运行scrapy爬虫时出错

[11122323l123]

利用scrapy 爬取天猫商品页相关的东西，但是报错，，，找了好久也不知道怎么解决，，望大神能指导一下。错误如下：

2017-03-15 08:49:11 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'detail.tmall.com': <GET https://detail.tmall.com/item.htm?id=521811263733>
2017-03-15 08:49:11 [scrapy.core.engine] INFO: Closing spider (finished)
2017-03-15 08:49:11 [scrapy.core.engine] ERROR: Scraper close failure
Traceback (most recent call last):
  File "e:\python35\lib\site-packages\twisted\internet\defer.py", line 653, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
TypeError: close_spider() takes 1 positional argument but 2 were given

页面源码为：

class MyxdSpider(scrapy.Spider):
    name = "myxd"
    allowed_domains = ["miaoyuxiaodiaosp.tmall.com"]
    start_urls = ['http://miaoyuxiaodiaosp.tmall.com/']

    def parse(self, response):
        url = "https://miaoyuxiaodiaosp.tmall.com/search.htm"
        yield Request(url=url, callback=self.page)

    def page(self, response):
        urldata = response.xpath("//div[@class='item4line1']//dl/@data-id").extract()
        # print(urldata)
        # print(len(urldata))
        for j in range(0, len(urldata)):
            thisid = urldata[j]
            urll = "https://detail.tmall.com/item.htm?id=" + str(thisid)
            # print(urll)
            yield Request(url=urll, callback=self.final_buzou)

    def final_buzou(self, response):
        print(response.url)

[龙熙]

我也有一样的问题，不知道怎么解决

[宇风 -飞扬]

scrapy.contrib.spiders已经过时了，请用scrapy.spiders替代 from scrapy.contrib.spiders import CrawlSpider 换成 from scrapy.spiders import CrawlSpider

[turbobin]

此问题我也出现过很多次，后来我发现把pipelines.py里 def close_spider(self): print("关闭爬虫......") self.f.close() 改成 def close_spider(self,spider): print("关闭爬虫......") self.f.close() 就好了。这里是覆盖方法，spider参数没用到也必须加上。