scrapy的header authorization

[取啥都被占用]

各位大神小牛，
抓取时候遇到需要用户名密码登录这种情况，想问一下大家是怎么玩的？
本人试验了好久都不成功。
试过中间件HttpAuthMiddleware，没疗效。

又想仿命令行的成功实验：
以下的code参照了这篇：https://stackoverflow.com/questions/42824249/how-can-use-scrapy-shell-with-url-and-basic-auth-credentials

import scrapy
from w3lib.http import basic_auth_header
from scrapy import Request
import sys  # So to export Chinese characters
reload(sys)# So to export Chinese characters
sys.setdefaultencoding('utf8')# So to export Chinese characters

class MyxmlSpider(scrapy.Spider):
	name = "PXML"
	f = open("Batch.txt")
	start_urls = [url.strip() for url in f.readlines()]
	f.close()

	def make_requests_from_url(self,url):
		auth = basic_auth_header("[e-mail]", "TS!")
		return Request(url,headers={'Authorization':auth})

	def parse(self, response):
		myItems  = ['B','BD','BG','BH','BQ']
                #rest of the code

求有经验的同学点拨，非常谢谢！

[取啥都被占用]

自己已经解决了这个问题。关于user-agent，以及之后redirection 报错要加个non_filter的参数。