ASP.NET 写的爬虫程序被屏蔽了，大家帮忙看看

[acertemper]

调试了好几个小时，找了好多方法，求大师帮忙



String server = "http://202.114.74.198/";
//请求URL
HttpWebRequest req = (HttpWebRequest)WebRequest.Create(url);
req.Accept = "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8";
req.ContentType = "application/x-www-form-urlencoded";
req.Headers.Add("Accept-Language: zh-CN,zh;q=0.8");
req.AllowAutoRedirect = false;
req.UserAgent = "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36";
req.KeepAlive = true;
req.Method = "GET";
req.Referer = server;
req.Timeout = 10000;
//获取Response
HttpWebResponse rep = (HttpWebResponse)req.GetResponse();
//rep.Cookies = req.CookieContainer.GetCookies(req.RequestUri);
//创建StreamReader与StreamWriter文件流对象
StreamReader sr = new StreamReader(rep.GetResponseStream(), Encoding.UTF8);
result = sr.ReadToEnd();
sr.Close();
sr.Dispose();

[泥菩萨]

抓的哪个网址？有可能是cookie验证了哦。

[秋的红果实]

首先，这个网址现在是打不开的 之所以跳转，可能是你的浏览器原因，当打不开某网页时自动跳转到别的指定网站；你的代码不会跳转

[acertemper]

模拟了GOOGLE浏览器访问，但是一抓取，就自动跳转了，用电脑浏览器是可以正常访问的

[wyn4397198]

现在很多网站为了防止爬虫，都加了token，楼主看看是不是有token验证。