贴一下我要爬的页面的 内容吧
<p><a href="test.asp?id=1">number</a><br />
<a href="test.asp?id=a">alpha</a><br />
<a href="test.asp?id=a3">combination</a><br />
<a href="test.asp?id=test.exe">mixed</a><br />
<a href="test.asp?id=1&id2=a">number+alpha</a><br />
<a href="test.asp?id=1&id2=a3">number+combination</a><br />
<a href="test.asp?id2=test.pdf&id=1">number+mixed</a><br />
<a href="test.asp?id=a&id2=a4">alpha+combination</a><br />
<a href="test.asp?id=a&id2=test.exe">alpha+mixed</a><br />
<a href="test.asp?id=123d&id2=test.exe">combination+mixed</a><br />
<a href="test.asp?id=1&id2=a&id3=du2">number+alpha+combination</a><br />
<a href="test.asp?id=1&id2=a&id3=test.exe">number+alpha+mixed</a><br />
<a href="test.asp?id=234&id2=af2de&id3=test.exe">number+combination+mixed</a><br />
<a href="test.asp?id=a&id2=af2de&id3=test.exe">alpha+combination+mixed</a><br />
<a href="test.asp?id=1&id2=sd&id3=ds2&id4=test.exe">number+alpha+combination+mixed</a><br />
</p>
<p> </p>
<p><a href="vnc-E4_5-x86_x64_win32.zip">vnc-E4_5-x86_x64_win32.zip</a></p>
<p> </p>
<p><a href="wireshark-win32-1.2.9.exe">exe</a></p>
爬取到的URL
http://127.0.0.1
http://127.0.0.1/test.asp?id=1
http://127.0.0.1/test.asp?id=a
http://127.0.0.1/test.asp?id=a3
http://127.0.0.1/test.asp?id=1&id2=a
http://127.0.0.1/test.asp?id=1&id2=a3
http://127.0.0.1/test.asp?id2=test.pdf&id=1
http://127.0.0.1/test.asp?id=a&id2=a4
http://127.0.0.1/test.asp?id=1&id2=a&id3=du2
No more URLs to spider
9
求解决方案啊，看文档半天没发现哪里可以设置抓取页面类型的设置，
AddAvoidOutboundLinkPattern
AddAvoidPattern
AddMustMatchPattern
AddUnspidered
这几个函数都不管用啊，在蜘蛛返回的URL中根本找不到我需要的链接，头大头大啊。
