62,244
社区成员
发帖
与我相关
我的任务
分享使用.NET是否可读取远程网页的内容到变量中？
我想做一个信息收集系统，如想把SINA末一新闻自动收集到我的数据库中（当然需要经过特殊处理），不知道如何将一页网页内容放到变量中。
...全文
请发表友善的回复…
发表回复
171717 2004-05-06
- 打赏
- 举报
ASP.NET如何跨站抓取页面
在这里用到了好几个类：WebRequestFactory、HttpWebRequest、HTTPWEBRESPONSE 和 STREAMREADER。前三个用来建立一个HTTP连接，然后通过此连接建立一个STREAMREADER对象，最后将得到的数据赋值给一个字符变量，在页面上显示。
Loogoo.com.aspx
<%@ Assembly Name="System.Net" %>
<%@ Import Namespace="System.Net" %>
<%@ Import Namespace="System.IO" %>
<script language="VB" runat="server">
Sub Page_Load(Src As Object, E As EventArgs)
Dim HttpWResp as HTTPWebresponse
Dim sr As StreamReader
dim STRtemp as string
text1.text = ""
HttpWReq = WebRequestFactory.Create("http://www.Loogoo.com")
HttpWReq.KeepAlive = false
HttpWResp = HttpWReq.GetResponse()
sr = new StreamReader(HttpWResp.GetResponseStream(), Encoding.ASCII)
Try
line=sr.ReadLine()
do while line <> null
line = sr.ReadLine()
lineENC = server.HTMLencode(line) & vbcrlf & "
"
text1.text = text1.text & lineENC
loop
Catch ex As Exception
text1.text = "发生错误: " & ex.Message
End Try
End Sub
</script>
<html><head>
<title>乐购跨站抓取</title>
</head>
<body bgcolor="#FFFFFF">
<h3><font face="Verdana">抓来得数据</font></h3>
<asp:TextBox id="text1" Width="600px" Textmode="multiline" rows="40"
runat="server"/>
</body></html>
在这里用到了好几个类：WebRequestFactory、HttpWebRequest、HTTPWEBRESPONSE 和 STREAMREADER。前三个用来建立一个HTTP连接，然后通过此连接建立一个STREAMREADER对象，最后将得到的数据赋值给一个字符变量，在页面上显示。
Loogoo.com.aspx
<%@ Assembly Name="System.Net" %>
<%@ Import Namespace="System.Net" %>
<%@ Import Namespace="System.IO" %>
<script language="VB" runat="server">
Sub Page_Load(Src As Object, E As EventArgs)
Dim HttpWResp as HTTPWebresponse
Dim sr As StreamReader
dim STRtemp as string
text1.text = ""
HttpWReq = WebRequestFactory.Create("http://www.Loogoo.com")
HttpWReq.KeepAlive = false
HttpWResp = HttpWReq.GetResponse()
sr = new StreamReader(HttpWResp.GetResponseStream(), Encoding.ASCII)
Try
line=sr.ReadLine()
do while line <> null
line = sr.ReadLine()
lineENC = server.HTMLencode(line) & vbcrlf & "
"
text1.text = text1.text & lineENC
loop
Catch ex As Exception
text1.text = "发生错误: " & ex.Message
End Try
End Sub
</script>
<html><head>
<title>乐购跨站抓取</title>
</head>
<body bgcolor="#FFFFFF">
<h3><font face="Verdana">抓来得数据</font></h3>
<asp:TextBox id="text1" Width="600px" Textmode="multiline" rows="40"
runat="server"/>
</body></html>
1979xt 2004-05-05
- 打赏
- 举报
WebClient或WebRequest。
http://dotnet.aspx.cc/ShowDetail.aspx?id=0A6660CE-4138-41EF-B882-15DB65564709
http://dotnet.aspx.cc/ShowDetail.aspx?id=C2BCFA0A-D4E5-4791-87F3-C0B2AA2B7B5B
http://dotnet.aspx.cc/ShowDetail.aspx?id=0A6660CE-4138-41EF-B882-15DB65564709
http://dotnet.aspx.cc/ShowDetail.aspx?id=C2BCFA0A-D4E5-4791-87F3-C0B2AA2B7B5B
jhxiaoma 2004-05-05
- 打赏
- 举报
是否可以给段代码？
mikespook 2004-05-05
- 打赏
- 举报
XMLHTTP组件可以~~~~
