获取页面源代码，怎么老是报“远程服务器返回错误: (500) 内部服务器错误”？

Pitt 2008-12-08 10:34:11

        /// <summary>

        /// 通过URL执行WEN后获取页面内容

        /// </summary>

        /// <param name="url"></param>

        public static string ExecutePage(string urlstr)

        {

            string content = "";



            if (urlstr.IndexOf("http://", StringComparison.OrdinalIgnoreCase) != 0 && urlstr.IndexOf("/") == 0)

            {

                urlstr = "http://" + HttpContext.Current.Request.Url.Host + urlstr;

            }

            else if (urlstr.IndexOf("http://", StringComparison.OrdinalIgnoreCase) != 0)

            {

                urlstr = "http://" + urlstr;

            }



            System.Net.WebResponse wResp = null;

            System.IO.Stream respStream = null;

            System.IO.StreamReader reader = null;

            try

            {

                Uri url = new Uri(urlstr);

                System.Net.WebRequest wReq = System.Net.WebRequest.Create(url);

                wResp = wReq.GetResponse();

                respStream = wResp.GetResponseStream();

                reader = new System.IO.StreamReader(respStream, System.Text.Encoding.GetEncoding("utf-8"));

                content = reader.ReadToEnd();                

            }

            catch (System.Net.WebException ex)

            {

                //return ex.Source + ":" + urlstr;

                throw;

            }

            finally 

            {

                if (reader!= null)

                    reader.Close();

                if (respStream != null)

                    respStream.Close();

                if (wResp != null)

                    wResp.Close();



            }

            return content;

        }

调用ExecutePage("http://www.163.com") 正常。

调用ExecutePage("http://localhost") 正常。

调用ExecutePage("http://localhost/ReviewBox/ReviewArticle.aspx?id=1") 报错。

http://localhost/ReviewBox/ReviewArticle.aspx?id=1 正常显示.

...全文

780 27 打赏收藏转发到动态举报

写回复

用AI写文章

27 条回复

切换为时间正序

请发表友善的回复…

发表回复

kitsmiler 2009-06-05

打赏
举报

被抓取的页面按照你参数的方式肯定报错了，你可以调试一下，直接用字符串的形式访问，看报不报错。我就是这样解决的这个问题的。

rubylily_2009 2009-05-21

打赏
举报

遇到同样问题，求答案

zhnzzy 2008-12-09

打赏
举报

断点试试呀，应该是你URL重写那里出了点问题

yefengzhixia 2008-12-09

打赏
举报

恩顶了！！虽然我不知道为什么。。。。呵呵呵欢迎加入c#新群 63242231 共同学习

Pitt 2008-12-09

打赏
举报

参数(HttpRequest request )

string sUserAgent = request.UserAgent;是NULL

有什么办法？

Pitt 2008-12-09

打赏
举报

ReviewArticle.aspx 页面有个FCKedit 就有NULL，怎么解决了？

Pitt 2008-12-09

打赏
举报

总算找到原因了，ReviewArticle.aspx 页面有个FCKedit

<html>
<head>
<title>未将对象引用设置到对象的实例。</title>
<style>
body {font-family:"Verdana";font-weight:normal;font-size: .7em;color:black;}
p {font-family:"Verdana";font-weight:normal;color:black;margin-top: -5px}
b {font-family:"Verdana";font-weight:bold;color:black;margin-top: -5px}
H1 { font-family:"Verdana";font-weight:normal;font-size:18pt;color:red }
H2 { font-family:"Verdana";font-weight:normal;font-size:14pt;color:maroon }
pre {font-family:"Lucida Console";font-size: .9em}
.marker {font-weight: bold; color: black;text-decoration: none;}
.version {color: gray;}
.error {margin-bottom: 10px;}
.expandable { text-decoration:underline; font-weight:bold; color:navy; cursor:hand; }
</style>
</head>

<body bgcolor="white">

<span><H1>“/”应用程序中的服务器错误。<hr width=100% size=1 color=silver></H1>

<h2> <i>未将对象引用设置到对象的实例。</i> </h2></span>

<font face="Arial, Helvetica, Geneva, SunSans-Regular, sans-serif ">

<b> 说明: </b>执行当前 Web 请求期间，出现未处理的异常。请检查堆栈跟踪信息，以了解有关该错误以及代码中导致错误的出处的详细信息。

<br><br>

<b> 异常详细信息: </b>System.NullReferenceException: 未将对象引用设置到对象的实例。<br><br>

<b>源错误:</b> <br><br>

<table width=100% bgcolor="#ffffcc">
<tr>
<td>
<code>

执行当前 Web 请求期间生成了未处理的异常。可以使用下面的异常堆栈跟踪信息确定有关异常原因和发生位置的信息。</code>

</td>
</tr>
</table>

<br>

<b>堆栈跟踪:</b> <br><br>

<table width=100% bgcolor="#ffffcc">
<tr>
<td>
<code><pre>

[NullReferenceException: 未将对象引用设置到对象的实例。]
FredCK.FCKeditorV2.FCKeditor.IsCompatibleBrowser(HttpRequest request) in C:\Documents and Settings\xsasa\桌面\FCKeditor.Net_2.6.3\FCKeditor.cs:494
FredCK.FCKeditorV2.FCKeditor.IsCompatibleBrowser() in C:\Documents and Settings\xsasa\桌面\FCKeditor.Net_2.6.3\FCKeditor.cs:476
FredCK.FCKeditorV2.FCKeditor.CheckBrowserCompatibility() in C:\Documents and Settings\xsasa\桌面\FCKeditor.Net_2.6.3\FCKeditor.cs:466
FredCK.FCKeditorV2.FCKeditor.OnPreRender(EventArgs e) in C:\Documents and Settings\xsasa\桌面\FCKeditor.Net_2.6.3\FCKeditor.cs:400
System.Web.UI.Control.PreRenderRecursiveInternal() +80
System.Web.UI.Control.PreRenderRecursiveInternal() +171
System.Web.UI.Control.PreRenderRecursiveInternal() +171
System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint) +842
</pre></code>

</td>
</tr>
</table>

<br>

<hr width=100% size=1 color=silver>

<b>版本信息:</b> Microsoft .NET Framework 版本:2.0.50727.3053; ASP.NET 版本:2.0.50727.3053

</font>

</body>
</html>

qinhl99 2008-12-09

打赏
举报

或者参考下:
http://topic.csdn.net/t/20020924/14/1049079.html

Pitt 2008-12-09

打赏
举报

忘了说后来我把ID换成articleNO了

qinhl99 2008-12-09

打赏
举报

改成下面测试下:

System.Net.HttpWebResponse wResp = null;
System.IO.Stream respStream = null;
System.IO.StreamReader reader = null;
try
{
Uri url = new Uri(urlstr);
System.Net.WebRequest wReq = System.Net.WebRequest.Create(url);
wResp = (HttpWebResponse)wReq.GetResponse();
respStream = wResp.GetResponseStream();
reader = new System.IO.StreamReader(respStream, System.Text.Encoding.GetEncoding("utf-8"));
content = reader.ReadToEnd();
}
catch (System.Net.WebException ex)
{
//return ex.Source + ":" + urlstr;
throw;
}

Pitt 2008-12-09

打赏
举报

        protected void Page_Load(object sender, EventArgs e)

        {            

            if (!IsPostBack)

            {

                string artNO = this.Request["articleNO"];

                if (artNO == null || artNO == "")

                {

                    return;

                    //这里我就退出去了，不知这样可以吗？

                }                

                modelart = bllart.GetModel(artNO);

                if (modelart == null)

                {

                    return;

                }

            }

        }