blocks|key|1226079|text|下面是我的代码|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1226080|HttpWebRequest+httpWebRequest+=+null;
HttpWebResponse+httpWebResponse+=+null;
Stream+webResponseStream;
StreamReader+streamReader;
string+html+=+"";

try
{
++++UTF8Encoding+encoding+=+new+UTF8Encoding();
++++byte[]+data+=+encoding.GetBytes(postData);
++++httpWebRequest+=+(HttpWebRequest)WebRequest.Create(url);
++++httpWebRequest.UserAgent+=+"Mozilla/5.0+(Windows;+U;+Windows+NT+6.1;+en-US;+rv:1.9.1.7)+Gecko/20091221+Firefox/3.5.7+(.NET+CLR+3.5.30729)";
++++httpWebRequest.Accept+=+"text/html,application/xhtml%2Bxml,application/xml;q=0.9,*/*;q=0.8";
++++httpWebRequest.ContentType+=+"application/x-www-form-urlencoded";

++++httpWebRequest.KeepAlive+=+false;
++++httpWebRequest.Method+=+WebRequestMethods.Http.Post;

++++httpWebRequest.AllowAutoRedirect+=+true;
++++httpWebRequest.Headers.Add("Accept-Language",+"en-us");
++++httpWebRequest.ContentLength+=+data.Length;


++++Stream+dataStream+=+httpWebRequest.GetRequestStream();
++++dataStream.Write(data,+0,+data.Length);
++++dataStream.Close();

++++httpWebResponse+=+(HttpWebResponse)httpWebRequest.GetResponse();

++++webResponseStream+=+httpWebResponse.GetResponseStream();

++++//+Reading+the+webResponseStream+with+streamReader+object+and+assigning+into+one+string
++++streamReader+=+new+StreamReader(webResponseStream);

++++html+=+streamReader.ReadToEnd();

}
catch{

}

return+html;|code-block|syntax|javascript|1226081|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Below is my code

<pre><code>HttpWebRequest httpWebRequest = null;
HttpWebResponse httpWebResponse = null;
Stream webResponseStream;
StreamReader streamReader;
string html = "";

try
{
 UTF8Encoding encoding = new UTF8Encoding();
 byte[] data = encoding.GetBytes(postData);
 httpWebRequest = (HttpWebRequest)WebRequest.Create(url);
 httpWebRequest.UserAgent = "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)";
 httpWebRequest.Accept = "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8";
 httpWebRequest.ContentType = "application/x-www-form-urlencoded";

 httpWebRequest.KeepAlive = false;
 httpWebRequest.Method = WebRequestMethods.Http.Post;

 httpWebRequest.AllowAutoRedirect = true;
 httpWebRequest.Headers.Add("Accept-Language", "en-us");
 httpWebRequest.ContentLength = data.Length;


 Stream dataStream = httpWebRequest.GetRequestStream();
 dataStream.Write(data, 0, data.Length);
 dataStream.Close();

 httpWebResponse = (HttpWebResponse)httpWebRequest.GetResponse();

 webResponseStream = httpWebResponse.GetResponseStream();

 // Reading the webResponseStream with streamReader object and assigning into one string
 streamReader = new StreamReader(webResponseStream);

 html = streamReader.ReadToEnd();

}
catch{

}

return html;
</code></pre>

blocks|key|1144620|text|为什么不用下面这样简单的方法：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1144621|+WebClient+w+=+new+WebClient();
+string+pageSource+=+w.DownloadString(URL);|code-block|syntax|javascript|1144622|试一试，如果有效，则将所有其余属性添加到WebClient对象中|1144623|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

why not go with some thign simple like this:

<pre><code> WebClient w = new WebClient();
 string pageSource = w.DownloadString(URL);
</code></pre>

try this and if it works then add all the rest of your attributes to the WebClient object

blocks|key|861601|text|如果站点使用AJAX加载数据，那么使用HttpWebRequest可能不起作用。原因是该站点可能正在使用document.onLoad()或page.onLoad()方法向远程站点发出GET请求。这发生在浏览器中的javascript执行中。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|861602|如果你想让它工作，你有两个选择。|861603|1)发出对容器页面(您访问的主页)的请求，并向容器页面使用AJAX加载的包含页面发出第二个请求。为了找到包含的页面，您必须使用Firefox和firebug插件来确定内部页面的URL。|861604|2)使用一些支持Javascript和HTML/DOM的高层框架。例如，你可以尝试使用托管在.NET中的微软的WebBrowser控件，或者你也可以使用其他框架，只要框架支持javascript并理解HTML。|861605|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|J|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|K|8|@]|9|@]|A|$]]|$1|D|3|E|5|6|7|L|8|@]|9|@]|A|$]]|$1|F|3|G|5|6|7|M|8|@]|9|@]|A|$]]|$1|H|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|I|$]]

If the site is using AJAX to load data, then using HttpWebRequest might not work. The reason is that the site is probably using the document.onLoad() or page.onLoad() method to issue a GET request to the remote site. And this happens inside the javascript execution in the browser.

If you want to get this to work, you have two options.

1) Issue the request for the container page (the main page that you access), and a second request to the contained page that is being loaded by the container page using AJAX. In order to find the contained page, you will have to use Firefox with the firebug plugin to figure out the URL of the inner page.

2) Use some higher level frameworks that support Javascript and HTML/DOM. For eg, you could try using the WebBrowser control from microsoft, hosted in .NET. Or you could use other frameworks, provided the framework supports javascript and understands HTML.

I am trying to use httpWebRequest to get a complete web page, but the response that I get is not a complete web page because part of the web page is loaded by AJAX and this part takes a while (usually 10 - 30 seconds to load). Is there a way that I can set/force httpWebRequest to wait for a number of seconds before retrieving the content of a web page?

Any help would be greatly appreciated!

Thanks

HTTPWebRequest waits for content to load by Ajax

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

我正在尝试使用httpWebRequest来获得一个完整的网页，但我得到的响应不是一个完整的网页，因为网页的一部分是由AJAX加载的，这一部分需要一段时间(通常是10 - 30秒加载)。有没有办法让我设置/强制httpWebRequest在检索网页内容之前等待几秒钟？任何帮助都将不胜感激！谢谢

问HTTPWebRequest等待Ajax加载内容
EN

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问HTTPWebRequest等待Ajax加载内容EN