blocks|key|1706687|text|如果您的HTML格式良好，您可以很容易地使用XML解析器为您完成这项工作……如果你只是在阅读，SAX将是理想的选择。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1706688|entityMap|0|LINK|mutability|MUTABLE|url|http://en.wikipedia.org/wiki/SAX^0|1B|3|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

If your HTML is well-formed, you can easily employ an XML parser to do the job for you... If you're only reading, <a href="http://en.wikipedia.org/wiki/SAX" rel="nofollow noreferrer">SAX</a> would be ideal.

blocks|key|1491705|text|您可能会对TagSoup感兴趣，它是一种能够处理格式错误的HTML的Java+HTML解析器。XML解析器只能在格式良好的XHTML上工作。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1491706|entityMap|0|LINK|mutability|MUTABLE|url|http://home.ccil.org/~cowan/XML/tagsoup/^0|5|7|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

You might be interested by <a href="http://home.ccil.org/~cowan/XML/tagsoup/" rel="noreferrer" title="TagSoup">TagSoup</a>, a Java HTML parser able to handle malformed HTML. XML parsers would work only on well formed XHTML.

blocks|key|1491774|text|HTMLParser项目(http://htmlparser.sourceforge.net/)可能是一种可能性。它在处理格式错误的HTML方面似乎相当不错。下面的代码片段应该能满足您的需求：|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1491775|Parser+parser+=+new+Parser(htmlInput);
CssSelectorNodeFilter+cssFilter+=+
++++new+CssSelectorNodeFilter("DIV.targetClassName");
NodeList+nodes+=+parser.parse(cssFilter);|code-block|syntax|javascript|1491776|entityMap|0|LINK|mutability|MUTABLE|url|http://htmlparser.sourceforge.net/^0|D|Y|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@$A|R|B|S|1|T]]|C|$]]|$1|D|3|E|5|F|7|U|8|@]|9|@]|C|$G|H]]|$1|I|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|J|$K|$5|L|M|N|C|$O|P]]]]

The HTMLParser project (<a href="http://htmlparser.sourceforge.net/" rel="noreferrer">http://htmlparser.sourceforge.net/</a>) might be a possibility. It seems to be pretty decent at handling malformed HTML. The following snippet should do what you need:

<pre><code>Parser parser = new Parser(htmlInput);
CssSelectorNodeFilter cssFilter = 
 new CssSelectorNodeFilter("DIV.targetClassName");
NodeList nodes = parser.parse(cssFilter);
</code></pre>

blocks|key|1706883|text|前面提到的主要问题是格式错误的HTML，因此html清理器或HTML-XML转换器是必须的。一旦获得了XML代码(XHTML)，就有很多工具可以处理它。您可以使用一个简单的SAX处理程序或任何基于树的方法(DOM、JDOM等)来获取它，该处理程序只提取您需要的数据。它甚至可以让你修改原始代码。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1706884|下面是一个示例代码，它使用HTML+cleaner获取使用某个类的所有DIVs，并打印出其中的所有文本内容。|offset|length|1706885|import+java.io.IOException;
import+java.net.URL;
import+java.util.ArrayList;
import+java.util.Iterator;
import+java.util.List;

import+org.htmlcleaner.HtmlCleaner;
import+org.htmlcleaner.TagNode;

/**
+*+@author+Fernando+Miguélez+Palomo+<fernandoDOTmiguelezATgmailDOTcom>
+*/
public+class+TestHtmlParse
{
++++static+final+String+className+=+"tags";
++++static+final+String+url+=+"http://www.stackoverflow.com";

++++TagNode+rootNode;

++++public+TestHtmlParse(URL+htmlPage)+throws+IOException
++++{
++++++++HtmlCleaner+cleaner+=+new+HtmlCleaner();
++++++++rootNode+=+cleaner.clean(htmlPage);
++++}

++++List+getDivsByClass(String+CSSClassname)
++++{
++++++++List+divList+=+new+ArrayList();

++++++++TagNode+divElements[]+=+rootNode.getElementsByName("div",+true);
++++++++for+(int+i+=+0;+divElements+!=+null+&&+i+<+divElements.length;+i%2B%2B)
++++++++{
++++++++++++String+classType+=+divElements[i].getAttributeByName("class");
++++++++++++if+(classType+!=+null+&&+classType.equals(CSSClassname))
++++++++++++{
++++++++++++++++divList.add(divElements[i]);
++++++++++++}
++++++++}

++++++++return+divList;
++++}

++++public+static+void+main(String[]+args)
++++{
++++++++try
++++++++{
++++++++++++TestHtmlParse+thp+=+new+TestHtmlParse(new+URL(url));

++++++++++++List+divs+=+thp.getDivsByClass(className);
++++++++++++System.out.println("***+Text+of+DIVs+with+class+'"%2BclassName%2B"'+at+'"%2Burl%2B"'+***");
++++++++++++for+(Iterator+iterator+=+divs.iterator();+iterator.hasNext();)
++++++++++++{
++++++++++++++++TagNode+divElement+=+(TagNode)+iterator.next();
++++++++++++++++System.out.println("Text+child+nodes+of+DIV:+"+%2B+divElement.getText().toString());
++++++++++++}
++++++++}
++++++++catch(Exception+e)
++++++++{
++++++++++++e.printStackTrace();
++++++++}
++++}
}|code-block|syntax|javascript|1706886|entityMap|0|LINK|mutability|MUTABLE|url|http://htmlcleaner.sourceforge.net/^0|0|D|C|0|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|T|8|@]|9|@$D|U|E|V|1|W]]|A|$]]|$1|F|3|G|5|H|7|X|8|@]|9|@]|A|$I|J]]|$1|K|3|-4|5|6|7|Y|8|@]|9|@]|A|$]]]|L|$M|$5|N|O|P|A|$Q|R]]]]

The main problem as stated by preceding coments is malformed HTML, so an html cleaner or HTML-XML converter is a must. Once you get the XML code (XHTML) there are plenty of tools to handle it. You could get it with a simple SAX handler that extracts only the data you need or any tree-based method (DOM, JDOM, etc.) that let you even modify original code.

Here is a sample code that uses <a href="http://htmlcleaner.sourceforge.net/" rel="noreferrer">HTML cleaner</a> to get all DIVs that use a certain class and print out all Text content inside it.

<pre><code>import java.io.IOException;
import java.net.URL;
import java.util.ArrayList;
import java.util.Iterator;
import java.util.List;

import org.htmlcleaner.HtmlCleaner;
import org.htmlcleaner.TagNode;

/**
 * @author Fernando Miguélez Palomo &lt;fernandoDOTmiguelezATgmailDOTcom&gt;
 */
public class TestHtmlParse
{
 static final String className = "tags";
 static final String url = "http://www.stackoverflow.com";

 TagNode rootNode;

 public TestHtmlParse(URL htmlPage) throws IOException
 {
 HtmlCleaner cleaner = new HtmlCleaner();
 rootNode = cleaner.clean(htmlPage);
 }

 List getDivsByClass(String CSSClassname)
 {
 List divList = new ArrayList();

 TagNode divElements[] = rootNode.getElementsByName("div", true);
 for (int i = 0; divElements != null &amp;&amp; i &lt; divElements.length; i++)
 {
 String classType = divElements[i].getAttributeByName("class");
 if (classType != null &amp;&amp; classType.equals(CSSClassname))
 {
 divList.add(divElements[i]);
 }
 }

 return divList;
 }

 public static void main(String[] args)
 {
 try
 {
 TestHtmlParse thp = new TestHtmlParse(new URL(url));

 List divs = thp.getDivsByClass(className);
 System.out.println("*** Text of DIVs with class '"+className+"' at '"+url+"' ***");
 for (Iterator iterator = divs.iterator(); iterator.hasNext();)
 {
 TagNode divElement = (TagNode) iterator.next();
 System.out.println("Text child nodes of DIV: " + divElement.getText().toString());
 }
 }
 catch(Exception e)
 {
 e.printStackTrace();
 }
 }
}
</code></pre>

blocks|key|1491929|text|几年前，我将JTidy用于同样的目的：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1491930|http://jtidy.sourceforge.net/|offset|length|1491931|"JTidy是HTML的一个Java端口，一个超文本标记语言语法检查器和漂亮的打印机。像它的非Java表亲一样，JTidy可以被用作清理错误和错误超文本标记语言的工具。此外，JTidy为正在处理的文档提供了一个DOM接口，这使得你能够有效地使用JTidy作为真实超文本标记语言的DOM解析器。|1491932|JTidy是由Andy+Quick编写的，他后来辞去了维护者的职务。现在JTidy是由一群志愿者维护的。|1491933|可以在JTidy+SourceForge项目页面上找到有关JTidy的更多信息。“|1491934|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|T|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|T|8|@]|9|@$D|U|E|V|1|W]]|A|$]]|$1|F|3|G|5|6|7|X|8|@]|9|@]|A|$]]|$1|H|3|I|5|6|7|Y|8|@]|9|@]|A|$]]|$1|J|3|K|5|6|7|Z|8|@]|9|@]|A|$]]|$1|L|3|-4|5|6|7|10|8|@]|9|@]|A|$]]]|M|$N|$5|O|P|Q|A|$R|C]]]]

Several years ago I used JTidy for the same purpose:

<a href="http://jtidy.sourceforge.net/" rel="noreferrer">http://jtidy.sourceforge.net/</a>

"JTidy is a Java port of HTML Tidy, a HTML syntax checker and pretty printer. Like its non-Java cousin, JTidy can be used as a tool for cleaning up malformed and faulty HTML. In addition, JTidy provides a DOM interface to the document that is being processed, which effectively makes you able to use JTidy as a DOM parser for real-world HTML.

JTidy was written by Andy Quick, who later stepped down from the maintainer position. Now JTidy is maintained by a group of volunteers.

More information on JTidy can be found on the JTidy SourceForge project page ."

blocks|key|1491988|text|HTMLUnit可能会有所帮助。它也能做更多的事情。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1491989|http://htmlunit.sourceforge.net/1|offset|length|1491990|entityMap|0|LINK|mutability|MUTABLE|url|http://htmlunit.sourceforge.net/|1^0|0|0|W|0|W|1|1|0^^$0|@$1|2|3|4|5|6|7|O|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|P|8|@]|9|@$D|Q|E|R|1|S]|$D|T|E|U|1|V]]|A|$]]|$1|F|3|-4|5|6|7|W|8|@]|9|@]|A|$]]]|G|$H|$5|I|J|K|A|$L|M]]|N|$5|I|J|K|A|$L|M]]]]

HTMLUnit might be of help. It does a lot more stuff too.

<a href="http://htmlunit.sourceforge.net/" rel="nofollow noreferrer">http://htmlunit.sourceforge.net/</a><a href="http://htmlunit.sourceforge.net/" rel="nofollow noreferrer">1</a>

blocks|key|1707063|text|杰里科：http://jericho.htmlparser.net/docs/index.html|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1707064|简单易用，支持格式不好的HTML，有很多例子。|1707065|entityMap|0|LINK|mutability|MUTABLE|url|http://jericho.htmlparser.net/docs/index.html^0|4|19|0|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]]|C|$]]|$1|D|3|E|5|6|7|R|8|@]|9|@]|C|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|M]]]]

Jericho: <a href="http://jericho.htmlparser.net/docs/index.html" rel="noreferrer">http://jericho.htmlparser.net/docs/index.html</a>

Easy to use, supports not well formed HTML, a lot of examples.

blocks|key|1707127|text|另一个可能对HTML处理有用的库是jsoup。Jsoup试图清理格式错误的HTML，并允许使用类似于标签选择器语法的jQuery在Java语言中进行html解析。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1707128|http://jsoup.org/|offset|length|1707129|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|H|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|N|8|@]|9|@$D|O|E|P|1|Q]]|A|$]]|$1|F|3|-4|5|6|7|R|8|@]|9|@]|A|$]]]|G|$H|$5|I|J|K|A|$L|C]]]]

Another library that might be useful for HTML processing is jsoup.
Jsoup tries to clean malformed HTML and allows html parsing in Java using jQuery like tag selector syntax.

<a href="http://jsoup.org/">http://jsoup.org/</a>

blocks|key|1492178|text|您也可以使用XWiki+HTML+Cleaner|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1492179|它使用HTMLCleaner并对其进行扩展以生成有效的XHTML1.1内容。|1492180|entityMap|0|LINK|mutability|MUTABLE|url|http://extensions.xwiki.org/xwiki/bin/view/Extension/XML%2BModule|1|http://htmlcleaner.sourceforge.net/^0|6|I|0|0|3|B|1|0^^$0|@$1|2|3|4|5|6|7|P|8|@]|9|@$A|Q|B|R|1|S]]|C|$]]|$1|D|3|E|5|6|7|T|8|@]|9|@$A|U|B|V|1|W]]|C|$]]|$1|F|3|-4|5|6|7|X|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|M]]|N|$5|I|J|K|C|$L|O]]]]

You can also use <a href="http://extensions.xwiki.org/xwiki/bin/view/Extension/XML+Module" rel="nofollow">XWiki HTML Cleaner</a>:

It uses <a href="http://htmlcleaner.sourceforge.net" rel="nofollow">HTMLCleaner</a> and extends it to generate valid XHTML 1.1 content.

blocks|key|1492250|text|让我们不要忘记Jerry，它在Java中的jQuery+:一个快速而简洁的Java+Library，它简化了HTML文档的解析、遍历和操作；包括css3选择器的使用。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1492251|示例：|1492252|Jerry+doc+=+jerry(html);
doc.$("div#jodd+p.neat").css("color",+"red").addClass("ohmy");|code-block|syntax|javascript|1492253|1492254|doc.form("#myform",+new+JerryFormHandler()+{
++++public+void+onForm(Jerry+form,+Map<String,+String[]>+parameters)+{
++++++++//+process+form+and+parameters
++++}
});|1492255|当然，这些只是一些快速的例子，让你感受一下这一切是什么样子的。|1492256|entityMap|0|LINK|mutability|MUTABLE|url|http://jodd.org/doc/jerry/index.html^0|7|5|0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|X|8|@]|9|@$A|Y|B|Z|1|10]]|C|$]]|$1|D|3|E|5|6|7|11|8|@]|9|@]|C|$]]|$1|F|3|G|5|H|7|12|8|@]|9|@]|C|$I|J]]|$1|K|3|E|5|6|7|13|8|@]|9|@]|C|$]]|$1|L|3|M|5|H|7|14|8|@]|9|@]|C|$I|J]]|$1|N|3|O|5|6|7|15|8|@]|9|@]|C|$]]|$1|P|3|-4|5|6|7|16|8|@]|9|@]|C|$]]]|Q|$R|$5|S|T|U|C|$V|W]]]]

Let's not forget <a href="http://jodd.org/doc/jerry/index.html" rel="nofollow">Jerry</a>, its jQuery in java: a fast and concise Java Library that simplifies HTML document parsing, traversing and manipulating; includes usage of css3 selectors.

Example:

<pre><code>Jerry doc = jerry(html);
doc.$("div#jodd p.neat").css("color", "red").addClass("ohmy");
</code></pre>

Example:

<pre><code>doc.form("#myform", new JerryFormHandler() {
 public void onForm(Jerry form, Map&lt;String, String[]&gt; parameters) {
 // process form and parameters
 }
});
</code></pre>

Of course, these are just some quick examples to get the feeling how it all looks like.

I'm working on an app which scrapes data from a website and I was wondering how I should go about getting the data. Specifically I need data contained in a number of div tags which use a specific CSS class - Currently (for testing purposes) I'm just checking for 

<pre><code>div class = "classname"
</code></pre>

in each line of HTML - This works, but I can't help but feel there is a better solution out there. 

Is there any nice way where I could give a class a line of HTML and have some nice methods like:

<pre><code>boolean usesClass(String CSSClassname);
String getText();
String getLink();
</code></pre>

Java HTML Parsing

我正在开发一个从网站上抓取数据的应用程序，我想知道我应该如何去获取数据。具体地说，我需要一些使用特定CSS类的div标记中包含的数据--目前(出于测试目的)，我只是在检查div class = "classname"在HTML的每一行中-这是有效的，但我不禁觉得有一个更好的解决方案。有没有什么好的方法可以让我给一个类一...

问Java HTML解析
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问Java HTML解析EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问Java HTML解析
EN