blocks|key|1295311|text|简单地去掉标签和多余的换行符可以接受吗？|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1295312|html.gsub(/<\/?[%5E>]*>/,+'').gsub(/\n\n%2B/,+"\n").gsub(/%5E\n%7C\n$/,+'')|code-block|syntax|javascript|1295313|第一次剥离标签，第二次将重复的换行符分解为一个，第三次删除字符串开始和结束处的换行符。|1295314|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

Is simply stripping tags and excess line breaks acceptable?

<pre><code>html.gsub(/&lt;\/?[^&gt;]*&gt;/, '').gsub(/\n\n+/, "\n").gsub(/^\n|\n$/, '')
</code></pre>

First strips tags, second takes duplicate line breaks down to one, third removes line breaks at the start and end of the string.

blocks|key|1295334|text|实际上，这要简单得多：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1295335|require+'rubygems'
require+'nokogiri'

puts+Nokogiri::HTML(my_html).text|code-block|syntax|javascript|1295336|不过，您仍然有换行符的问题，所以您必须自己弄清楚如何处理这些问题。|1295337|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

Actually, this is much simpler:

<pre><code>require 'rubygems'
require 'nokogiri'

puts Nokogiri::HTML(my_html).text
</code></pre>

You still have line break issues, though, so you're going to have to figure out how you want to handle those yourself.

blocks|key|1295366|text|您可以从如下内容开始：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1295367|require+'open-uri'
require+'rubygems'
require+'nokogiri'

uri+=+'http://stackoverflow.com/questions/2505104/html-to-plain-text-with-ruby'
doc+=+Nokogiri::HTML(open(uri))
doc.css('script,+link').each+{+%7Cnode%7C+node.remove+}
puts+doc.css('body').text.squeeze("+\n")|code-block|syntax|javascript|1295368|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

You could start with something like this:

<pre><code>require 'open-uri'
require 'rubygems'
require 'nokogiri'

uri = 'http://stackoverflow.com/questions/2505104/html-to-plain-text-with-ruby'
doc = Nokogiri::HTML(open(uri))
doc.css('script, link').each { |node| node.remove }
puts doc.css('body').text.squeeze(" \n")
</code></pre>

blocks|key|1080352|text|你想要hpricot_scrub：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1080353|http://github.com/UnderpantsGnome/hpricot_scrub|offset|length|1080354|您可以指定在配置散列中剥离/保留哪些标记。|1080355|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|1B|0|0|0^^$0|@$1|2|3|4|5|6|7|O|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|P|8|@]|9|@$D|Q|E|R|1|S]]|A|$]]|$1|F|3|G|5|6|7|T|8|@]|9|@]|A|$]]|$1|H|3|-4|5|6|7|U|8|@]|9|@]|A|$]]]|I|$J|$5|K|L|M|A|$N|C]]]]

You want hpricot_scrub:

<a href="http://github.com/UnderpantsGnome/hpricot_scrub" rel="nofollow noreferrer">http://github.com/UnderpantsGnome/hpricot_scrub</a>

You can specify which tags to strip / keep in a config hash.

blocks|key|1295455|text|我使用的是sanitize+gem。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1295456|("+"+%2B+Sanitize.clean(html).gsub("\n",+"\n\n").strip).gsub(/%5E+/,+"\t")|code-block|syntax|javascript|1295457|但它确实会删除超链接，这对某些应用程序来说可能是一个问题。但是我正在做NLP文本分析，所以这非常适合我的需要。|1295458|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/rgrove/sanitize^0|5|8|5|8|0|0|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@$9|V|A|W|B|C]]|D|@$9|X|A|Y|1|Z]]|E|$]]|$1|F|3|G|5|H|7|10|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|11|8|@]|D|@]|E|$]]|$1|M|3|-4|5|6|7|12|8|@]|D|@]|E|$]]]|N|$O|$5|P|Q|R|E|$S|T]]]]

I'm using the <a href="https://github.com/rgrove/sanitize" rel="nofollow noreferrer"><code>sanitize</code></a> gem.

<pre><code>(" " + Sanitize.clean(html).gsub("\n", "\n\n").strip).gsub(/^ /, "\t")
</code></pre>

It does drop hyperlinks though, which may be an issue for some applications. But I'm doing NLP text analysis, so this is perfect for my needs.

blocks|key|1080464|text|require+'open-uri'
require+'nokogiri'

url+=+'http://en.wikipedia.org/wiki/Wolfram_language'
doc+=+Nokogiri::HTML(open(url))

text+=+''
doc.css('p,h1').each+do+%7Ce%7C
++text+<<+e.content
end

puts+text|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|1080465|这只会从网页中提取所需的文本(大多数情况下)。例如，如果您还想包含链接，则将a添加到块中的css类。|unstyled|offset|length|style|CODE|1080466|entityMap^0|0|12|1|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$B|C]]|$1|D|3|E|5|F|7|N|8|@$G|O|H|P|I|J]]|9|@]|A|$]]|$1|K|3|-4|5|F|7|Q|8|@]|9|@]|A|$]]]|L|$]]

<pre><code>require 'open-uri'
require 'nokogiri'

url = 'http://en.wikipedia.org/wiki/Wolfram_language'
doc = Nokogiri::HTML(open(url))

text = ''
doc.css('p,h1').each do |e|
 text &lt;&lt; e.content
end

puts text
</code></pre>

This extracts just the desired text from a webpage (most of the time). If for example you wanted to also include links then add <code>a</code> to the css classes in the block.

blocks|key|1080537|text|如果是在rails中，您可以使用以下代码：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1080538|html_escape_once(value).gsub("\n",+"\r\n ").html_safe|code-block|syntax|javascript|1080539|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

if its in rails, you may use this:

<pre><code>html_escape_once(value).gsub("\n", "\r\n&lt;br/&gt;").html_safe
</code></pre>

blocks|key|1295599|text|基于Matchu的回答，这对我的(非常相似的)需求是有效的：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1295600|html.gsub(/<\/?[%5E>]*>/,+'+').gsub(/\n\n%2B/,+'\n').gsub(/%5E\n%7C\n$/,+'+').squish|code-block|syntax|javascript|1295601|希望这能让别人的生活更轻松一些:-)|1295602|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

Building slightly on Matchu's answer, this worked for my (very similar) requirements:

<pre><code>html.gsub(/&lt;\/?[^&gt;]*&gt;/, ' ').gsub(/\n\n+/, '\n').gsub(/^\n|\n$/, ' ').squish
</code></pre>

Hope it makes someone's life a bit easier :-)

blocks|key|1080625|text|如果您使用的是rails，则可以：html+=+'<div+class="asd">hello+world</div>Hola +que+tal'+puts+ActionView::Base.full_sanitizer.sanitize(html)|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1080626|entityMap^0|H|3N|0^^$0|@$1|2|3|4|5|6|7|H|8|@$9|I|A|J|B|C]]|D|@]|E|$]]|$1|F|3|-4|5|6|7|K|8|@]|D|@]|E|$]]]|G|$]]

if you are using rails you can:
<code>
html = '&lt;div class="asd"&gt;hello world&lt;/div&gt;&lt;p&gt;&lt;span&gt;Hola&lt;/span&gt;&lt;br&gt; que tal&lt;/p&gt;'
puts ActionView::Base.full_sanitizer.sanitize(html)
</code>

Is there anything out there to convert html to plain text (maybe a nokogiri script)? Something that would keep the line breaks, but that's about it.

If I write something on googledocs, like <a href="http://docs.google.com/View?id=dffk85xk_63f29hv2hn">this</a>, and run that command, it outputs (removing the css and javascript), this:

<pre><code>\n\n\n\n\nh1. Test&amp;nbsp;h2. HELLO THEREI am some teexton the next line!!!OKAY!#*!)$!
</code></pre>

So the formatting's all messed up. I'm sure someone has solved the details like these somewhere out there.

HTML to Plain Text with Ruby?

文本分析

有没有什么东西可以将html转换成纯文本(可能是nokogiri脚本)？一些可以保持断行的东西，但仅此而已。如果我在googledocs上编写一些东西，比如，并运行该命令，它会输出(删除css和javascript)，如下所示：\n\n\n\n\nh1. Test&nbsp;h2. HELLO THEREI am so...

问用Ruby将HTML转换为纯文本？
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问用Ruby将HTML转换为纯文本？EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问用Ruby将HTML转换为纯文本？
EN