blocks|key|478207|text|我使用了python-boilerpipe，到目前为止，它工作得很好……|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|478208|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/misja/python-boilerpipe^0|4|H|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

I used <a href="https://github.com/misja/python-boilerpipe" rel="nofollow">python-boilerpipe</a> and it works very well, so far...

blocks|key|478104|text|最简单的方法是使用类似这样的转储(简而言之，是可视HTML的文本版本)。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|478105|远程文件：|478106|lynx+--dump+www.google.com+>+file.txt
links+-dump+www.google.com|code-block|syntax|javascript|478107|本地文件：|478108|lynx+--dump+./1.html+>+file.txt
links+-dump+./1.htm|478109|使用字符集转换为utf8+(see)：|offset|length|478110|lynx+-dump+-display_charset+UTF-8+./1.htm
links+-dump+-codepage+UTF-8+./1.htm|478111|entityMap|0|LINK|mutability|MUTABLE|url|http://www.microhowto.info/howto/convert_from_html_to_formatted_plain_text.html^0|0|0|0|0|0|E|3|0|0|0^^$0|@$1|2|3|4|5|6|7|10|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|11|8|@]|9|@]|A|$]]|$1|D|3|E|5|F|7|12|8|@]|9|@]|A|$G|H]]|$1|I|3|J|5|6|7|13|8|@]|9|@]|A|$]]|$1|K|3|L|5|F|7|14|8|@]|9|@]|A|$G|H]]|$1|M|3|N|5|6|7|15|8|@]|9|@$O|16|P|17|1|18]]|A|$]]|$1|Q|3|R|5|F|7|19|8|@]|9|@]|A|$G|H]]|$1|S|3|-4|5|6|7|1A|8|@]|9|@]|A|$]]]|T|$U|$5|V|W|X|A|$Y|Z]]]]

Easiest way is to use something like this which the dump (in short is the text version of viewable HTML).
Remote file:
<pre><code>lynx --dump www.google.com &gt; file.txt
links -dump www.google.com
</code></pre>
Local file:
<pre><code>lynx --dump ./1.html &gt; file.txt
links -dump ./1.htm
</code></pre>
With charset conversion to utf8 (<a href="http://www.microhowto.info/howto/convert_from_html_to_formatted_plain_text.html" rel="nofollow noreferrer">see</a>):
<pre><code>lynx -dump -display_charset UTF-8 ./1.htm
links -dump -codepage UTF-8 ./1.htm
</code></pre>

blocks|key|261209|text|命令行上有html2text.py。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|261210|用法：html2text.py+[(filename%7Curl)+[encoding]]|style|CODE|261211|Options:
++--version+++++++++++++show+program's+version+number+and+exit
++-h,+--help++++++++++++show+this+help+message+and+exit
++--ignore-links++++++++don't+include+any+formatting+for+links
++--ignore-images+++++++don't+include+any+formatting+for+images
++-g,+--google-doc++++++convert+an+html-exported+Google+Document
++-d,+--dash-unordered-list
++++++++++++++++++++++++use+a+dash+rather+than+a+star+for+unordered+list+items
++-b+BODY_WIDTH,+--body-width=BODY_WIDTH
++++++++++++++++++++++++number+of+characters+per+output+line,+0+for+no+wrap
++-i+LIST_INDENT,+--google-list-indent=LIST_INDENT
++++++++++++++++++++++++number+of+pixels+Google+indents+nested+lists
++-s,+--hide-strikethrough
++++++++++++++++++++++++hide+strike-through+text.+only+relevent+when+-g+is
++++++++++++++++++++++++specified+as+well|code-block|syntax|javascript|261212|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/aaronsw/html2text^0|5|C|0|0|3|14|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@]|9|@$A|V|B|W|1|X]]|C|$]]|$1|D|3|E|5|6|7|Y|8|@$A|Z|B|10|F|G]]|9|@]|C|$]]|$1|H|3|I|5|J|7|11|8|@]|9|@]|C|$K|L]]|$1|M|3|-4|5|6|7|12|8|@]|9|@]|C|$]]]|N|$O|$5|P|Q|R|C|$S|T]]]]

You have <a href="https://github.com/aaronsw/html2text" rel="nofollow noreferrer">html2text.py</a> on command line.

Usage: <code>html2text.py [(filename|url) [encoding]]</code>

<pre><code>Options:
 --version show program's version number and exit
 -h, --help show this help message and exit
 --ignore-links don't include any formatting for links
 --ignore-images don't include any formatting for images
 -g, --google-doc convert an html-exported Google Document
 -d, --dash-unordered-list
 use a dash rather than a star for unordered list items
 -b BODY_WIDTH, --body-width=BODY_WIDTH
 number of characters per output line, 0 for no wrap
 -i LIST_INDENT, --google-list-indent=LIST_INDENT
 number of pixels Google indents nested lists
 -s, --hide-strikethrough
 hide strike-through text. only relevent when -g is
 specified as well
</code></pre>

blocks|key|261630|text|在OSX上，你可以使用一个名为textutil的命令行工具将html文件批量转换为txt格式：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|261631|textutil+-convert+txt+*.html|code-block|syntax|javascript|261632|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

On OSX you can use the command line tool called textutil to batch convert html files to txt format:

<pre><code>textutil -convert txt *.html
</code></pre>

blocks|key|261612|text|在ubuntu/debian中，html2text是一个很好的选择。http://linux.die.net/man/1/html2text|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|261613|entityMap|0|LINK|mutability|MUTABLE|url|http://linux.die.net/man/1/html2text^0|G|9|Y|10|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@$9|O|A|P|B|C]]|D|@$9|Q|A|R|1|S]]|E|$]]|$1|F|3|-4|5|6|7|T|8|@]|D|@]|E|$]]]|G|$H|$5|I|J|K|E|$L|M]]]]

in ubuntu/debian <code>html2text</code> is a good select. <a href="http://linux.die.net/man/1/html2text" rel="nofollow noreferrer">http://linux.die.net/man/1/html2text</a>

blocks|key|261561|text|您可以获取nodejs并全局安装模块html-to-text|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|261562|npm+install+-g+html-to-text|code-block|syntax|javascript|261563|然后像这样使用它：|261564|html-to-text+<+stuff.html+>+stuff.txt|261565|entityMap|0|LINK|mutability|MUTABLE|url|http://nodejs.org/|1|https://npmjs.org/package/html-to-text^0|5|6|0|I|C|1|0|0|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@$A|X|B|Y|1|Z]|$A|10|B|11|1|12]]|C|$]]|$1|D|3|E|5|F|7|13|8|@]|9|@]|C|$G|H]]|$1|I|3|J|5|6|7|14|8|@]|9|@]|C|$]]|$1|K|3|L|5|F|7|15|8|@]|9|@]|C|$G|H]]|$1|M|3|-4|5|6|7|16|8|@]|9|@]|C|$]]]|N|$O|$5|P|Q|R|C|$S|T]]|U|$5|P|Q|R|C|$S|V]]]]

You could get <a href="http://nodejs.org/" rel="nofollow noreferrer">nodejs</a> and globally install the module <a href="https://npmjs.org/package/html-to-text" rel="nofollow noreferrer">html-to-text</a>:

<pre><code>npm install -g html-to-text
</code></pre>

Then use it like this:

<pre><code>html-to-text &lt; stuff.html &gt; stuff.txt
</code></pre>

blocks|key|478162|text|使用sed|type|unstyled|depth|inlineStyleRanges|entityRanges|data|478163|sed+-e+'s/<[%5E>]*>//g'+foo.html|code-block|syntax|javascript|478164|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Using sed

<pre><code>sed -e 's/&lt;[^&gt;]*&gt;//g' foo.html
</code></pre>

blocks|key|478067|text|我认为links是做这件事最常用的工具。检查手册链接并搜索纯文本或类似内容。-dump是我的猜测，也可以搜索一下。该软件随大多数发行版一起提供。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|478068|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

I think links is the most common tool to do this. Check man links and search for plain text or similar. -dump is my guess, search for that too. The software comes with most distributions.

blocks|key|261594|text|本地htm+&+html文件的批处理模式，需要lynx|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|261595|#!/bin/sh
#+h2t,+convert+all+htm+and+html+files+of+a+directory+to+text+

for+file+in+`ls+*.htm`
do
new=`basename+$file+htm`
lynx+-dump+$file+>+${new}txt+
done
#####
for+file+in+`ls+*.html`
do
new=`basename+$file+html`
lynx+-dump+$file+>+${new}txt+
done|code-block|syntax|javascript|261596|entityMap^0|N|4|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@$9|N|A|O|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|P|8|@]|D|@]|E|$I|J]]|$1|K|3|-4|5|6|7|Q|8|@]|D|@]|E|$]]]|L|$]]

batch mode for local htm &amp; html file, <code>lynx</code> required

<pre><code>#!/bin/sh
# h2t, convert all htm and html files of a directory to text 

for file in `ls *.htm`
do
new=`basename $file htm`
lynx -dump $file &gt; ${new}txt 
done
#####
for file in `ls *.html`
do
new=`basename $file html`
lynx -dump $file &gt; ${new}txt 
done
</code></pre>

blocks|key|261713|text|将html页面递归转换为文本文件的Bash脚本。应用于httpd-manual。使grep+-Rhi+'LoadModule+ssl‘/usr/share/httpd/manual_dump+-A+10工作起来更方便。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|261714|#!/bin/sh
#+Adapted+from+ewwink,+recursive+html+to+txt+dump
#+Made+to+kind+of+recursively+(4+levels)+dump+the+/usr/share/httpd+manual+to+a+dump+httpd+manual+directory+into+a+txt+dump+including+dir
#+put+this+script+in+/usr/share/httpd+for+it+to+work+(after+installing+httpd-manual+rpm)

for+file+in+./manual/*{,/*,/*/*,/*/*/*}.html
do
new=`basename+$file+.html`
mkdir+-p+./manual_dump/${new}
lynx+--dump+$file+>+./manual_dump/${new}.txt
done|code-block|syntax|javascript|261715|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Bash script to recursively convert html page to text file. 
Applied to httpd-manual.
Makes grep -Rhi 'LoadModule ssl' /usr/share/httpd/manual_dump -A 10 work convenient.

<pre><code>#!/bin/sh
# Adapted from ewwink, recursive html to txt dump
# Made to kind of recursively (4 levels) dump the /usr/share/httpd manual to a dump httpd manual directory into a txt dump including dir
# put this script in /usr/share/httpd for it to work (after installing httpd-manual rpm)

for file in ./manual/*{,/*,/*/*,/*/*/*}.html
do
new=`basename $file .html`
mkdir -p ./manual_dump/${new}
lynx --dump $file &gt; ./manual_dump/${new}.txt
done
</code></pre>

blocks|key|261753|text|pandoc工具可以将HTML转换为纯文本(在其他几种标记格式中)，与这里的answers中的其他几个工具相比，我更喜欢它格式化文本的方式-它像浏览器一样使用大量空格，而不是像html2text那样将所有内容打包在一起。您可能想要比较几个工具，然后选择一个。要在Ubuntu或Debian上安装它：|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|261754|sudo+apt+install+pandoc|code-block|syntax|javascript|261755|它有从文件读取和写入文件的选项，但我发现在管道模式中使用它最容易，在管道模式中，您只需指定要转换的格式：|261756|curl+URL+%7C+pandoc+-f+html+-t+plain+>+output.txt|261757|entityMap|0|LINK|mutability|MUTABLE|url|https://pandoc.org/^0|2G|9|0|6|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@$9|X|A|Y|B|C]]|D|@$9|Z|A|10|1|11]]|E|$]]|$1|F|3|G|5|H|7|12|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|13|8|@]|D|@]|E|$]]|$1|M|3|N|5|H|7|14|8|@]|D|@]|E|$I|J]]|$1|O|3|-4|5|6|7|15|8|@]|D|@]|E|$]]]|P|$Q|$5|R|S|T|E|$U|V]]]]

The <a href="https://pandoc.org/" rel="nofollow noreferrer">pandoc</a> tool can convert HTML to plain text (among several other markup formats) and I prefer how it formats text when compared to several of the other tools in answers here — it uses lots of whitespace, like a browser does, instead of packing everything together like <code>html2text</code> does. You might want to compare a few tools and then select one. To install it on Ubuntu or Debian:
<pre><code>sudo apt install pandoc
</code></pre>
It has options to read and write from files, but I find it easiest to use in pipe mode, where you only have to specify the format to convert from and to:
<pre><code>curl URL | pandoc -f html -t plain &gt; output.txt
</code></pre>

I am a beginner to linux. Would you please help me how to convert an html page to a text file. the text file will remove any images and links from the webpage. I want to use only bash commands and not html to text converting tools. As an example, i want to convert the first page google search results for "computers".

Thank you

bash command to convert html page to a text file

命令行工具

Ubuntu

Debian

我是linux的初学者。你能帮我把html页面转换成文本文件吗？该文本文件将从网页中删除所有图像和链接。我只想使用bash命令，而不是html到文本转换工具。作为一个例子，我想转换第一页谷歌搜索结果中的“计算机”。谢谢

问用于将html页面转换为文本文件的bash命令
EN

回答 11

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问用于将html页面转换为文本文件的bash命令EN

回答 11

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问用于将html页面转换为文本文件的bash命令
EN