blocks|key|1263143|text|您可以使用ASCII字符是前128个字符，因此使用ord获取每个字符的数量，如果超出范围，则对其进行剔除|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1263144|#+-*-+coding:+utf-8+-*-

def+strip_non_ascii(string):
++++'''+Returns+the+string+without+non+ASCII+characters'''
++++stripped+=+(c+for+c+in+string+if+0+<+ord(c)+<+127)
++++return+''.join(stripped)


test+=+u'éáé123456tgreáé@€'
print+test
print+strip_non_ascii(test)|code-block|syntax|javascript|1263145|结果|1263146|éáé123456tgreáé@€
123456tgre@|1263147|请注意，包含@是因为它毕竟是一个ASCII码字符。如果您想要剥离特定的子集(如数字和大小写字母)，您可以限制查看ASCII+table的范围|1263148|编辑:在再次阅读您的问题后，也许您需要转义您的HTML代码，以便所有这些字符在呈现后都正确显示。您可以在模板上使用escape筛选器。|1263149|entityMap|0|LINK|mutability|MUTABLE|url|http://www.asciitable.com/^0|P|3|0|0|0|0|6|1|1K|B|0|0|1L|6|0^^$0|@$1|2|3|4|5|6|7|10|8|@$9|11|A|12|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|13|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|14|8|@]|D|@]|E|$]]|$1|M|3|N|5|H|7|15|8|@]|D|@]|E|$I|J]]|$1|O|3|P|5|6|7|16|8|@$9|17|A|18|B|C]]|D|@$9|19|A|1A|1|1B]]|E|$]]|$1|Q|3|R|5|6|7|1C|8|@$9|1D|A|1E|B|C]]|D|@]|E|$]]|$1|S|3|-4|5|6|7|1F|8|@]|D|@]|E|$]]]|T|$U|$5|V|W|X|E|$Y|Z]]]]

You can use that the ASCII characters are the first 128 ones, so get the number of each character with <code>ord</code> and strip it if it's out of range

<pre><code># -*- coding: utf-8 -*-

def strip_non_ascii(string):
 ''' Returns the string without non ASCII characters'''
 stripped = (c for c in string if 0 &lt; ord(c) &lt; 127)
 return ''.join(stripped)


test = u'éáé123456tgreáé@€'
print test
print strip_non_ascii(test)
</code></pre>

Result

<pre><code>éáé123456tgreáé@€
123456tgre@
</code></pre>

Please note that <code>@</code> is included because, well, after all it's an ASCII character. If you want to strip a particular subset (like just numbers and uppercase and lowercase letters), you can limit the range looking at a <a href="http://www.asciitable.com/" rel="noreferrer">ASCII table</a>

EDITED: After reading your question again, maybe you need to escape your HTML code, so all those characters appears correctly once rendered. You can use the <code>escape</code> filter on your templates.

blocks|key|1048502|text|这是我不久前发现的，所以这不是我的作品。我找不到源代码，但这是我代码中的代码片段。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1048503|def+unicode_escape(unistr):
++++"""
++++Tidys+up+unicode+entities+into+HTML+friendly+entities

++++Takes+a+unicode+string+as+an+argument

++++Returns+a+unicode+string
++++"""
++++import+htmlentitydefs
++++escaped+=+""

++++for+char+in+unistr:
++++++++if+ord(char)+in+htmlentitydefs.codepoint2name:
++++++++++++name+=+htmlentitydefs.codepoint2name.get(ord(char))
++++++++++++entity+=+htmlentitydefs.name2codepoint.get(name)
++++++++++++escaped+%2B="&#"+%2B+str(entity)

++++++++else:
++++++++++++escaped+%2B=+char

++++return+escaped|code-block|syntax|javascript|1048504|像这样使用它|1048505|>>>+from+zack.utilities+import+unicode_escape
>>>+unicode_escape(u'such+as+®+I+want')
u'such+as+&#174+I+want'|1048506|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

I found this a while ago, so this isn't in any way my work. I can't find the source, but here's the snippet from my code.

<pre><code>def unicode_escape(unistr):
 """
 Tidys up unicode entities into HTML friendly entities

 Takes a unicode string as an argument

 Returns a unicode string
 """
 import htmlentitydefs
 escaped = ""

 for char in unistr:
 if ord(char) in htmlentitydefs.codepoint2name:
 name = htmlentitydefs.codepoint2name.get(ord(char))
 entity = htmlentitydefs.name2codepoint.get(name)
 escaped +="&amp;#" + str(entity)

 else:
 escaped += char

 return escaped
</code></pre>

Use it like this

<pre><code>&gt;&gt;&gt; from zack.utilities import unicode_escape
&gt;&gt;&gt; unicode_escape(u'such as ® I want')
u'such as &amp;#174 I want'
</code></pre>

blocks|key|1048539|text|你不应该做任何事情，因为Django会自动转义字符：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1048540|请参阅：http://docs.djangoproject.com/en/dev/topics/templates/#id2|offset|length|1048541|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.djangoproject.com/en/dev/topics/templates/#id2^0|0|4|1M|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|O|8|@]|9|@$D|P|E|Q|1|R]]|A|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|A|$]]]|G|$H|$5|I|J|K|A|$L|M]]]]

You shouldn't have anything to do, as Django will automatically escape characters :

see : <a href="http://docs.djangoproject.com/en/dev/topics/templates/#id2" rel="nofollow noreferrer">http://docs.djangoproject.com/en/dev/topics/templates/#id2</a>

blocks|key|1048583|text|要删除特殊的xml、html字符'<‘、'>’、'&‘，您可以使用cgi.escape：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1048584|import+cgi
test+=+"1+<+4+&+4+>+1"
cgi.escape(test)|code-block|syntax|javascript|1048585|将返回：|1048586|'1+&lt;+4+&amp;+4+&gt;+1'|1048587|这可能是您需要避免的最低限度的问题。要获得更多信息，您必须了解字符串的编码方式。如果它适合你的html文档的编码，你不需要做更多的事情。如果不是，则必须转换为正确的编码。|1048588|test+=+test.decode("cp1252").encode("utf8")|1048589|假设字符串是cp1252，html文档是utf8|1048590|entityMap^0|0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|T|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|U|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|V|8|@]|9|@]|A|$E|F]]|$1|K|3|L|5|6|7|W|8|@]|9|@]|A|$]]|$1|M|3|N|5|D|7|X|8|@]|9|@]|A|$E|F]]|$1|O|3|P|5|6|7|Y|8|@]|9|@]|A|$]]|$1|Q|3|-4|5|6|7|Z|8|@]|9|@]|A|$]]]|R|$]]

To get rid of the special xml, html characters '&lt;', '>', '&amp;' you can use cgi.escape:

<pre><code>import cgi
test = "1 &lt; 4 &amp; 4 &gt; 1"
cgi.escape(test)
</code></pre>

Will return:

<pre><code>'1 &amp;lt; 4 &amp;amp; 4 &amp;gt; 1'
</code></pre>

This is probably the bare minimum you need to avoid problem.
For more you have to know the encoding of your string.
If it fit the encoding of your html document you don't have to do something more.
If not you have to convert to the correct encoding.

<pre><code>test = test.decode("cp1252").encode("utf8")
</code></pre>

Supposing that your string was cp1252 and that your html document is utf8

blocks|key|1048616|text|在https://stackoverflow.com/a/18430817/5100481上有一个简单得多的答案|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1048617|要从字符串s中删除非ASCII码字符，请使用：|style|CODE|1048618|s+=+s.encode('ascii',errors='ignore')|1048619|然后使用以下命令将其从字节转换回字符串：|1048620|s+=+s.decode()|1048621|所有这些都使用Python+3.6|1048622|entityMap|0|LINK|mutability|MUTABLE|url|https://stackoverflow.com/a/18430817/5100481^0|1|18|0|0|5|1|0|0|11|0|0|0|E|0|0^^$0|@$1|2|3|4|5|6|7|X|8|@]|9|@$A|Y|B|Z|1|10]]|C|$]]|$1|D|3|E|5|6|7|11|8|@$A|12|B|13|F|G]]|9|@]|C|$]]|$1|H|3|I|5|6|7|14|8|@$A|15|B|16|F|G]]|9|@]|C|$]]|$1|J|3|K|5|6|7|17|8|@]|9|@]|C|$]]|$1|L|3|M|5|6|7|18|8|@$A|19|B|1A|F|G]]|9|@]|C|$]]|$1|N|3|O|5|6|7|1B|8|@]|9|@]|C|$]]|$1|P|3|-4|5|6|7|1C|8|@]|9|@]|C|$]]]|Q|$R|$5|S|T|U|C|$V|W]]]]

There's a much simpler answer to this at <a href="https://stackoverflow.com/a/18430817/5100481">https://stackoverflow.com/a/18430817/5100481</a>

To remove non-ASCII characters from a string, <code>s</code>, use:

<code>s = s.encode('ascii',errors='ignore')</code>

Then convert it from bytes back to a string using:

<code>s = s.decode()</code>

This all using Python 3.6

I have a string of HTML stored in a database. Unfortunately it contains characters such as ®
I want to replace these characters by their HTML equivalent, either in the DB itself or using a Find Replace in my Python / Django code.

Any suggestions on how I can do this?

Remove non-ASCII characters from a string using python / django

数据库

Django

Python

我有一个存储在数据库中的HTML字符串。不幸的是，它包含诸如®之类的字符。我想将这些字符替换为它们的HTML等效项，要么在DB本身中，要么在我的Python / Django代码中使用Find replace。对如何做到这一点有什么建议吗？

问使用python / django从字符串中删除非ASCII字符
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问使用python / django从字符串中删除非ASCII字符EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问使用python / django从字符串中删除非ASCII字符
EN