blocks|key|988329|text|您可以使用以下形式的内容|type|unstyled|depth|inlineStyleRanges|entityRanges|data|988330|s.decode('utf-8')|code-block|syntax|javascript|988331|这将把UTF-8编码的字节串转换成Python+Unicode串。但是使用的确切过程取决于加载和解析XML文件的方式，例如，如果您从未直接访问XML字符串，则可能必须使用codecs+module中的解码器对象。|offset|length|style|CODE|988332|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.python.org/library/codecs.html^0|0|0|2D|6|2D|D|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|V|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|W|8|@$I|X|J|Y|K|L]]|9|@$I|Z|J|10|1|11]]|A|$]]|$1|M|3|-4|5|6|7|12|8|@]|9|@]|A|$]]]|N|$O|$5|P|Q|R|A|$S|T]]]]

You can use something of the form

<pre><code>s.decode('utf-8')
</code></pre>

which will convert a UTF-8 encoded bytestring into a Python Unicode string. But the exact procedure to use depends on exactly how you load and parse the XML file, e.g. if you don't ever access the XML string directly, you might have to use a decoder object from the <a href="http://docs.python.org/library/codecs.html" rel="nofollow noreferrer"><code>codecs</code> module</a>.

blocks|key|988517|text|您的问题很可能是您正确地解析了它，而现在您试图打印XML的内容，但却无法打印，因为其中有一些外来的Unicode字符。首先尝试将unicode字符串编码为ascii：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|988518|unicodeData.encode('ascii',+'ignore')|code-block|syntax|javascript|988519|“忽略”部分将告诉它跳过这些字符。从python文档中：|988520|>>>+#+Python+2:+u+=+unichr(40960)+%2B+u'abcd'+%2B+unichr(1972)
>>>+u+=+chr(40960)+%2B+u'abcd'+%2B+chr(1972)
>>>+u.encode('utf-8')
'\xea\x80\x80abcd\xde\xb4'
>>>+u.encode('ascii')
Traceback+(most+recent+call+last):
++File+"<stdin>",+line+1,+in+?
UnicodeEncodeError:+'ascii'+codec+can't+encode+character+'\ua000'+in+position+0:+ordinal+not+in+range(128)
>>>+u.encode('ascii',+'ignore')
'abcd'
>>>+u.encode('ascii',+'replace')
'?abcd?'
>>>+u.encode('ascii',+'xmlcharrefreplace')
'&#40960;abcd&#1972;'|988521|您可能想要阅读这篇文章：http://www.joelonsoftware.com/articles/Unicode.html，我发现这篇文章非常有用，它是关于正在发生的事情的基本教程。阅读之后，您将不再觉得您只是在猜测要使用的命令(或者至少在我身上发生了这种情况)。|offset|length|988522|entityMap|0|LINK|mutability|MUTABLE|url|http://www.joelonsoftware.com/articles/Unicode.html^0|0|0|0|0|C|1F|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|X|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|Y|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|Z|8|@]|9|@]|A|$E|F]]|$1|K|3|L|5|6|7|10|8|@]|9|@$M|11|N|12|1|13]]|A|$]]|$1|O|3|-4|5|6|7|14|8|@]|9|@]|A|$]]]|P|$Q|$5|R|S|T|A|$U|V]]]]

Likely, your problem is that you parsed it okay, and now you're trying to print the contents of the XML and you can't because theres some foreign Unicode characters. Try to encode your unicode string as ascii first:
<pre><code>unicodeData.encode('ascii', 'ignore')
</code></pre>
the 'ignore' part will tell it to just skip those characters. From the python docs:
<pre><code>&gt;&gt;&gt; # Python 2: u = unichr(40960) + u'abcd' + unichr(1972)
&gt;&gt;&gt; u = chr(40960) + u'abcd' + chr(1972)
&gt;&gt;&gt; u.encode('utf-8')
'\xea\x80\x80abcd\xde\xb4'
&gt;&gt;&gt; u.encode('ascii')
Traceback (most recent call last):
 File &quot;&lt;stdin&gt;&quot;, line 1, in ?
UnicodeEncodeError: 'ascii' codec can't encode character '\ua000' in position 0: ordinal not in range(128)
&gt;&gt;&gt; u.encode('ascii', 'ignore')
'abcd'
&gt;&gt;&gt; u.encode('ascii', 'replace')
'?abcd?'
&gt;&gt;&gt; u.encode('ascii', 'xmlcharrefreplace')
'&amp;#40960;abcd&amp;#1972;'
</code></pre>
You might want to read this article: <a href="http://www.joelonsoftware.com/articles/Unicode.html" rel="nofollow noreferrer">http://www.joelonsoftware.com/articles/Unicode.html</a>, which I found very useful as a basic tutorial on what's going on. After the read, you'll stop feeling like you're just guessing what commands to use (or at least that happened to me).

blocks|key|988580|text|更好的解决方案：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|988581|if+type(value)+==+str:
++++#+Ignore+errors+even+if+the+string+is+not+proper+UTF-8+or+has
++++#+broken+marker+bytes.
++++#+Python+built-in+function+unicode()+can+do+this.
++++value+=+unicode(value,+"utf-8",+errors="ignore")
else:
++++#+Assume+the+value+object+has+proper+__unicode__()+method
++++value+=+unicode(value)|code-block|syntax|javascript|988582|如果您想了解更多关于原因的信息：|988583|http://docs.plone.org/manage/troubleshooting/unicode.html#id1|offset|length|988584|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|0|0|1P|0|0^^$0|@$1|2|3|4|5|6|7|T|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|U|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|V|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|W|8|@]|9|@$K|X|L|Y|1|Z]]|A|$]]|$1|M|3|-4|5|6|7|10|8|@]|9|@]|A|$]]]|N|$O|$5|P|Q|R|A|$S|J]]]]

A better solution:

<pre><code>if type(value) == str:
 # Ignore errors even if the string is not proper UTF-8 or has
 # broken marker bytes.
 # Python built-in function unicode() can do this.
 value = unicode(value, "utf-8", errors="ignore")
else:
 # Assume the value object has proper __unicode__() method
 value = unicode(value)
</code></pre>

If you would like to read more about why:

<a href="http://docs.plone.org/manage/troubleshooting/unicode.html#id1">http://docs.plone.org/manage/troubleshooting/unicode.html#id1</a>

blocks|key|1203121|text|不要在脚本中对环境的字符编码进行硬编码；直接打印Unicode文本：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1203122|assert+isinstance(text,+unicode)+#+or+str+on+Python+3
print(text)|code-block|syntax|javascript|1203123|如果将输出重定向到文件(或管道)；您可以使用PYTHONIOENCODING环境变量来指定字符编码：|offset|length|style|CODE|1203124|$+PYTHONIOENCODING=utf-8+python+your_script.py+>output.utf8|1203125|否则，python+your_script.py应该按原样工作--您的语言环境设置用于对文本进行编码(on+POSIX+check：LC_ALL，LC_CTYPE，LANG+envvars+-如果需要，请将LANG设置为utf-8语言环境)。|1203126|To+print+Unicode+on+Windows,+see+this+answer+that+shows+how+to+print+Unicode+to+Windows+console,+to+a+file,+or+using+IDLE。|1203127|entityMap|0|LINK|mutability|MUTABLE|url|https://stackoverflow.com/a/30982765/4279^0|0|0|M|G|0|0|3|L|1U|6|21|8|2A|4|2V|4|0|0|3D|0|0^^$0|@$1|2|3|4|5|6|7|10|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|11|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|12|8|@$I|13|J|14|K|L]]|9|@]|A|$]]|$1|M|3|N|5|D|7|15|8|@]|9|@]|A|$E|F]]|$1|O|3|P|5|6|7|16|8|@$I|17|J|18|K|L]|$I|19|J|1A|K|L]|$I|1B|J|1C|K|L]|$I|1D|J|1E|K|L]|$I|1F|J|1G|K|L]]|9|@]|A|$]]|$1|Q|3|R|5|6|7|1H|8|@]|9|@$I|1I|J|1J|1|1K]]|A|$]]|$1|S|3|-4|5|6|7|1L|8|@]|9|@]|A|$]]]|T|$U|$5|V|W|X|A|$Y|Z]]]]

Don't hardcode the character encoding of your environment inside your script; print Unicode text directly instead:

<pre><code>assert isinstance(text, unicode) # or str on Python 3
print(text)
</code></pre>

If your output is redirected to a file (or a pipe); you could use <code>PYTHONIOENCODING</code> envvar, to specify the character encoding:

<pre><code>$ PYTHONIOENCODING=utf-8 python your_script.py &gt;output.utf8
</code></pre>

Otherwise, <code>python your_script.py</code> should work as is -- your locale settings are used to encode the text (on POSIX check: <code>LC_ALL</code>, <code>LC_CTYPE</code>, <code>LANG</code> envvars -- set <code>LANG</code> to a utf-8 locale if necessary).

<a href="https://stackoverflow.com/a/30982765/4279">To print Unicode on Windows, see this answer that shows how to print Unicode to Windows console, to a file, or using IDLE</a>.

blocks|key|1203172|text|我写了以下修复讨厌的非ascii引用，并强制转换为有用的东西。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1203173|unicodeToAsciiMap+=+{u'\u2019':"'",+u'\u2018':"`",+}

def+unicodeToAscii(inStr):
++++try:
++++++++return+str(inStr)
++++except:
++++++++pass
++++outStr+=+""
++++for+i+in+inStr:
++++++++try:
++++++++++++outStr+=+outStr+%2B+str(i)
++++++++except:
++++++++++++if+unicodeToAsciiMap.has_key(i):
++++++++++++++++outStr+=+outStr+%2B+unicodeToAsciiMap[i]
++++++++++++else:
++++++++++++++++try:
++++++++++++++++++++print+"unicodeToAscii:+add+to+map:",+i,+repr(i),+"(encoded+as+_)"
++++++++++++++++except:
++++++++++++++++++++print+"unicodeToAscii:+unknown+code+(encoded+as+_)",+repr(i)
++++++++++++++++outStr+=+outStr+%2B+"_"
++++return+outStr|code-block|syntax|javascript|1203174|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

I wrote the following to fix the nuisance non-ascii quotes and force conversion to something usable.

<pre><code>unicodeToAsciiMap = {u'\u2019':"'", u'\u2018':"`", }

def unicodeToAscii(inStr):
 try:
 return str(inStr)
 except:
 pass
 outStr = ""
 for i in inStr:
 try:
 outStr = outStr + str(i)
 except:
 if unicodeToAsciiMap.has_key(i):
 outStr = outStr + unicodeToAsciiMap[i]
 else:
 try:
 print "unicodeToAscii: add to map:", i, repr(i), "(encoded as _)"
 except:
 print "unicodeToAscii: unknown code (encoded as _)", repr(i)
 outStr = outStr + "_"
 return outStr
</code></pre>

blocks|key|988722|text|尝试在python脚本的顶部添加以下行。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|988723|#+_*_+coding:utf-8+_*_|code-block|syntax|javascript|988724|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Try adding the following line at the top of your python script.

<pre><code># _*_ coding:utf-8 _*_
</code></pre>

blocks|key|1203207|text|优秀帖子：http://www.carlosble.com/2010/12/understanding-python-and-unicode/|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1203208|#+-*-+coding:+utf-8+-*-

def+__if_number_get_string(number):
++++converted_str+=+number
++++if+isinstance(number,+int)+or+\
++++++++++++isinstance(number,+float):
++++++++converted_str+=+str(number)
++++return+converted_str


def+get_unicode(strOrUnicode,+encoding='utf-8'):
++++strOrUnicode+=+__if_number_get_string(strOrUnicode)
++++if+isinstance(strOrUnicode,+unicode):
++++++++return+strOrUnicode
++++return+unicode(strOrUnicode,+encoding,+errors='ignore')


def+get_string(strOrUnicode,+encoding='utf-8'):
++++strOrUnicode+=+__if_number_get_string(strOrUnicode)
++++if+isinstance(strOrUnicode,+unicode):
++++++++return+strOrUnicode.encode(encoding)
++++return+strOrUnicode|code-block|syntax|javascript|1203209|entityMap|0|LINK|mutability|MUTABLE|url|http://www.carlosble.com/2010/12/understanding-python-and-unicode/^0|5|1U|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@$A|R|B|S|1|T]]|C|$]]|$1|D|3|E|5|F|7|U|8|@]|9|@]|C|$G|H]]|$1|I|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|J|$K|$5|L|M|N|C|$O|P]]]]

Excellent post : <a href="http://www.carlosble.com/2010/12/understanding-python-and-unicode/" rel="nofollow">http://www.carlosble.com/2010/12/understanding-python-and-unicode/</a>

<pre><code># -*- coding: utf-8 -*-

def __if_number_get_string(number):
 converted_str = number
 if isinstance(number, int) or \
 isinstance(number, float):
 converted_str = str(number)
 return converted_str


def get_unicode(strOrUnicode, encoding='utf-8'):
 strOrUnicode = __if_number_get_string(strOrUnicode)
 if isinstance(strOrUnicode, unicode):
 return strOrUnicode
 return unicode(strOrUnicode, encoding, errors='ignore')


def get_string(strOrUnicode, encoding='utf-8'):
 strOrUnicode = __if_number_get_string(strOrUnicode)
 if isinstance(strOrUnicode, unicode):
 return strOrUnicode.encode(encoding)
 return strOrUnicode
</code></pre>

blocks|key|1203258|text|如果您需要将字符串的近似表示形式打印到屏幕上，而不是忽略那些不可打印的字符，请在此处尝试unidecode包：|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1203259|https://pypi.python.org/pypi/Unidecode|1203260|这里有一个解释：|1203261|https://www.tablix.org/~avian/blog/archives/2009/01/unicode_transliteration_in_python/|1203262|这比对给定的字符串u使用u.encode('ascii',+'ignore')更好，并且可以避免不必要的麻烦，如果您不想要字符精度，但仍然希望具有人类可读性。|1203263|Wirawan|1203264|entityMap|0|LINK|mutability|MUTABLE|url|1^0|18|9|0|0|12|0|0|0|0|2E|1|0|9|1|C|R|0|0^^$0|@$1|2|3|4|5|6|7|X|8|@$9|Y|A|Z|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|10|8|@]|D|@$9|11|A|12|1|13]]|E|$]]|$1|H|3|I|5|6|7|14|8|@]|D|@]|E|$]]|$1|J|3|K|5|6|7|15|8|@]|D|@$9|16|A|17|1|18]]|E|$]]|$1|L|3|M|5|6|7|19|8|@$9|1A|A|1B|B|C]|$9|1C|A|1D|B|C]]|D|@]|E|$]]|$1|N|3|O|5|6|7|1E|8|@]|D|@]|E|$]]|$1|P|3|-4|5|6|7|1F|8|@]|D|@]|E|$]]]|Q|$R|$5|S|T|U|E|$V|G]]|W|$5|S|T|U|E|$V|K]]]]

If you need to print an approximate representation of the string to the screen, rather than ignoring those nonprintable characters, please try <code>unidecode</code> package here:

<a href="https://pypi.python.org/pypi/Unidecode" rel="nofollow noreferrer">https://pypi.python.org/pypi/Unidecode</a>

The explanation is found here:

<a href="https://www.tablix.org/~avian/blog/archives/2009/01/unicode_transliteration_in_python/" rel="nofollow noreferrer">https://www.tablix.org/~avian/blog/archives/2009/01/unicode_transliteration_in_python/</a>

This is better than using the <code>u.encode('ascii', 'ignore')</code> for a given string <code>u</code>, and can save you from unnecessary headache if character precision is not what you are after, but still want to have human readability.

Wirawan

I'm reading and parsing an Amazon XML file and while the XML file shows a ' , when I try to print it I get the following error:

<pre><code>'ascii' codec can't encode character u'\u2019' in position 16: ordinal not in range(128) 
</code></pre>

From what I've read online thus far, the error is coming from the fact that the XML file is in UTF-8, but Python wants to handle it as an ASCII encoded character. Is there a simple way to make the error go away and have my program print the XML as it reads?

Python Unicode Encode Error

Python

我正在读取和解析Amazon XML文件，当XML文件显示‘时，当我尝试打印它时，我得到以下错误：'ascii' codec can't encode character u'\u2019' in position 16: ordinal not in range(128) 根据我到目前为止在网上读到的内容，错误是由于...

问Python Unicode编码错误
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问Python Unicode编码错误EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问Python Unicode编码错误
EN