blocks|key|1090949|text|在Python+2中|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1090950|>>>+plain_string+=+"Hi!"
>>>+unicode_string+=+u"Hi!"
>>>+type(plain_string),+type(unicode_string)
(<type+'str'>,+<type+'unicode'>)|code-block|syntax|javascript|1090951|%5E这是字节字符串(plain_string)和unicode字符串之间的区别。|1090952|>>>+s+=+"Hello!"
>>>+u+=+unicode(s,+"utf-8")|1090953|%5E转换为unicode并指定编码。|1090954|在Python+3中|1090955|所有字符串都是unicode。unicode函数不再存在。查看@Noumenon的答案|offset|length|style|CODE|1090956|entityMap^0|0|0|0|0|0|0|F|7|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|X|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|Y|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|Z|8|@]|9|@]|A|$E|F]]|$1|K|3|L|5|6|7|10|8|@]|9|@]|A|$]]|$1|M|3|N|5|6|7|11|8|@]|9|@]|A|$]]|$1|O|3|P|5|6|7|12|8|@$Q|13|R|14|S|T]]|9|@]|A|$]]|$1|U|3|-4|5|6|7|15|8|@]|9|@]|A|$]]]|V|$]]

<h3>In Python 2</h3>
<pre><code>&gt;&gt;&gt; plain_string = &quot;Hi!&quot;
&gt;&gt;&gt; unicode_string = u&quot;Hi!&quot;
&gt;&gt;&gt; type(plain_string), type(unicode_string)
(&lt;type 'str'&gt;, &lt;type 'unicode'&gt;)
</code></pre>
^ This is the difference between a byte string (plain_string) and a unicode string.
<pre><code>&gt;&gt;&gt; s = &quot;Hello!&quot;
&gt;&gt;&gt; u = unicode(s, &quot;utf-8&quot;)
</code></pre>
^ Converting to unicode and specifying the encoding.
<h3>In Python 3</h3>
All strings are unicode. The <code>unicode</code> function does not exist anymore. See answer from @Noumenon

blocks|key|1091005|text|如果我没理解错的话，你的代码中有一个utf-8编码的字节串。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1091006|将字节串转换为unicode字符串称为解码(unicode+->字节串是编码)。|1091007|您可以使用unicode函数或decode方法来执行此操作。以下任一项：|offset|length|1091008|unicodestr+=+unicode(bytestr,+encoding)
unicodestr+=+unicode(bytestr,+"utf-8")|code-block|syntax|javascript|1091009|或者：|1091010|unicodestr+=+bytestr.decode(encoding)
unicodestr+=+bytestr.decode("utf-8")|1091011|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.python.org/library/functions.html#unicode|1|http://docs.python.org/library/stdtypes.html#str.decode^0|0|0|5|7|0|F|6|1|0|0|0|0^^$0|@$1|2|3|4|5|6|7|10|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|11|8|@]|9|@]|A|$]]|$1|D|3|E|5|6|7|12|8|@]|9|@$F|13|G|14|1|15]|$F|16|G|17|1|18]]|A|$]]|$1|H|3|I|5|J|7|19|8|@]|9|@]|A|$K|L]]|$1|M|3|N|5|6|7|1A|8|@]|9|@]|A|$]]|$1|O|3|P|5|J|7|1B|8|@]|9|@]|A|$K|L]]|$1|Q|3|-4|5|6|7|1C|8|@]|9|@]|A|$]]]|R|$S|$5|T|U|V|A|$W|X]]|Y|$5|T|U|V|A|$W|Z]]]]

If I understand you correctly, you have a utf-8 encoded byte-string in your code.

Converting a byte-string to a unicode string is known as decoding (unicode -> byte-string is encoding).

You do that by using the <a href="http://docs.python.org/library/functions.html#unicode" rel="noreferrer">unicode</a> function or the <a href="http://docs.python.org/library/stdtypes.html#str.decode" rel="noreferrer">decode</a> method. Either:

<pre><code>unicodestr = unicode(bytestr, encoding)
unicodestr = unicode(bytestr, "utf-8")
</code></pre>

Or:

<pre><code>unicodestr = bytestr.decode(encoding)
unicodestr = bytestr.decode("utf-8")
</code></pre>

blocks|key|1091066|text|如果上述方法不起作用，您还可以告诉Python忽略字符串中无法转换为utf-8的部分：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1091067|stringnamehere.decode('utf-8',+'ignore')|code-block|syntax|javascript|1091068|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

If the methods above don't work, you can also tell Python to ignore portions of a string that it can't convert to utf-8:

<pre><code>stringnamehere.decode('utf-8', 'ignore')
</code></pre>

blocks|key|1091091|text|将以下行添加到.py文件的顶部：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1091092|#+-*-+coding:+utf-8+-*-|code-block|syntax|javascript|1091093|允许您直接在脚本中对字符串进行编码，如下所示：|1091094|utfstr+=+"ボールト"|1091095|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

Adding the following line to the top of your .py file:

<pre><code># -*- coding: utf-8 -*-
</code></pre>

allows you to encode strings directly in your script, like this:

<pre><code>utfstr = "ボールト"
</code></pre>

blocks|key|876530|text|可能有点夸张，但当我在同一文件中使用ascii和unicode时，重复解码可能是一种痛苦，以下是我使用的：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|876531|def+make_unicode(inp):
++++if+type(inp)+!=+unicode:
++++++++inp+=++inp.decode('utf-8')
++++return+inp|code-block|syntax|javascript|876532|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Might be a bit overkill, but when I work with ascii and unicode in same files, repeating decode can be a pain, this is what I use:
<pre><code>def make_unicode(inp):
 if type(inp) != unicode:
 inp = inp.decode('utf-8')
 return inp
</code></pre>

blocks|key|1091198|text|在Python+3.6中，它们没有内置的unicode()方法。默认情况下，字符串已存储为unicode，不需要进行转换。示例：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1091199|my_str+=+"\u221a25"
print(my_str)
>>>+√25|code-block|syntax|javascript|1091200|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

In Python 3.6, they do not have a built-in unicode() method.
Strings are already stored as unicode by default and no conversion is required. Example:

<pre><code>my_str = "\u221a25"
print(my_str)
&gt;&gt;&gt; √25
</code></pre>

blocks|key|876559|text|city+=+'Ribeir\xc3\xa3o+Preto'
print+city.decode('cp1252').encode('utf-8')|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|876560|unstyled|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|G|8|@]|9|@]|A|$B|C]]|$1|D|3|-4|5|E|7|H|8|@]|9|@]|A|$]]]|F|$]]

<pre><code>city = 'Ribeir\xc3\xa3o Preto'
print city.decode('cp1252').encode('utf-8')
</code></pre>

blocks|key|876591|text|使用ord()和unichar()进行转换。每个unicode字符都有一个与之相关的数字，有点像索引。因此Python有几种方法可以在字符和数字之间进行转换。缺点是一个很好的例子。希望能有所帮助。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|876592|>>>+C+=+'ñ'
>>>+U+=+C.decode('utf8')
>>>+U
u'\xf1'
>>>+ord(U)
241
>>>+unichr(241)
u'\xf1'
>>>+print+unichr(241).encode('utf8')
ñ|code-block|syntax|javascript|876593|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Translate with ord() and unichar().
Every unicode char have a number asociated, something like an index. So Python have a few methods to translate between a char and his number. Downside is a ñ example. Hope it can help.

<pre><code>&gt;&gt;&gt; C = 'ñ'
&gt;&gt;&gt; U = C.decode('utf8')
&gt;&gt;&gt; U
u'\xf1'
&gt;&gt;&gt; ord(U)
241
&gt;&gt;&gt; unichr(241)
u'\xf1'
&gt;&gt;&gt; print unichr(241).encode('utf8')
ñ
</code></pre>

blocks|key|1091274|text|可以，您可以添加|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1091275|#+-*-+coding:+utf-8+-*-|code-block|syntax|javascript|1091276|在源代码的第一行。|1091277|您可以在此处阅读更多详细信息https://www.python.org/dev/peps/pep-0263/|offset|length|1091278|entityMap|0|LINK|mutability|MUTABLE|url|https://www.python.org/dev/peps/pep-0263/^0|0|0|0|E|15|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|V|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|W|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|X|8|@]|9|@$K|Y|L|Z|1|10]]|A|$]]|$1|M|3|-4|5|6|7|11|8|@]|9|@]|A|$]]]|N|$O|$5|P|Q|R|A|$S|T]]]]

Yes, You can add 

<pre><code># -*- coding: utf-8 -*-
</code></pre>

in your source code's first line.

You can read more details here <a href="https://www.python.org/dev/peps/pep-0263/" rel="nofollow noreferrer">https://www.python.org/dev/peps/pep-0263/</a>

blocks|key|1091292|text|您还可以执行以下操作：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1091293|from+unidecode+import+unidecode
unidecode(yourStringtoDecode)|code-block|syntax|javascript|1091294|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

you can also do this:
<pre><code>from unidecode import unidecode
unidecode(yourStringtoDecode)
</code></pre>

blocks|key|1091345|text|您可以使用python的标准库codecs+module。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1091346|import+codecs
codecs.decode(b'Decode+me',+'utf-8')|code-block|syntax|javascript|1091347|entityMap|0|LINK|mutability|MUTABLE|url|https://docs.python.org/3/library/codecs.html^0|F|6|F|D|0|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@$9|T|A|U|B|C]]|D|@$9|V|A|W|1|X]]|E|$]]|$1|F|3|G|5|H|7|Y|8|@]|D|@]|E|$I|J]]|$1|K|3|-4|5|6|7|Z|8|@]|D|@]|E|$]]]|L|$M|$5|N|O|P|E|$Q|R]]]]

You can use python's standard library <a href="https://docs.python.org/3/library/codecs.html" rel="nofollow noreferrer"><code>codecs</code> module</a>.
<pre><code>import codecs
codecs.decode(b'Decode me', 'utf-8')
</code></pre>

I have a browser which sends utf-8 characters to my Python server, but when I retrieve it from the query string, the encoding that Python returns is ASCII. How can I convert the plain string to utf-8?

NOTE: The string passed from the web is already UTF-8 encoded, I just want to make Python to treat it as UTF-8 not ASCII.

How to convert a string to utf-8 in Python

服务器

Python

我有一个浏览器，它将utf-8字符发送到我的Python服务器，但是当我从查询字符串中检索它时，Python返回的编码是ASCII。如何将普通字符串转换为utf-8？注意:从web传递的字符串已经是UTF-8编码的，我只想让Python将其视为UTF-8而不是ASCII。

问如何在Python中将字符串转换为utf-8
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何在Python中将字符串转换为utf-8EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何在Python中将字符串转换为utf-8
EN