blocks|key|823422|text|(ruby+1.9.2)|type|unstyled|depth|inlineStyleRanges|entityRanges|data|823423|#encoding:+UTF-8
class+String
++def+contains_cjk?
++++!!(self+=~+/\p{Han}%7C\p{Katakana}%7C\p{Hiragana}%7C\p{Hangul}/)
++end
end

strings=+['日本',+'광고+프로그램',+'艾弗森将退出篮坛',+'Watashi+ha+bakana+gaijin+desu.']
strings.each{%7Cs%7C+puts+s.contains_cjk?}

#true
#true
#true
#false|code-block|syntax|javascript|823424|\p{}匹配字符的Unicode脚本。|823425|支持以下脚本:阿拉伯语、亚美尼亚语、巴厘语、孟加拉语、博波莫夫语、盲文、布吉尼语、布希德语、Canadian_Aboriginal、卡里安语、查姆语、切罗基语、通用、科普特人、楔形文字、塞语、西里尔文、沙漠、德瓦纳加里文、埃塞俄比亚文、格鲁吉亚文、格拉斯哥里文、哥特文、希腊文、古吉拉特文、古吉拉特文、古尔穆赫希文、韩文、韩文、汉努乌文、希伯来文、平假名、继承、卡纳达文、片塔纳文、Kayah_Li、哈罗什提、高棉文、老语、拉丁文、莱普查、利姆布、Linear_B、Lycian、Lydian、马拉雅拉姆、蒙古文、缅甸、New_Tai_Lue、Nko、Ogham、Ol_Chiki、Old_Italic、Old_Persian、奥里亚、奥斯曼尼亚、塔班瓦、Phags_Pa、泰米尔语、泰米尔语、泰卢固语、塔那那语、泰语、藏语、提芬那语、乌加里特语、瓦伊语和彝语。|823426|哇。Ruby+Regexp+source。|offset|length|823427|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/ruby/ruby/blob/master/doc/regexp.rdoc^0|0|0|0|0|2|I|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|X|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|Y|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|Z|8|@]|9|@]|A|$]]|$1|K|3|L|5|6|7|10|8|@]|9|@$M|11|N|12|1|13]]|A|$]]|$1|O|3|-4|5|6|7|14|8|@]|9|@]|A|$]]]|P|$Q|$5|R|S|T|A|$U|V]]]]

(ruby 1.9.2)

<pre><code>#encoding: UTF-8
class String
 def contains_cjk?
 !!(self =~ /\p{Han}|\p{Katakana}|\p{Hiragana}|\p{Hangul}/)
 end
end

strings= ['日本', '광고 프로그램', '艾弗森将退出篮坛', 'Watashi ha bakana gaijin desu.']
strings.each{|s| puts s.contains_cjk?}

#true
#true
#true
#false
</code></pre>

\p{} matches a character’s Unicode script. 
The following scripts are supported: Arabic, Armenian, Balinese, Bengali, Bopomofo, Braille, Buginese, Buhid, Canadian_Aboriginal, Carian, Cham, Cherokee, Common, Coptic, Cuneiform, Cypriot, Cyrillic, Deseret, Devanagari, Ethiopic, Georgian, Glagolitic, Gothic, Greek, Gujarati, Gurmukhi, Han, Hangul, Hanunoo, Hebrew, Hiragana, Inherited, Kannada, Katakana, Kayah_Li, Kharoshthi, Khmer, Lao, Latin, Lepcha, Limbu, Linear_B, Lycian, Lydian, Malayalam, Mongolian, Myanmar, New_Tai_Lue, Nko, Ogham, Ol_Chiki, Old_Italic, Old_Persian, Oriya, Osmanya, Phags_Pa, Phoenician, Rejang, Runic, Saurashtra, Shavian, Sinhala, Sundanese, Syloti_Nagri, Syriac, Tagalog, Tagbanwa, Tai_Le, Tamil, Telugu, Thaana, Thai, Tibetan, Tifinagh, Ugaritic, Vai, and Yi.

Wow. <a href="https://github.com/ruby/ruby/blob/master/doc/regexp.rdoc" rel="nofollow noreferrer">Ruby Regexp source</a> .

blocks|key|823480|text|考虑到Ruby+1.8.7的限制，这是我能做的最好的事情：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|823481|class+String
++CJKV_RANGES+=+[
++++++(0xe2ba80..0xe2bbbf),
++++++(0xe2bfb0..0xe2bfbf),
++++++(0xe38080..0xe380bf),
++++++(0xe38180..0xe383bf),
++++++(0xe38480..0xe386bf),
++++++(0xe38780..0xe387bf),
++++++(0xe38880..0xe38bbf),
++++++(0xe38c80..0xe38fbf),
++++++(0xe39080..0xe4b6bf),
++++++(0xe4b780..0xe4b7bf),
++++++(0xe4b880..0xe9bfbf),
++++++(0xea8080..0xea98bf),
++++++(0xeaa080..0xeaaebf),
++++++(0xeaaf80..0xefbfbf),
++]

++def+contains_cjkv?
++++each_char+do+%7Cch%7C
++++++return+true+if+CJKV_RANGES.any?+{%7Crange%7C+range.member?+ch.unpack('H*').first.hex+}
++++end
++++false
++end
end


strings+=+['日本',+'광고+프로그램',+'艾弗森将退出篮坛',+'Watashi+ha+bakana+gaijin+desu.']
strings.each+{%7Cs%7C+puts+s.contains_cjkv?+}

#true
#true
#true
#false|code-block|syntax|javascript|823482|很老套，但很管用。它实际上也可以检测到各种印度文字，所以它可能真的应该被称为contains_asian？|823483|也许我应该为其他坚持使用Ruby1.8的可怜的I18N黑客做点什么。|823484|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|P|8|@]|9|@]|A|$]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

Given my Ruby 1.8.7 constraint, this is the best I could do:

<pre><code>class String
 CJKV_RANGES = [
 (0xe2ba80..0xe2bbbf),
 (0xe2bfb0..0xe2bfbf),
 (0xe38080..0xe380bf),
 (0xe38180..0xe383bf),
 (0xe38480..0xe386bf),
 (0xe38780..0xe387bf),
 (0xe38880..0xe38bbf),
 (0xe38c80..0xe38fbf),
 (0xe39080..0xe4b6bf),
 (0xe4b780..0xe4b7bf),
 (0xe4b880..0xe9bfbf),
 (0xea8080..0xea98bf),
 (0xeaa080..0xeaaebf),
 (0xeaaf80..0xefbfbf),
 ]

 def contains_cjkv?
 each_char do |ch|
 return true if CJKV_RANGES.any? {|range| range.member? ch.unpack('H*').first.hex }
 end
 false
 end
end


strings = ['日本', '광고 프로그램', '艾弗森将退出篮坛', 'Watashi ha bakana gaijin desu.']
strings.each {|s| puts s.contains_cjkv? }

#true
#true
#true
#false
</code></pre>

Pretty hacktacular, but it works. It actually detects a variety of Indic scripts as well, so it should probably really be called contains_asian?

Maybe I should gem this up for other poor I18N hackers stuck with Ruby 1.8.

blocks|key|823532|text|我已经写了一个小宝石，打包了steenslag上面的答案中的方法：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|823533|https://github.com/jpatokal/script_detector|offset|length|823534|它还可以尝试区分日语、韩语、简体中文和繁体中文，尽管由于汉语言统一的复杂性，它只能可靠地处理大段文本。|823535|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|17|0|0|0^^$0|@$1|2|3|4|5|6|7|O|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|P|8|@]|9|@$D|Q|E|R|1|S]]|A|$]]|$1|F|3|G|5|6|7|T|8|@]|9|@]|A|$]]|$1|H|3|-4|5|6|7|U|8|@]|9|@]|A|$]]]|I|$J|$5|K|L|M|A|$N|C]]]]

I've written a little gem that packages up the approach in steenslag's answer above:

<a href="https://github.com/jpatokal/script_detector" rel="nofollow">https://github.com/jpatokal/script_detector</a>

It can also take a stab at differentiating between Japanese, Korean, simplified Chinese and traditional Chinese, although due to the complexities of Han unification it only works reliably with large slabs of text.

blocks|key|1038593|text|基于this+code的Ruby1.8解决方案，并在此线程上使用Josh+Glover的解决方案中的API：|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1038594|class+String
++CJKV_RANGES+=+[
++++(0x4E00..0x9FFF),
++++(0x3400..0x4DBF),
++++(0x20000..0x2A6DF),
++++(0x2A700..0x2B73F),
++]

++def+contains_cjkv?
++++unpack("U*").any?+{+%7Cchar%7C
++++++CJKV_RANGES.any?+{+%7Crange%7C+range.member?(char)+}
++++}
++end
end|code-block|syntax|javascript|1038595|entityMap|0|LINK|mutability|MUTABLE|url|https://stackoverflow.com/a/2728344/6962^0|2|9|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@$A|R|B|S|1|T]]|C|$]]|$1|D|3|E|5|F|7|U|8|@]|9|@]|C|$G|H]]|$1|I|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|J|$K|$5|L|M|N|C|$O|P]]]]

Ruby 1.8 solution based on <a href="https://stackoverflow.com/a/2728344/6962">this code</a> and using the API from Josh Glover's solution on this thread:

<pre><code>class String
 CJKV_RANGES = [
 (0x4E00..0x9FFF),
 (0x3400..0x4DBF),
 (0x20000..0x2A6DF),
 (0x2A700..0x2B73F),
 ]

 def contains_cjkv?
 unpack("U*").any? { |char|
 CJKV_RANGES.any? { |range| range.member?(char) }
 }
 end
end
</code></pre>

Given a string in Ruby 1.8.7 (without the awesome Oniguruma regular expression engine that supports Unicode properties with \p{}), I would like to be able to determine if the string contains one or more Chinese, Japanese, or Korean characters; i.e.

<pre><code>class String
 def contains_cjk?
 ...
 end
end

&gt;&gt; '日本語'.contains_cjk?
=&gt; true
&gt;&gt; '광고 프로그램'.contains_cjk?
=&gt; true
&gt;&gt; '艾弗森将退出篮坛'.contains_cjk?
=&gt; true
&gt;&gt; 'Watashi ha bakana gaijin desu.'.contains_cjk?
=&gt; false
</code></pre>

I suspect that this will boil down to seeing if any of the characters in the string are in the <a href="http://en.wikipedia.org/wiki/Summary_of_Unicode_character_assignments#Unihan_CJKV_Blocks" rel="nofollow noreferrer">Unihan CJKV Unicode blocks</a>, but I figured it was worth asking if anyone knows of an existing solution in Ruby.

How can I detect certain Unicode characters in a string in Ruby?

Ruby语言

给定Ruby 1.8.7中的一个字符串(没有支持带\p{}的Unicode属性的出色的Oniguruma正则表达式引擎)，我希望能够确定该字符串是否包含一个或多个中文、日文或韩文字符；class String  def contains_cjk?    ...  endend>> '日本語'.contains_cjk?...

问如何在Ruby中检测字符串中的某些Unicode字符？
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何在Ruby中检测字符串中的某些Unicode字符？EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何在Ruby中检测字符串中的某些Unicode字符？
EN