blocks|key|1548546|text|您可以使用String.Split+method。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1548547|class+ExampleClass
{
++++public+ExampleClass()
++++{
++++++++string+exampleString+=+"there+is+a+cat";
++++++++//+Split+string+on+spaces.+This+will+separate+all+the+words+in+a+string
++++++++string[]+words+=+exampleString.Split('+');
++++++++foreach+(string+word+in+words)
++++++++{
++++++++++++Console.WriteLine(word);
++++++++++++//+there
++++++++++++//+is
++++++++++++//+a
++++++++++++//+cat
++++++++}
++++}
}|code-block|syntax|javascript|1548548|有关详细信息，请参阅Sam+Allen's+article+about+splitting+strings+in+c#+(性能，正则表达式)|1548549|entityMap|0|LINK|mutability|MUTABLE|url|http://msdn.microsoft.com/en-us/library/system.string.split.aspx|1|http://www.dotnetperls.com/split^0|5|J|0|0|0|A|1D|1|0^^$0|@$1|2|3|4|5|6|7|U|8|@]|9|@$A|V|B|W|1|X]]|C|$]]|$1|D|3|E|5|F|7|Y|8|@]|9|@]|C|$G|H]]|$1|I|3|J|5|6|7|Z|8|@]|9|@$A|10|B|11|1|12]]|C|$]]|$1|K|3|-4|5|6|7|13|8|@]|9|@]|C|$]]]|L|$M|$5|N|O|P|C|$Q|R]]|S|$5|N|O|P|C|$Q|T]]]]

You could use <a href="http://msdn.microsoft.com/en-us/library/system.string.split.aspx" rel="noreferrer" title="String.Split method msdn reference">String.Split method</a>.

<pre><code>class ExampleClass
{
 public ExampleClass()
 {
 string exampleString = "there is a cat";
 // Split string on spaces. This will separate all the words in a string
 string[] words = exampleString.Split(' ');
 foreach (string word in words)
 {
 Console.WriteLine(word);
 // there
 // is
 // a
 // cat
 }
 }
}
</code></pre>

For more information see <a href="http://www.dotnetperls.com/split" rel="noreferrer" title="C# Split String Examples by Sam Allen">Sam Allen's article about splitting strings in c#</a> (Performance, Regex)

blocks|key|1763708|text|我只想强调C#的Split方法的强大之处，并给出更详细的比较，特别是来自具有Java背景的人的比较。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1763709|虽然Java语言中的StringTokenizer只允许一个分隔符，但我们实际上可以拆分多个分隔符，从而减少对正则表达式的需要(尽管如果需要正则表达式，请务必使用正则表达式！)以此为例：|1763710|str.Split(new+char[]+{+'+',+'.',+'?'+})|code-block|syntax|javascript|1763711|它分为三个不同的分隔符，返回一个标记数组。我们还可以使用上面示例中的第二个参数来删除空数组：|1763712|str.Split(new+char[]+{+'+',+'.',+'?'+},+StringSplitOptions.RemoveEmptyEntries)|1763713|我认为C#缺少的一件事是Java的字符串标记器(至少Java7具有这个特性)，那就是能够将分隔符作为标记。C#的拆分将丢弃令牌，这在一些NLP应用程序中可能很重要，但对于更通用的应用程序，这可能不是问题。|1763714|entityMap^0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|R|8|@]|9|@]|A|$]]|$1|D|3|E|5|F|7|S|8|@]|9|@]|A|$G|H]]|$1|I|3|J|5|6|7|T|8|@]|9|@]|A|$]]|$1|K|3|L|5|F|7|U|8|@]|9|@]|A|$G|H]]|$1|M|3|N|5|6|7|V|8|@]|9|@]|A|$]]|$1|O|3|-4|5|6|7|W|8|@]|9|@]|A|$]]]|P|$]]

I just want to highlight the power of C#'s Split method and give a more detailed comparison, particularly from someone who comes from a Java background.

Whereas StringTokenizer in Java only allows a single delimiter, we can actually split on multiple delimiters making regular expressions less necessary (although if one needs regex, use regex by all means!) Take for example this:

<pre><code>str.Split(new char[] { ' ', '.', '?' })
</code></pre>

This splits on three different delimiters returning an array of tokens. We can also remove empty arrays with what would be a second parameter for the above example:

<pre><code>str.Split(new char[] { ' ', '.', '?' }, StringSplitOptions.RemoveEmptyEntries)
</code></pre>

One thing Java's String tokenizer does have that I believe C# is lacking (at least Java 7 has this feature) is the ability to keep the delimiter(s) as tokens. C#'s Split will discard the tokens. This could be important in say some NLP applications, but for more general purpose applications this might not be a problem.

blocks|key|1548510|text|字符串的split方法就是您所需要的。实际上，Java中的记号赋予器类已被弃用，取而代之的是Java的字符串拆分方法。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1548511|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

The split method of a string is what you need. In fact the tokenizer class in Java is deprecated in favor of Java's string split method.

blocks|key|1548600|text|对于复杂拆分，您可以使用regex来创建匹配集合。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1548601|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

For complex splitting you could use a regex creating a match collection.

blocks|key|1548813|text|_words+=+new+List<string>(YourText.ToLower().Trim('\n',+'\r').Split('+').
++++++++++++Select(x+=>+new+string(x.Where(Char.IsLetter).ToArray())));+|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|1548814|或|unstyled|1548815|_words+=+new+List<string>(YourText.Trim('\n',+'\r').Split('+').
++++++++++++Select(x+=>+new+string(x.Where(Char.IsLetterOrDigit).ToArray())));+|1548816|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$B|C]]|$1|D|3|E|5|F|7|L|8|@]|9|@]|A|$]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$B|C]]|$1|I|3|-4|5|F|7|N|8|@]|9|@]|A|$]]]|J|$]]

<pre><code>_words = new List&lt;string&gt;(YourText.ToLower().Trim('\n', '\r').Split(' ').
 Select(x =&gt; new string(x.Where(Char.IsLetter).ToArray()))); 
</code></pre>

Or 

<pre><code>_words = new List&lt;string&gt;(YourText.Trim('\n', '\r').Split(' ').
 Select(x =&gt; new string(x.Where(Char.IsLetterOrDigit).ToArray()))); 
</code></pre>

blocks|key|1548682|text|使用Regex.Split(string,"#%7C#");|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1548683|entityMap^0|2|Q|0^^$0|@$1|2|3|4|5|6|7|H|8|@$9|I|A|J|B|C]]|D|@]|E|$]]|$1|F|3|-4|5|6|7|K|8|@]|D|@]|E|$]]]|G|$]]

use <code>Regex.Split(string,"#|#");</code>

blocks|key|1548732|text|阅读这篇文章，split函数有一个重载需要一个由分隔符http://msdn.microsoft.com/en-us/library/system.stringsplitoptions.aspx组成的数组|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1548733|entityMap|0|LINK|mutability|MUTABLE|url|http://msdn.microsoft.com/en-us/library/system.stringsplitoptions.aspx^0|R|1Y|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

read this, split function has an overload takes an array consist of seperators
<a href="http://msdn.microsoft.com/en-us/library/system.stringsplitoptions.aspx" rel="nofollow noreferrer">http://msdn.microsoft.com/en-us/library/system.stringsplitoptions.aspx</a>

blocks|key|1763826|text|如果您试图在.NET控制台应用程序中拆分命令行参数，您将会遇到问题，因为.NET要么坏了，要么试图变得聪明(这意味着它和坏掉的一样好)。我需要能够按空格字符拆分参数，保留所有引用的字面值，这样它们就不会在中间被拆分。这是我写的代码来完成这项工作：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1763827|private+static+List<String>+Tokenise(string+value,+char+seperator)
{
++++List<string>+result+=+new+List<string>();
++++value+=+value.Replace("++",+"+").Replace("++",+"+").Trim();
++++StringBuilder+sb+=+new+StringBuilder();
++++bool+insideQuote+=+false;
++++foreach(char+c+in+value.ToCharArray())
++++{
++++++++if(c+==+'"')
++++++++{
++++++++++++insideQuote+=+!insideQuote;
++++++++}
++++++++if((c+==+seperator)+&&+!insideQuote)
++++++++{
++++++++++++if+(sb.ToString().Trim().Length+>+0)
++++++++++++{
++++++++++++++++result.Add(sb.ToString().Trim());
++++++++++++++++sb.Clear();
++++++++++++}
++++++++}
++++++++else
++++++++{
++++++++++++sb.Append(c);
++++++++}
++++}
++++if+(sb.ToString().Trim().Length+>+0)
++++{
++++++++result.Add(sb.ToString().Trim());
++++}

++++return+result;
}|code-block|syntax|javascript|1763828|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

If you're trying to do something like splitting command line arguments in a .NET Console app, you're going to have issues because .NET is either broken or is trying to be clever (which means it's as good as broken). I needed to be able to split arguments by the space character, preserving any literals that were quoted so they didn't get split in the middle. This is the code I wrote to do the job:

<pre><code>private static List&lt;String&gt; Tokenise(string value, char seperator)
{
 List&lt;string&gt; result = new List&lt;string&gt;();
 value = value.Replace(" ", " ").Replace(" ", " ").Trim();
 StringBuilder sb = new StringBuilder();
 bool insideQuote = false;
 foreach(char c in value.ToCharArray())
 {
 if(c == '"')
 {
 insideQuote = !insideQuote;
 }
 if((c == seperator) &amp;&amp; !insideQuote)
 {
 if (sb.ToString().Trim().Length &gt; 0)
 {
 result.Add(sb.ToString().Trim());
 sb.Clear();
 }
 }
 else
 {
 sb.Append(c);
 }
 }
 if (sb.ToString().Trim().Length &gt; 0)
 {
 result.Add(sb.ToString().Trim());
 }

 return result;
}
</code></pre>

blocks|key|1548673|text|如果你使用的是C#+3.5，你可以为System.String编写一个扩展方法来做你需要的拆分。然后，您可以使用语法：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1548674|string.SplitByMyTokens();|code-block|syntax|javascript|1548675|更多信息和来自MS+here+http://msdn.microsoft.com/en-us/library/bb383977.aspx的有用示例|offset|length|1548676|entityMap|0|LINK|mutability|MUTABLE|url|http://msdn.microsoft.com/en-us/library/bb383977.aspx^0|0|0|F|1H|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|T|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|U|8|@]|9|@$I|V|J|W|1|X]]|A|$]]|$1|K|3|-4|5|6|7|Y|8|@]|9|@]|A|$]]]|L|$M|$5|N|O|P|A|$Q|R]]]]

If you are using C# 3.5 you could write an extension method to System.String that does the splitting you need. You then can then use syntax:

<pre><code>string.SplitByMyTokens();
</code></pre>

More info and a useful example from MS here <a href="http://msdn.microsoft.com/en-us/library/bb383977.aspx" rel="nofollow noreferrer">http://msdn.microsoft.com/en-us/library/bb383977.aspx</a>

I'm doing simple string input parsing and I am in need of a string tokenizer. I am new to C# but have programmed Java, and it seems natural that C# should have a string tokenizer. Does it? Where is it? How do I use it?

Does C# have a String Tokenizer like Java's?

Java

我正在做简单的字符串输入解析，我需要一个字符串标记器。我刚接触C#，但已经编写过Java程序，C#应该有一个字符串标记器似乎是很自然的事情。是吗？它在哪里?我该如何使用它？

问C#有像Java一样的字符串令牌器吗？
EN

回答 9

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问C#有像Java一样的字符串令牌器吗？EN

回答 9

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问C#有像Java一样的字符串令牌器吗？
EN