blocks|key|5480328|text|通过阅读评论，我了解到您实际上想要删除重复项。或者，更具体地说，是以相同的8个字符开头的行。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|5480329|如果是这样的话，为什么不使用键的集合来记住具有相同8个初始字符的字符串是否还没有加载。|5480330|例如，你可以有一个集合(如List)，你可以在其中添加8字符子字符串。然后，在编写代码行之前，首先检查子字符串是否已经在集合中。如果它是，那么你知道它是一个副本，你不会写它。|5480331|另一种选择是，如果您想要计算有多少个特定类型的重复项，则可以使用字典。当你有一个特定类型的副本时，你可以在字典中增加计数器。|5480332|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|J|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|K|8|@]|9|@]|A|$]]|$1|D|3|E|5|6|7|L|8|@]|9|@]|A|$]]|$1|F|3|G|5|6|7|M|8|@]|9|@]|A|$]]|$1|H|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|I|$]]

From reading the comments what I understand is that you actually want to remove duplicates. Or, to be more specific, the lines that start with the same 8 characters.

If that's the case why not use a collection of keys to remember whether the string with the same 8 initial characters has not been already loaded.

E.g. you can have a collection (like List) where you add the 8 character substring. Then, before writing the line you first check if the substring is already in the collection. If it is then you know it's a duplicate and you don't write it.

Another option, if you want to calculate how many duplicates of a specific type there are, would be to use a Dictionary. When you have a duplicate of specific type you can then increase the counter in the dictionary.

blocks|key|5503835|text|如果您希望根据前8个字符对数据进行分组，则只需：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|5503836|var+groups+=+File.ReadLines(your_file_name).GroupBy(line+=>+line.Substring(0,+8));|code-block|syntax|javascript|5503837|对组中的元素调用Count()的元素进行计数|offset|length|style|CODE|5503838|groups.First().Count()|5503839|(您也可以通过foreach+(var+group+in+groups)通过groups枚举。)|5503840|分组结果将包含文件中的完整行。如果您不想在结果中包含"key“(即前8个字符)，则可以使用GroupBy的重载|5503841|var+groups+=+File.ReadLines(your_file_name).GroupBy(line+=>+line.Substring(0,+8),+line+=>+line.Substring(8));|5503842|为了获得包含"key“和连接的行的新输出，您可以使用如下代码：|5503843|var+groups+=+File.ReadLines(input_file).GroupBy(line+=>+line.Substring(0,+8),+line+=>+line.Substring(8));
File.WriteAllLines(output_file,+groups.Select(group+=>+string.Format("{0}{1}",+group.Key,+string.Join(string.Empty,+group))));|5503844|entityMap^0|0|0|8|7|0|0|7|T|12|6|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|10|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|11|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|12|8|@$I|13|J|14|K|L]]|9|@]|A|$]]|$1|M|3|N|5|D|7|15|8|@]|9|@]|A|$E|F]]|$1|O|3|P|5|6|7|16|8|@$I|17|J|18|K|L]|$I|19|J|1A|K|L]]|9|@]|A|$]]|$1|Q|3|R|5|6|7|1B|8|@]|9|@]|A|$]]|$1|S|3|T|5|D|7|1C|8|@]|9|@]|A|$E|F]]|$1|U|3|V|5|6|7|1D|8|@]|9|@]|A|$]]|$1|W|3|X|5|D|7|1E|8|@]|9|@]|A|$E|F]]|$1|Y|3|-4|5|6|7|1F|8|@]|9|@]|A|$]]]|Z|$]]

If you want to group the data based on the first 8 characters, all you need is:

<pre><code>var groups = File.ReadLines(your_file_name).GroupBy(line =&gt; line.Substring(0, 8));
</code></pre>

To count the elements you call <code>Count()</code> on the elements in the groups

<pre><code>groups.First().Count()
</code></pre>

(you can also enumerate over <code>groups</code> via <code>foreach (var group in groups)</code>..)

The group result will contain the complete line from the file. If you don't want the "key" (i.e. the first 8 characters) in the result, you can use the overload of GroupBy

<pre><code>var groups = File.ReadLines(your_file_name).GroupBy(line =&gt; line.Substring(0, 8), line =&gt; line.Substring(8));
</code></pre>

In order to get new output with the "key" and the lines concatenated, you would use something like this:

<pre><code>var groups = File.ReadLines(input_file).GroupBy(line =&gt; line.Substring(0, 8), line =&gt; line.Substring(8));
File.WriteAllLines(output_file, groups.Select(group =&gt; string.Format("{0}{1}", group.Key, string.Join(string.Empty, group))));
</code></pre>

blocks|key|5503868|text|因为你有很大的文件，所以File.ReadAllLines可能不适合你。您可以声明以下方法(我们需要使用Stream，因为StreamReader没有Position属性)：|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|5503869|public+static+string+ReadLine(Stream+stream)
{
++++return+ReadLine(stream,+Encoding.UTF8);
}

public+static+string+ReadLine(Stream+stream,+Encoding+encoding)
{
++++List<byte>+lineBytes+=+new+List<byte>();
++++while+(stream.Position+<+stream.Length)
++++{
++++++++byte+b+=+(byte)stream.ReadByte();
++++++++if+(b+==+0x0a)
++++++++++++break;
++++++++if+(b+==+0x0d)
++++++++++++continue;
++++++++lineBytes.Add(b);
++++}
++++return+encoding.GetString(lineBytes.ToArray());
}|code-block|syntax|javascript|5503870|示例代码：|5503871|string+sourceFileName+=+"input.txt";
string+targetFileName+=+"output.txt";

using+(StreamWriter+targetWriter+=+new+StreamWriter(targetFileName))
using+(FileStream+sourceStream+=+File.OpenRead(sourceFileName))
{
++++HashSet<string>+processedKeys+=+new+HashSet<string>();
++++while+(sourceStream.Position+<+sourceStream.Length)
++++{
++++++++string+line+=+ReadLine(sourceStream);
++++++++if+(line.Length+<+8)
++++++++++++targetWriter.WriteLine(line);
++++++++else
++++++++{
++++++++++++string+key+=+line.Substring(0,+8);
++++++++++++if+(processedKeys.Contains(key))
++++++++++++++++continue;
++++++++++++targetWriter.Write(line);
++++++++++++long+backupPosition+=+sourceStream.Position;
++++++++++++while+(sourceStream.Position+<+sourceStream.Length)
++++++++++++{
++++++++++++++++string+dupLine+=+ReadLine(sourceStream);
++++++++++++++++if+(dupLine.Length+<+8)
++++++++++++++++++++continue;
++++++++++++++++string+dupKey+=+dupLine.Substring(0,+8);
++++++++++++++++if+(dupKey+==+key)
++++++++++++++++++++targetWriter.Write("+"+%2B+dupLine);
++++++++++++}
++++++++++++sourceStream.Position+=+backupPosition;
++++++++++++targetWriter.WriteLine();
++++++++++++processedKeys.Add(key);
++++++++}
++++}
}|5503872|entityMap^0|C|H|1G|6|1P|C|23|8|0|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@$9|R|A|S|B|C]|$9|T|A|U|B|C]|$9|V|A|W|B|C]|$9|X|A|Y|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|Z|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|10|8|@]|D|@]|E|$]]|$1|M|3|N|5|H|7|11|8|@]|D|@]|E|$I|J]]|$1|O|3|-4|5|6|7|12|8|@]|D|@]|E|$]]]|P|$]]

Since you have large files, probably <code>File.ReadAllLines</code> is not an option for you. You can declare the following methods (we need to work with <code>Stream</code>, since <code>StreamReader</code> doesn't have <code>Position</code> property):

<pre><code>public static string ReadLine(Stream stream)
{
 return ReadLine(stream, Encoding.UTF8);
}

public static string ReadLine(Stream stream, Encoding encoding)
{
 List&lt;byte&gt; lineBytes = new List&lt;byte&gt;();
 while (stream.Position &lt; stream.Length)
 {
 byte b = (byte)stream.ReadByte();
 if (b == 0x0a)
 break;
 if (b == 0x0d)
 continue;
 lineBytes.Add(b);
 }
 return encoding.GetString(lineBytes.ToArray());
}
</code></pre>

Sample code:

<pre><code>string sourceFileName = "input.txt";
string targetFileName = "output.txt";

using (StreamWriter targetWriter = new StreamWriter(targetFileName))
using (FileStream sourceStream = File.OpenRead(sourceFileName))
{
 HashSet&lt;string&gt; processedKeys = new HashSet&lt;string&gt;();
 while (sourceStream.Position &lt; sourceStream.Length)
 {
 string line = ReadLine(sourceStream);
 if (line.Length &lt; 8)
 targetWriter.WriteLine(line);
 else
 {
 string key = line.Substring(0, 8);
 if (processedKeys.Contains(key))
 continue;
 targetWriter.Write(line);
 long backupPosition = sourceStream.Position;
 while (sourceStream.Position &lt; sourceStream.Length)
 {
 string dupLine = ReadLine(sourceStream);
 if (dupLine.Length &lt; 8)
 continue;
 string dupKey = dupLine.Substring(0, 8);
 if (dupKey == key)
 targetWriter.Write(" " + dupLine);
 }
 sourceStream.Position = backupPosition;
 targetWriter.WriteLine();
 processedKeys.Add(key);
 }
 }
}
</code></pre>

I am trying to read from a file,the program goes through each line of the text file comparing the first 8 characters of the each line and joining these lines into one where the 8 characters are similar.See code:

<pre><code> while ((line1 = fileread1.ReadLine()) != null)
 {

 line2 = fileread2.ReadLine();
 while (line2 != null)
 {
 if (line1.Length &gt;= 8 &amp;&amp; line2.Length &gt;= 8 &amp;&amp;
 line1.Substring(0, 8) == line2.Substring(0, 8))
 {
 //line2 = line2.Remove(0, 60);
 line1 = line1 +" "+ line2;
 }
 line2 = fileread3.ReadLine();
 counter2++;
 }

 filewrite.WriteLine(line1);
 counter1++;
 }
</code></pre>

Qusetion 1:

How can i get the count of fileread2 and assign it to fileread3,because i need every time the inner loop executes to reset the count of fileread3 to be the same as fileread2.

Question 2:

How do i write the combined lines as single line where the first 8 characters match.

File ReadLine Count

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

我试图从一个文件中读取，程序遍历文本文件的每一行，比较每行的前8个字符，并将这些行连接成一个其中的8个字符是similar.See代码： while ((line1 = fileread1.ReadLine()) != null)        {            line2 = fileread2.ReadLi...

问文件ReadLine计数
EN

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问文件ReadLine计数EN