blocks|key|1337585|text|和一个Perl一行程序！|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1337586|perl+-MList::Util+-e+'print+List::Util::shuffle+<>'|code-block|syntax|javascript|1337587|它使用一个模块，但该模块是Perl代码分发的一部分。如果这还不够好，你可以考虑滚动你自己的。|1337588|我尝试将它与-i标志(“原地编辑”)一起使用，让它编辑文件。文档建议它应该可以工作，但它不工作。它仍然将混洗过的文件显示到stdout，但这次它删除了原始文件。我建议你不要用它。|offset|length|style|CODE|1337589|考虑一个shell脚本：|1337590|#!/bin/sh

if+[[+$#+-eq+0+]]
then
++echo+"Usage:+$0+[file+...]"
++exit+1
fi

for+i+in+"$@"
do
++perl+-MList::Util+-e+'print+List::Util::shuffle+<>'+$i+>+$i.new
++if+[[+`wc+-c+$i`+-eq+`wc+-c+$i.new`+]]
++then
++++mv+$i.new+$i
++else
++++echo+"Error+for+file+$i!"
++fi
done|1337591|未经测试，但希望能正常工作。|1337592|entityMap^0|0|0|0|6|2|0|0|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|X|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|Y|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|Z|8|@$K|10|L|11|M|N]]|9|@]|A|$]]|$1|O|3|P|5|6|7|12|8|@]|9|@]|A|$]]|$1|Q|3|R|5|D|7|13|8|@]|9|@]|A|$E|F]]|$1|S|3|T|5|6|7|14|8|@]|9|@]|A|$]]|$1|U|3|-4|5|6|7|15|8|@]|9|@]|A|$]]]|V|$]]

And a Perl one-liner you get!

<pre><code>perl -MList::Util -e 'print List::Util::shuffle &lt;&gt;'
</code></pre>

It uses a module, but the module is part of the Perl code distribution. If that's not good enough, you may consider rolling your own.

I tried using this with the <code>-i</code> flag ("edit-in-place") to have it edit the file. The documentation suggests it should work, but it doesn't. It still displays the shuffled file to stdout, but this time it deletes the original. I suggest you don't use it.

Consider a shell script:

<pre><code>#!/bin/sh

if [[ $# -eq 0 ]]
then
 echo "Usage: $0 [file ...]"
 exit 1
fi

for i in "$@"
do
 perl -MList::Util -e 'print List::Util::shuffle &lt;&gt;' $i &gt; $i.new
 if [[ `wc -c $i` -eq `wc -c $i.new` ]]
 then
 mv $i.new $i
 else
 echo "Error for file $i!"
 fi
done
</code></pre>

Untested, but hopefully works.

blocks|key|1337831|text|嗯，别忘了|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1337832|sort+--random-sort|code-block|syntax|javascript|1337833|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Um, lets not forget

<pre><code>sort --random-sort
</code></pre>

blocks|key|1553708|text|shuf是最好的方法。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1553709|sort+-R的速度慢得令人痛苦。我只是试着对5+5GB的文件进行排序。我在半小时后就放弃了。然后shuf立即对其进行了排序。|1553710|entityMap^0|0|4|0|0|7|1D|4|0^^$0|@$1|2|3|4|5|6|7|J|8|@$9|K|A|L|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|M|8|@$9|N|A|O|B|C]|$9|P|A|Q|B|C]]|D|@]|E|$]]|$1|H|3|-4|5|6|7|R|8|@]|D|@]|E|$]]]|I|$]]

<code>shuf</code> is the best way.

<code>sort -R</code> is painfully slow. I just tried to sort 5GB file. I gave up after 2.5 hours. Then <code>shuf</code> sorted it in a minute.

blocks|key|1337728|text|cat+yourfile.txt+%7C+while+IFS=+read+-r+f;+do+printf+"%2505d+%25s\n"+"$RANDOM"+"$f";+done+%7C+sort+-n+%7C+cut+-c7-|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|1337729|读取文件，在每一行前面加上一个随机数，根据这些随机前缀对文件进行排序，然后删除前缀。一行代码应该可以在任何半现代的shell中工作。|unstyled|1337730|编辑:纳入Richard+Hansen的评论。|1337731|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$B|C]]|$1|D|3|E|5|F|7|L|8|@]|9|@]|A|$]]|$1|G|3|H|5|F|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|F|7|N|8|@]|9|@]|A|$]]]|J|$]]

<pre><code>cat yourfile.txt | while IFS= read -r f; do printf "%05d %s\n" "$RANDOM" "$f"; done | sort -n | cut -c7-
</code></pre>

Read the file, prepend every line with a random number, sort the file on those random prefixes, cut the prefixes afterwards. One-liner which should work in any semi-modern shell.

EDIT: incorporated Richard Hansen's remarks.

blocks|key|1338098|text|python的一行代码：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1338099|python+-c+"import+random,+sys;+lines+=+open(sys.argv[1]).readlines();+random.shuffle(lines);+print+''.join(lines),"+myFile|code-block|syntax|javascript|1338100|并且只打印一行随机行：|1338101|python+-c+"import+random,+sys;+print+random.choice(open(sys.argv[1]).readlines()),"+myFile|1338102|但要了解python的random.shuffle()的缺点，请参阅this+post。它不能很好地处理很多(超过2080个)元素。|offset|length|style|CODE|1338103|entityMap|0|LINK|mutability|MUTABLE|url|https://stackoverflow.com/a/3062966/1340631^0|0|0|0|0|B|G|Y|9|0|0^^$0|@$1|2|3|4|5|6|7|Y|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|Z|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|10|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|11|8|@]|9|@]|A|$E|F]]|$1|K|3|L|5|6|7|12|8|@$M|13|N|14|O|P]]|9|@$M|15|N|16|1|17]]|A|$]]|$1|Q|3|-4|5|6|7|18|8|@]|9|@]|A|$]]]|R|$S|$5|T|U|V|A|$W|X]]]]

A one-liner for python:

<pre><code>python -c "import random, sys; lines = open(sys.argv[1]).readlines(); random.shuffle(lines); print ''.join(lines)," myFile
</code></pre>

And for printing just a single random line:

<pre><code>python -c "import random, sys; print random.choice(open(sys.argv[1]).readlines())," myFile
</code></pre>

But see <a href="https://stackoverflow.com/a/3062966/1340631">this post</a> for the drawbacks of python's <code>random.shuffle()</code>. It won't work well with many (more than 2080) elements.

blocks|key|1553755|text|当我使用自制软件安装coreutils时|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1553756|brew+install+coreutils|code-block|syntax|javascript|1553757|shuf成为可用的n。|offset|length|style|CODE|1553758|entityMap^0|0|0|0|4|9|1|0^^$0|@$1|2|3|4|5|6|7|O|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|Q|8|@$I|R|J|S|K|L]|$I|T|J|U|K|L]]|9|@]|A|$]]|$1|M|3|-4|5|6|7|V|8|@]|9|@]|A|$]]]|N|$]]

When I install coreutils with homebrew

<pre><code>brew install coreutils
</code></pre>

<code>shuf</code> becomes available as <code>n</code>.

blocks|key|1338123|text|带有DarwinPorts的Mac：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1338124|sudo+port+install+unsort
cat+$file+%7C+unsort+%7C+...|code-block|syntax|javascript|1338125|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Mac OS X with DarwinPorts:

<pre><code>sudo port install unsort
cat $file | unsort | ...
</code></pre>

blocks|key|1553860|text|FreeBSD有它自己的随机工具：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1553861|cat+$file+%7C+random+%7C+...|code-block|syntax|javascript|1553862|它位于/usr/+games+/random中，所以如果您没有安装游戏，那么您就不走运了。|1553863|您可以考虑安装诸如textproc/rand或textproc/msort之类的端口。如果可移植性是一个问题，那么它们很可能在Linux和/或Mac上可用。|1553864|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|P|8|@]|9|@]|A|$]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

FreeBSD has its own random utility:

<pre><code>cat $file | random | ...
</code></pre>

It's in /usr/games/random, so if you have not installed games, you are out of luck.

You could consider installing ports like textproc/rand or textproc/msort. These might well be available on Linux and/or Mac OS X, if portability is a concern.

blocks|key|1337895|text|在OSX上，从http://ftp.gnu.org/gnu/coreutils/抓取最新信息，比如|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1337896|./configure+make+sudo+make+install|1337897|...should会给出/usr/local/bin/sort+--...should-sort|1337898|不会弄乱/usr/bin/sort|1337899|entityMap|0|LINK|mutability|MUTABLE|url|http://ftp.gnu.org/gnu/coreutils/^0|7|X|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|R|8|@]|9|@$A|S|B|T|1|U]]|C|$]]|$1|D|3|E|5|6|7|V|8|@]|9|@]|C|$]]|$1|F|3|G|5|6|7|W|8|@]|9|@]|C|$]]|$1|H|3|I|5|6|7|X|8|@]|9|@]|C|$]]|$1|J|3|-4|5|6|7|Y|8|@]|9|@]|C|$]]]|K|$L|$5|M|N|O|C|$P|Q]]]]

On OSX, grabbing latest from <a href="http://ftp.gnu.org/gnu/coreutils/" rel="nofollow">http://ftp.gnu.org/gnu/coreutils/</a> and something like

./configure
make
sudo make install

...should give you /usr/local/bin/sort --random-sort

without messing up /usr/bin/sort

blocks|key|1337973|text|或者从MacPorts获取：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1337974|$+sudo+port+install+coreutils|code-block|syntax|javascript|1337975|和/或|1337976|$+/opt/local//libexec/gnubin/sort+--random-sort|1337977|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

Or get it from MacPorts:

<pre><code>$ sudo port install coreutils
</code></pre>

and/or

<pre><code>$ /opt/local//libexec/gnubin/sort --random-sort
</code></pre>

How can I randomize the lines in a file using standard tools on Red Hat Linux?

I don't have the <code>shuf</code> command, so I am looking for something like a <code>perl</code> or <code>awk</code> one-liner that accomplishes the same task.

How can I randomize the lines in a file using standard tools on Red Hat Linux?

FreeBSD

Linux

Perl

如何在Red Hat Linux上使用标准工具随机化文件中的行？我没有shuf命令，所以我正在寻找像perl或awk这样的行程序来完成同样的任务。

问如何在Red Hat Linux上使用标准工具随机化文件中的行？
EN

回答 10

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何在Red Hat Linux上使用标准工具随机化文件中的行？EN

回答 10

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何在Red Hat Linux上使用标准工具随机化文件中的行？
EN