Differences between revisions 4 and 5
Revision 4 as of 2018-08-16 02:11:13
Size: 352
Editor: SamatJain
Comment:
Revision 5 as of 2018-11-14 20:48:20
Size: 536
Editor: SamatJain
Comment:
Deletions are marked like this. Additions are marked like this.
Line 4: Line 4:
find . -maxdepth 1 -mindepth 1 -print0 | parallel -0 -j4 echo cp -avn {} $dst find . -maxdepth 1 -mindepth 1 -print0 | parallel -q0 -j4 echo cp -avn {} $dst
Line 11: Line 11:

# Quickly get hash of large file. Reads in 1G chunks, multiple CPUs, and outputs 1 hash.
parallel --block=1G --pipepart -a $LARGE_FILE --progress --recend '' -k sha1sum | sha1sum

   1 # Parallel copy
   2 # Because we are copying the current directory, make sure $dst is correct
   3 find . -maxdepth 1 -mindepth 1 -print0 | parallel -q0 -j4 echo cp -avn {} $dst
   4 
   5 # Check MP3s in parallel, many arguments per invocation
   6 parallel -m mp3check -Sqe ::: *mp3
   7 
   8 # Run commands in a file parallel
   9 parallel < commands.txt
  10 
  11 # Quickly get hash of large file. Reads in 1G chunks, multiple CPUs, and outputs 1 hash.
  12 parallel --block=1G --pipepart -a $LARGE_FILE --progress --recend '' -k sha1sum | sha1sum

SamatsWiki: CheatSheet/GNUParallel (last edited 2019-04-28 00:16:11 by SamatJain)