parallel

> Run commands on multiple CPU cores.

Gzip several files at once, using all cores:

parallel gzip ::: {file1} {file2} {file3}

Read arguments from stdin, run 4 jobs at once:

ls *.txt | parallel -j4 gzip

Convert JPG images to PNG using replacement strings:

parallel convert {} {.}.png ::: *.jpg

Parallel xargs, cram as many args as possible onto one command:

{args} | parallel -X {command}

Break stdin into ~1M blocks, feed each block to stdin of new command:

cat {big_file.txt} | parallel --pipe --block 1M {command}

Run on multiple machines via SSH:

parallel -S {machine1},{machine2} {command} ::: {arg1} {arg2}

> This work is licensed under the Creative Commons Attribution 4.0 International License (CC-BY).

-- Response ended

-- Page fetched on Fri May 17 01:30:36 2024