tldr/pages/common/parallel.md

29 lines
744 B
Markdown

# parallel
> Run commands on multiple CPU cores.
> More information: <https://www.gnu.org/software/parallel>.
- Gzip several files at once, using all cores:
`parallel gzip ::: {{file1}} {{file2}} {{file3}}`
- Read arguments from stdin, run 4 jobs at once:
`ls *.txt | parallel -j4 gzip`
- Convert JPG images to PNG using replacement strings:
`parallel convert {} {.}.png ::: *.jpg`
- Parallel xargs, cram as many args as possible onto one command:
`{{args}} | parallel -X {{command}}`
- Break stdin into ~1M blocks, feed each block to stdin of new command:
`cat {{big_file.txt}} | parallel --pipe --block 1M {{command}}`
- Run on multiple machines via SSH:
`parallel -S {{machine1}},{{machine2}} {{command}} ::: {{arg1}} {{arg2}}`