./parallel/parallel, Build and execute shell commands in parallel

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 20230822, Package name: parallel-20230822, Maintainer: cheusov

GNU Parallel is a shell tool for executing jobs in parallel using one or
more machines. A job is typically a single command or a small script that
has to be run for each of the lines in the input. The typical input is a
list of files, a list of hosts, a list of users, or a list of tables.


Required to run:
[lang/perl5]

Required to build:
[pkgtools/cwrappers]

Master sites: (Expand)

Filesize: 2449.095 KB

Version history: (Expand)


CVS history: (Expand)


   2023-09-08 20:39:05 by Paolo Vincenzo Olivo | Files touched by this commit (3) | Package updated
Log message:
parallel/parallel: update to version 20230822

# CHANGES (since version 20210722)

20230822

New in this release:

* Bug fixes and man page updates.

20230722

New in this release:

* Time functions (e.g. yyyymmdd($secs) ) can now take secs since epoch as argument.

* Bug fixes and man page updates.

20230622

New in this release:

* Bug fixes and man page updates.

20230522

New in this release:

* Bug fixes and man page updates.

20230422

New in this release:

* --jobs evaluates expression: +3*log(55)% = ncpu*1.12

* Bug fixes and man page updates.

20230322

New in this release:

* Better support for wide characters in --latest-line.

* Support for rsync 3.2.7.

* Bug fixes and man page updates.

20230222

New in this release:

* parsort: --parallel now does closer to what you expect.

* parallel: --files0 is --files but \0 separated.

* Bug fixes and man page updates.

20230122

New in this release:

* Bug fixes and man page updates.

20221222

New in this release:

* --results works on more file systems (e.g. fat)

* Joblog gives the same exit code as bash.

20221122

New in this release:

* Support for IPv6 adresses and _ in hostnames in --sshlogin.

* Use --total-jobs for --eta/--bar if generating jobs is slow.

* A lot of bugs fixed in --latest-line.

* Better support for MSYS2.

* Better Text::CSV error messages.

* --bar supports UTF8.

* Bug fixes and man page updates.

20221022

New in this release:

* --latest-line chops line length at terminal width.

* Determine max command length faster on Microsoft Windows.

20220922

New in this release:

* --colour-failed only changes output for failing jobs.

* Password for --sshlogin can be put in $SSHPASS.

* Examples are moved from `man parallel` to `man parallel_examples`.

* Bug fixes and man page updates.

20220822

New in this release:

* --header 0 allows using {filename} as replacement string

* Bug fixes and man page updates.

20220722

New in this release:

* --colour-failed will color output red if the job fails.

* sql: support for InfluxDB.

* Polarhome.com is dead, so these OSs are no longer supported: AIX
  HPUX IRIX Minix OPENSTEP OpenIndiana OpenServer QNX Solaris Syllable
  Tru64 Ultrix UnixWare.

* Bug fixes and man page updates.

20220622

New in this release:

* , can be used in --sshlogin if quoted as \, or ,,

* --plus {/#regexp/str} replace ^regexp with str.

* --plus {/%regexp/str} replace regexp$ with str.

* --plus {//regexp/str} replace every regexp with str.

* 'make install' installs bash+zsh completion files.

* Bug fixes and man page updates.

20220522

New in this release:

* --latest-line shows only the latest line of running jobs.

* --color colors output in different colors per job (this obsoletes --ctag).

* xargs compatibility: --process-slot-var foo sets $foo to jobslot-1.

* xargs compatibility: --open-tty opens the terminal on stdin (standard input).

* Bug fixes and man page updates.

20220422

New in this release:

* sash is no longer supported as shell.

* --retries 0 is an alias for --retries 2147483647.

* --shell-completion returns shell completion code.

* --ssh-login-file reloads every second.

* --parset is replaced with --_parset because it is only used internally.

* sem --pipe passes STDIN (standard input) to the command.

* Bug fixes and man page updates.

20220322

New in this release:

* --sshlogin user:password@host is now supported by using sshpass.

* Bug fixes and man page updates.

20220222

New in this release:

* Encoding of remote commands has changed. This limits the length of
  remote commands to less than half. It also requires $REMOTE_TMPDIR
  to be writable. It makes this release beta quality.

* Time functions hh_mm_ss() hhmmss() hh_mm() hhmm() are now available
  for {= =}.

* Many options in the man page for parallel now has 'see also' for
  related options.

* parallel_options_map.pdf is a map showing which options other
  options relate to.

* {uniq} added to --plus to only run jobs with unique values.

* sem --fg exits with the exit code of the job.

* Bug fixes and man page updates.

20220122

New in this release:

* GNU Parallel turned 20 on the 2022-01-06
  https://www.gnu.org/software/parallel/20th-birthday.html

* Bug fixes and man page updates.

20211222

New in this release:

* Bug fixes and man page updates.

20211122

New in this release:

* Bug fixes and man page updates.

20211022

New in this release:

* Don't postpone output until $jobslots jobs have been started.

* Bug fixes and man page updates.

20210922

New in this release:

* Bug fixes and man page updates.

20210822

New in this release:

* --ctag/--ctagstring colors the tag in different colors for each job.

* You can use unit prefixes (k, m, g, etc) with -n -N -L.

* Bug fixes and man page updates.
   2022-06-28 13:38:00 by Thomas Klausner | Files touched by this commit (3952)
Log message:
*: recursive bump for perl 5.36
   2021-10-26 13:10:38 by Nia Alarie | Files touched by this commit (29)
Log message:
parallel: Replace RMD160 checksums with BLAKE2s checksums

All checksums have been double-checked against existing RMD160 and
SHA512 hashes
   2021-10-07 16:46:48 by Nia Alarie | Files touched by this commit (29)
Log message:
parallel: Remove SHA1 hashes for distfiles
   2021-08-13 14:46:09 by Nia Alarie | Files touched by this commit (2) | Package updated
Log message:
parallel: update to 20210722

New in this release:

* --results no longer prints the result to standard output (stdout) as voted in \ 
https://lists.gnu.org/archive/html/parallel/2020-12/msg00003.html
* parset supports associative arrays in bash, ksh, zsh.
* Online HTML is now generated by Sphinx.
* Bug fixes and man page updates.
   2021-05-24 21:56:06 by Thomas Klausner | Files touched by this commit (3575)
Log message:
*: recursive bump for perl 5.34
   2021-05-02 10:48:33 by Nia Alarie | Files touched by this commit (3) | Package updated
Log message:
parallel: update to 20210422

20210422

* Bug fixes and man page updates.

20210322

* Bug fixes and man page updates.
   2020-11-24 19:14:20 by Nia Alarie | Files touched by this commit (2) | Package updated
Log message:
parallel: Update to 20201122

20201122

* Bug fixes and man page updates.

News about GNU Parallel:

* https://bash-prompt.net/guides/gnu-parallel-multi-server/

20201022

* --termseq now works for jobs running remotely.

* parsort: Performance optimized for 64-core machines.

* Bug fixes and man page updates.

News about GNU Parallel:

* Juan Sierra Pons has made a testimonial:
  http://www.elsotanillo.net/wp-content/uploads/GnuParallel_JuanSierraPons.mp4

* 「翻译」在生物信息学中使用 GNU-Parallel
  https://cloud.tencent.com/developer/article/1705499

20200922

* New CPU detection for GNU/Linux.

* Bug fixes and man page updates.

News about GNU Parallel:

* Aug 21, 2020 - More Unix tools
  https://floki.blog/2020/08/more_unix_tools

20200822

New in this release:

* Max command line length is changed for MacOS - making this version
  beta quality for MacOS.

* Bug fixes and man page updates.

20200722

New in this release:

* No new functionality

* Bug fixes and man page updates.

News about GNU Parallel:

* Tips for Running Jobs on your VM
  \ 
https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel

* Introduction to GNU Parallel: Parallelizing Massive Individual Tasks
  https://www.youtube.com/watch?v=QSFLTEyCKvo

* Slides for same
  \ 
http://www.hpc.lsu.edu/training/weekly-materials/2020-Spring/GNUParallel_Spring_2020.pdf

* Linux-Fu: Parallel Universe
  https://hackaday.com/2020/06/29/linux-fu-parallel-universe/

* Resumable batch jobs with gnu parallel https://igor.io/parallel/

* Introducing Parallel into Shell
  https://www.petelawson.com/post/parallel-in-shell/

* AV1 encoding parallelization with GNU Parallel
  \ 
https://www.reddit.com/r/AV1/comments/fjvqp9/av1_encoding_parallelization_with_gnu_parallel/

* Beschleunigte Befehlsbearbeitung mit GNU Parallel
  \ 
https://www.linux-community.de/ausgaben/linuxuser/2013/06/beschleunigte-befehlsbearbeitung-mit-gnu-parallel/

20200622

New in this release:

* No new functionality

* Bug fixes and man page updates.

News about GNU Parallel:

* GNU Parallel is used at NERSC:
  https://www.nersc.gov/assets/Uploads/08-Workflows-20200616.pdf

* Resumable batch jobs with GNU Parallel https://igor.io/parallel/

* Lab Meeting technical talk
  https://www.slideshare.net/hoffmanlab/gnu-parallel-194030490

* Open Sky Software Website Credits
  https://www.openskysoftware.com/site-credits.htm

* Speed up your Python Scripts using Ubuntu and GNU Parallel
  \ 
https://ecce.esri.ca/wpecce/2019/12/24/speed-up-your-python-scripts-using-ubuntu-and-gnu-parallel/

* Indispensable command-line tools
  https://negfeedback.blogspot.com/2020/05/indispensable-command-line-tools.html

* GNU Parallel for simulations
  http://pdebuyl.be/blog/2020/gnu-parallel-for-simulations.html

* Introduction to GNU parallel
  https://bioinformaticsworkbook.org/Appendix/GNUparallel/GNU_parallel_examples.html

20200522

New in this release:

* While running a job $PARALLEL_JOBSLOT is the jobslot of the job. It
  is equal to {%} unless the job is being retried. See {%} for
  details.

* While running a job $PARALLEL_SSHLOGIN is the sshlogin line with
  number of cores removed. E.g. '4//usr/bin/specialssh user@host'
  becomes: '/usr/bin/specialssh user@host'

* While running a job $PARALLEL_SSHHOST is the host part of an
  sshlogin line. E.g. '4//usr/bin/specialssh user@host' becomes:
  'host'

* --plus activates the replacement strings {slot} = $PARALLEL_JOBSLOT,
  {sshlogin} = $PARALLEL_SSHLOGIN, {host} = $PARALLEL_SSHHOST

* Bug fixes and man page updates.

News about GNU Parallel:

* Portable Batch System (PBS) & GNU Parallel - Running a Program
  Multiple Times in Parallel
  https://www.youtube.com/watch?v=6ccbWu6Befo

* GNU Parallel przykład https://www.youtube.com/watch?v=gs_wG4Kt2G4

* Demo of LINUX APP - GNU PARALLEL - running multiple Gstreamer webcam
  .sh scripts with only 1 command
  https://www.youtube.com/watch?v=trQuA_wmWjg