Wednesday, August 4, 2010

Shell parallelization - Shell solution for running same process or different processes in parallel

Multiple instances of same job, in parallel.

Example 1:

#!/bin/bash

secvential-job.sh &
secvential-job.sh &
secvential-job.sh &
secvential-job.sh &
...


Example 2:

#!/bin/bash

secvential-job.sh &
secvential-job.sh &
secvential-job.sh &
secvential-job.sh &
...

# wait for all secvential started processes to finish
wait

# do other stuff ...
email-results.sh


Example 3:

#!/bin/bash

secvential-job1.sh &
secvential-job2.sh &
secvential-job2.sh &
secvential-job3.sh &
...

# wait for all secvential started processes to finish
wait

# do other stuff ...
compute-full-report.sh
email-results.sh

No comments: