Topic: Basic Parallelisation in Bash

[sam]

I have recently started writing some quite CPU intensive code and since we have a nice cluster here (without any management software on it) I decided that it would be best for me to take advantage of the number of cores on them. Actually, this works nicely on my desktop which has four cores anyway (and 4GB of RAM). Essentially, I'm lazy and this basically runs my pipeline in parallel for different sources by sending off different jobs to different cores (to the maximum number that you specify)... and then when they finish runs then next few... and so on until they are all done. No longer do I have to worry about waiting for the jobs to finish and wasting time by missing their finishing point. I also no longer have to have lots of [screen] sessions or loads of terminals open... bliss... 

http://www.krioma.net/blog/2010/02/basic_parallelisation_in_bash.php

[Simon]

[Rik]

But does it work in Windows?

[sam]

if you install cygwin it will... (i.e. linux inside windows)

[Rik]

Now tell me how it would help me, Sam.

[sam]

unless you are writing your own scripts it probably wont... though if you are processing movies it might. You have to be a linux person really to benefit from this... thus the place it is posted in.

[Rik]

I'm Scots, does that count?

[sam]

no.