running a bunch of JOBS in parallel but only 3 at a time

[Alex Hauthaler]

Hi guys, i hope you can help me.

Lets say I have 20 jobs objects.

I want to run them all, 3 in paralell, as fast as possible.

i have put them in 3 "lines", running them in sequence, but that is not very fast. whenever one is taking longer it is blocking the subsequent ones. 

whenever one finishes the next should start.

how would i create a Workflow for that.

Thx Alex

[Michael Dolinek]

Hi @Alex Hauthaler

I'm not sure if I understand you 100% correct but I would suggest to use SYNC-objects and do not connect your 20 tasks in a workflow. Or connect the 20 tasks only to the start-node of the workflow (and ignore the end-status of any of these tasks).

Sample for SYNC: https://docs.automic.com/documentation/webhelp/english/AA/24.0/DOCU/24.0/Automic%20Automation%20Guides/Content/AWA/Objects/obj_SyncUsing.htm

Hope this helps

Michael

------------------------------
Michael K. Dolinek

Engineering Program Manager | Agile Operation Division
Broadcom Software
------------------------------

[Arun Verma]

Hi Alex,

I'm not sure about your specific use case or whether there are dependencies between your jobs, However, I believe utilizing a SYNC object could be beneficial. This will ensure that only three jobs are active at any given time. Configure the SYNC object to allow a maximum of 3 executions and add your jobs in parallel or maybe use JOBG. As one job finishes, the next one will start automatically.

For more details, refer to the SYNC object documentation here: SYNC Object Documentation

Hope this helps!

Best regards,

------------------------------
Regards,
Arun Verma
------------------------------

[Peter Gross]

Hi

There are several possibilities. Here are my suggestions:

1. The jobs are started using the same JOBS/JOBP object with different values: Use "max. parallel executions" with "wait" in the JOBS/JOBP Object
2. The jobs are using different JOBS/JOBP- objects: Use a dedicated QUEUE with 3 slots.

Hope that helps you out.


Kind regards
Peter Gross
________________________

Peter Gross
Senior System Engineer
D [phone]
[e-mail]<mailto:[e-mail]>


[cid:image001.png@01DA8BE3.5AF4A330]

Raiffeisen Schweiz Genossenschaft
Raiffeisenplatz 4, 9001 St. Gallen
T 071 225 88 88
raiffeisen.ch<https: www.raiffeisen.ch/="">

[cid:image002.png@01DA8BE3.5AF4A330]<https: twitter.com/raiffeisen_ch=""> [cid:image003.png@01DA8BE3.5AF4A330] <https: www.linkedin.com/company/raiffeisen-switzerland/mycompany/=""> [cid:image004.png@01DA8BE3.5AF4A330] <https: www.facebook.com/raiffeisenmemberplus.schweiz/=""> [cid:image005.png@01DA8BE3.5AF4A330] <https: www.instagram.com/raiffeisen_ch=""> [cid:image006.png@01DA8BE3.5AF4A330] <https: www.youtube.com/user/raiffeisenschweiz="">

[cid:image007.png@01DA8BE3.5AF4A330]


*****************************************************

This e-mail may contain confidential material. It is intended only for the person or entity which it is addressed to. In case you should not be supposed to get this e-mail we ask you to delete it without taking notice of its content. Any views or opinions expressed in this e-mail are those of the sender and do not necessarily coincide with those of The Swiss Raiffeisen Group. Therefore this e-mail does not represent a binding agreement nor an offer to deal. E-Mail transmission can be insecure and can contain errors. Information could be intercepted, corrupted, lost, destroyed, incomplete or may contain viruses. Neither The Swiss Raiffeisen Group nor the sender can accept any liability for any kind of damage as the result of viruses or transmission errors.

*****************************************************

[Markus Embacher]

Hi Alex,

there are several options to solve that  requirement:

1) The JobGroup (JOBG) object. It allows you to define how many jobs are allowed to run in parallel in that group. 
2) QUEUE object to allow 3 slots
3) use the same job and start it 20 times. Use script to dynamically adjust the JCL. Then use max-parallel 3
4) SYNC

Regards, Markus

[Alex Hauthaler]

Thanks to all of you.

I tried now with JOBG.

Problem was when i i put my JOBS objects within a JOBP to register them with the JOBG, it does not work, they are started right away.

therefore i used a ScriptObject to activate all of the JOBS, and then run the JOBG.

Both, script and JOBG i have put within a JOBP.

Thanks for helping.

[Richard Beck]

Build a queue object that has a limit of three threads and attach them to the jobs. Then put all of your jobs in a workflow and attach them all to the start node so it looks like all of them will start at once. They won't because you're Queue limit will prevent this.
If you have jobs that you want to run earlier or later in the pack you can play with the priorities.

This will start three jobs and as soon as one finishes a new one will out of the 20 will kick off

Sent via the Samsung Galaxy S22+ 5G, an AT&T 5G smartphone
Get Outlook for Android<https: aka.ms/aab9ysg="">