Python Forum
running multiple commands in a parallel pool
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
running multiple commands in a parallel pool
#1
i would like to run multiple commands in a parallel pool. i do not need to wait for the commands to be started or to end. i need to be able to set the pool size at least in advance to limit the concurrency. i need to be able to submit commands after they start running. when a command finishes, it needs to start the next one with no action needed by my code. after submitting the last command i need to wait for everything to be done. commands are in the form of a list of strings like in subprocess.Popen(). surely, something like this has been created, already.
Tradition is peer pressure from dead people

What do you call someone who speaks three languages? Trilingual. Two languages? Bilingual. One language? American.
Reply


Messages In This Thread
running multiple commands in a parallel pool - by Skaperen - Jul-29-2019, 07:40 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Suggestions for coding of multiple commands astroashton 3 1,090 Nov-30-2022, 11:18 PM
Last Post: astroashton
  Multiprocessing Pool Multiple Instances How to Kill by Pool ID sunny9495 0 790 Nov-16-2022, 05:57 AM
Last Post: sunny9495
  super multiple parallel classes catlessness 2 1,373 Jun-07-2022, 02:35 PM
Last Post: deanhystad
  execute commands inside a running application mr_byte31 3 1,375 Apr-12-2022, 08:50 AM
Last Post: Larz60+
  Controlling what get outputted to stdout when running external commands Daring_T 4 2,220 Jan-30-2022, 05:40 PM
Last Post: bowlofred
  Pool multiprocessing - know current status in loop? korenron 0 1,663 Jul-28-2021, 08:49 AM
Last Post: korenron
  pool mysql error - not catch by try\except? korenron 1 2,181 Jul-05-2021, 11:26 AM
Last Post: ibreeden
  Running script on multiple files Afrodizzyjack 1 2,545 May-14-2021, 10:49 PM
Last Post: Yoriz
  Multiproccessing ValueError: Pool not running when running parallel functions Gilush 1 3,357 Jun-06-2020, 12:49 AM
Last Post: Gilush
  Use dynamic variable from parallel running python script Sicksym 0 1,887 May-15-2020, 02:52 PM
Last Post: Sicksym

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020