Python Forum
Multi-processing - problem with running multiple *.py files at the same time
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Multi-processing - problem with running multiple *.py files at the same time
#6
From Multiprocessing - RTM

Quote:join([timeout])
If the optional argument timeout is None (the default), the method blocks until the process whose join() method is called terminates. If timeout is a positive number, it blocks at most timeout seconds. Note that the method returns None if its process terminates or if the method times out. Check the process’s exitcode to determine if it terminated.

A process can be joined many times.

A process cannot join itself because this would cause a deadlock. It is an error to attempt to join a process before it has been started.

You essentially block the parent process till the current child process terminates, making all the multiprocessing effort redundant.

You may wait on each process after your start all the processes. Drop p.join() from the first loop and use p.join(0.2) in the second one (also, drop time.sleep from it - redundant).


In general, I believe process pool could be a better option (haven't done multiprocessing in Python for ages) - but in your case that is not so important. If you apply the fixes I've specified above, your code should work as you expect it to.
Test everything in a Python shell (iPython, Azure Notebook, etc.)
  • Someone gave you an advice you liked? Test it - maybe the advice was actually bad.
  • Someone gave you an advice you think is bad? Test it before arguing - maybe it was good.
  • You posted a claim that something you did not test works? Be prepared to eat your hat.
Reply


Messages In This Thread
RE: Multi-processing - problem with running multiple *.py files at the same time - by volcano63 - Sep-12-2018, 01:08 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Problem running external process rjdegraff42 0 337 Mar-19-2025, 07:50 PM
Last Post: rjdegraff42
  Trying to generating multiple json files using python script dzgn989 4 2,286 May-10-2024, 03:09 PM
Last Post: deanhystad
  Filer and sort files by modification time in a directory tester_V 5 2,428 May-02-2024, 05:39 PM
Last Post: tester_V
  problem in running a code akbarza 7 2,353 Feb-14-2024, 02:57 PM
Last Post: snippsat
  python convert multiple files to multiple lists MCL169 6 3,308 Nov-25-2023, 05:31 AM
Last Post: Iqratech
Question Need Help with Vehicle Routing Problem with Time Windows (VRPTW) in Python kasper321421312 1 2,118 Nov-10-2023, 08:19 PM
Last Post: snippsat
  Downloading time zone aware files, getting wrong files(by date))s tester_V 9 2,821 Jul-23-2023, 08:32 AM
Last Post: deanhystad
  splitting file into multiple files by searching for string AlphaInc 2 2,779 Jul-01-2023, 10:35 PM
Last Post: Pedroski55
  Processing Files that are not in use randywberry 3 1,828 Jun-06-2023, 06:00 PM
Last Post: rajeshgk
  Merging multiple csv files with same X,Y,Z in each Auz_Pete 3 3,116 Feb-21-2023, 04:21 AM
Last Post: Auz_Pete

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020