Python Forum
How to use multiprocessing with an array that is continually being appended
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to use multiprocessing with an array that is continually being appended
#1
I have a (long!) script that I wish to speed up considerably by splitting it into 3 modules, and running them in parallel, rather than sequentially, which they currently do. Each script will need to read from several arrays which are constantly being appended, and I'm a little bit confused as to which multiprocessing method is best for that, as each script will potentially be reading the information at different times (ie, process a could be writing value 100 in the array, whilst process b is currently reading 50, and process c 30).

Would a pipe have to send every value in the array I want to pass at once, or can I append it? If it helps, the information only has to travel one way.
Reply


Messages In This Thread
How to use multiprocessing with an array that is continually being appended - by Apretext - Jun-25-2019, 08:53 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020