Python Forum
Errors using --processes parameter
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Errors using --processes parameter
#1
Hello all,

I'm new to Python and not even a "real" programmer, so I apologize if any of my questions show the lack of expertise ;-)

I'm trying to create "bags" (a defined structure) using a Python script that's been provided. It's called "bagit.py" and can be found on Github (https://github.com/edsu/bagit/blob/master/bagit.py). The script works very well, but considering the amount of data to be packed it runs for many hours. In a helpfile (readme.rst) I found:

Quote:Since calculating checksums can take a while when creating a bag, you may want to calculate them in parallel if you are on a multicore machine. You can do that with the --processes option:

bagit.py --processes 4 /directory/to/bag

Unfortunately following this approach leads to multiple errors (I don't know where to attach the screenshot, but I have one) and NO result at all.

As a probable solution I changed every occurance of "processes=1" into "processes=4" in the script, but that didn't help... just different error messages resulting.

Would one of you probably be able to guide me to the correct use (or syntax), please?

Thank you ever so much!
Michael
Reply


Messages In This Thread
Errors using --processes parameter - by sonhospa - Jul-01-2020, 11:46 AM
RE: Errors using --processes parameter - by buran - Jul-01-2020, 12:47 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [ERROR] ParamValidationError: Parameter validation failed: Invalid type for parameter gdbengo 3 10,963 Dec-26-2022, 08:48 AM
Last Post: ibreeden
  processes shall be parallel flash77 4 1,109 Sep-20-2022, 11:46 AM
Last Post: DeaD_EyE
  Sharing imported modules with Sub Processes? Stubblemonster 2 1,500 May-02-2022, 06:42 AM
Last Post: Stubblemonster
  function with 'self' input parameter errors out with and without 'self' called dford 12 3,078 Jan-15-2022, 06:07 PM
Last Post: deanhystad
  Killing processes via python Lavina 2 2,605 Aug-04-2021, 06:20 AM
Last Post: warnerarc
  How to share a numpy array between 2 processes on Windows? qstdy 0 2,156 Jan-29-2021, 04:24 AM
Last Post: qstdy
  sharing variables between two processes Kiyoshi767 1 1,869 Nov-07-2020, 04:00 AM
Last Post: ndc85430
  2 or more processes on the write end of the same pipe Skaperen 4 3,848 Sep-27-2020, 06:41 PM
Last Post: Skaperen
  cv2.resize(...) shutting down processes? DreamingInsanity 1 2,259 Dec-18-2019, 04:06 PM
Last Post: DreamingInsanity
  waiting for many processes in parallel Skaperen 2 1,886 Sep-02-2019, 02:20 AM
Last Post: Skaperen

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020