Python Forum
Multithreaded file transfer from multiple volumes
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Multithreaded file transfer from multiple volumes
#2
concurrent futures is easier to use than multiprocessing, but it's threading, thus the ( concurrent ) prefix.
Can only read data from one input at a time, it's just time sliced which gives the appearance of parallelism, but it's not.

Multiprocessing will allow tasks to run in parallel so should improve overall performance.
Take a look at some available packages: https://pypi.org/search/?q=fast+parallel...+reading&o=
(I can't recommend one over the other, some will be better than others, use the 'trending' search to arrange in most popular order)

You might think about streaming the camera data directly using multiprocessing and eliminating the SD card completely, if you can access the raw video (time consuming (software wise), but vendor may provide code).
skoobi likes this post
Reply


Messages In This Thread
RE: Multithreaded file transfer from multiple volumes - by Larz60+ - Jul-27-2022, 08:06 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  How do I properly implement restarting a multithreaded python application? MrFentazis 1 732 Jul-17-2023, 09:10 PM
Last Post: JamesSmith
  file transfer via python SFTP SCP mg24 3 3,199 Sep-15-2022, 04:20 AM
Last Post: mg24
Question resume file transfer onran 0 1,745 Jan-27-2021, 02:16 PM
Last Post: onran
  Remote File Transfer- Error wonderboy 1 1,745 Jan-06-2021, 11:24 AM
Last Post: wonderboy
  code to read files in folders and transfer the file name, type, date created to excel Divya577 0 1,929 Dec-06-2020, 04:14 PM
Last Post: Divya577
  Multithreaded HTTP Server sbguy01 0 6,436 Oct-21-2020, 04:42 PM
Last Post: sbguy01
  DNP3 file transfer with python Aussie 0 1,512 Sep-01-2020, 10:45 PM
Last Post: Aussie
  Splitting the audio file into smaller packets before transfer using UDP protocol in p MuhammadAli152 0 3,814 May-15-2020, 03:01 PM
Last Post: MuhammadAli152
  How to stop Xmodem after bin file transfer was finished shaya2103 0 2,595 Nov-27-2019, 04:33 PM
Last Post: shaya2103
  Multiple entries into a csv file SatansClaw 1 2,082 Jun-13-2019, 07:06 PM
Last Post: stullis

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020