Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
multi-threaded file parsing
#1
hi
i have a large file which i need to parse
it has data put in some format, i.e.
data1 data2
data3
key1 value1
key2 value2
...
all file data follows similar syntax
is it possible to process such file and store the data with multitreading?
Reply
#2
you are too vague, Please elaborate.
Reply
#3
what isn't comprehensible?

i have some data structure. i'm asking whether it's poosible to read the file using several threads and store the data in container?
Reply
#4
Yes, as long as processing one record does not require data from another record.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
Video doing data treatment on a file import-parsing a variable EmBeck87 15 2,810 Apr-17-2023, 06:54 PM
Last Post: EmBeck87
  Modify values in XML file by data from text file (without parsing) Paqqno 2 1,649 Apr-13-2022, 06:02 AM
Last Post: Paqqno
  Parsing xml file deletes whitespaces. How to avoid it? Paqqno 0 1,029 Apr-01-2022, 10:20 PM
Last Post: Paqqno
  Parsing a syslog file ebolisa 11 4,101 Oct-10-2021, 05:15 PM
Last Post: snippsat
  Improves performance on socket multi-threaded servers for object detection pennant 1 1,895 Aug-31-2021, 08:43 AM
Last Post: Larz60+
Thumbs Up Parsing a YAML file without changing the string content..?, Flask - solved. SpongeB0B 2 2,265 Aug-05-2021, 08:02 AM
Last Post: SpongeB0B
  Get return value from a threaded function Reverend_Jim 3 17,024 Mar-12-2021, 03:44 AM
Last Post: Reverend_Jim
  File Name Parsing millpond 5 3,595 Aug-26-2020, 08:04 AM
Last Post: bowlofred
  Error while parsing tables from docx file aditi 1 3,720 Jul-14-2020, 09:24 PM
Last Post: aditi
  Simple mutli-threaded scheduler using sched - stuck Mzarour 2 6,115 Nov-12-2019, 07:44 PM
Last Post: Mzarour

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020