Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
multi-threaded file parsing
#1
hi
i have a large file which i need to parse
it has data put in some format, i.e.
data1 data2
data3
key1 value1
key2 value2
...
all file data follows similar syntax
is it possible to process such file and store the data with multitreading?
Reply
#2
you are too vague, Please elaborate.
Reply
#3
what isn't comprehensible?

i have some data structure. i'm asking whether it's poosible to read the file using several threads and store the data in container?
Reply
#4
Yes, as long as processing one record does not require data from another record.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
Video doing data treatment on a file import-parsing a variable EmBeck87 15 2,893 Apr-17-2023, 06:54 PM
Last Post: EmBeck87
  Modify values in XML file by data from text file (without parsing) Paqqno 2 1,679 Apr-13-2022, 06:02 AM
Last Post: Paqqno
  Parsing xml file deletes whitespaces. How to avoid it? Paqqno 0 1,043 Apr-01-2022, 10:20 PM
Last Post: Paqqno
  Parsing a syslog file ebolisa 11 4,147 Oct-10-2021, 05:15 PM
Last Post: snippsat
  Improves performance on socket multi-threaded servers for object detection pennant 1 1,907 Aug-31-2021, 08:43 AM
Last Post: Larz60+
Thumbs Up Parsing a YAML file without changing the string content..?, Flask - solved. SpongeB0B 2 2,280 Aug-05-2021, 08:02 AM
Last Post: SpongeB0B
  Get return value from a threaded function Reverend_Jim 3 17,114 Mar-12-2021, 03:44 AM
Last Post: Reverend_Jim
  File Name Parsing millpond 5 3,622 Aug-26-2020, 08:04 AM
Last Post: bowlofred
  Error while parsing tables from docx file aditi 1 3,736 Jul-14-2020, 09:24 PM
Last Post: aditi
  Simple mutli-threaded scheduler using sched - stuck Mzarour 2 6,138 Nov-12-2019, 07:44 PM
Last Post: Mzarour

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020