Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
multi-threaded file parsing
#1
hi
i have a large file which i need to parse
it has data put in some format, i.e.
data1 data2
data3
key1 value1
key2 value2
...
all file data follows similar syntax
is it possible to process such file and store the data with multitreading?
Reply
#2
you are too vague, Please elaborate.
Reply
#3
what isn't comprehensible?

i have some data structure. i'm asking whether it's poosible to read the file using several threads and store the data in container?
Reply
#4
Yes, as long as processing one record does not require data from another record.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
Video doing data treatment on a file import-parsing a variable EmBeck87 15 2,981 Apr-17-2023, 06:54 PM
Last Post: EmBeck87
  Modify values in XML file by data from text file (without parsing) Paqqno 2 1,730 Apr-13-2022, 06:02 AM
Last Post: Paqqno
  Parsing xml file deletes whitespaces. How to avoid it? Paqqno 0 1,059 Apr-01-2022, 10:20 PM
Last Post: Paqqno
  Parsing a syslog file ebolisa 11 4,200 Oct-10-2021, 05:15 PM
Last Post: snippsat
  Improves performance on socket multi-threaded servers for object detection pennant 1 1,929 Aug-31-2021, 08:43 AM
Last Post: Larz60+
Thumbs Up Parsing a YAML file without changing the string content..?, Flask - solved. SpongeB0B 2 2,305 Aug-05-2021, 08:02 AM
Last Post: SpongeB0B
  Get return value from a threaded function Reverend_Jim 3 17,220 Mar-12-2021, 03:44 AM
Last Post: Reverend_Jim
  File Name Parsing millpond 5 3,669 Aug-26-2020, 08:04 AM
Last Post: bowlofred
  Error while parsing tables from docx file aditi 1 3,764 Jul-14-2020, 09:24 PM
Last Post: aditi
  Simple mutli-threaded scheduler using sched - stuck Mzarour 2 6,167 Nov-12-2019, 07:44 PM
Last Post: Mzarour

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020