Python Forum
Is there a way to save a CSV file as a python object
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Is there a way to save a CSV file as a python object
#5
(Jul-16-2019, 11:48 AM)perfringo Wrote:
(Jul-16-2019, 11:23 AM)amjass12 Wrote: Based on experience in R, reading an R object in to R is near instant and that is what i would consider satisfactory.
I read csv files with 200K rows into dictionary and it's 'near instant'. Access to dictionary keys is instant (O(1)).

ok perfect! this was the kind of information i was looking for! if this is the quickest way to do it in python then great. indeed it is significantly faster in python than in R but i was thinking about the long term where i will be getting data sets of a similar size ~200k. they are essentially counts tables... in R these take a long time to read in!

thanks for the info! i shall continue reading in CSV files..
Reply


Messages In This Thread
RE: Is there a way to save a CSV file as a python object - by amjass12 - Jul-16-2019, 12:00 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [solved] Save a matplotlib figure into hdf5 file paul18fr 1 2,524 Jun-08-2021, 05:58 PM
Last Post: paul18fr
  Corrupted numpy arrays when save to file. DreamingInsanity 2 3,249 Dec-14-2019, 12:12 PM
Last Post: DreamingInsanity
  save my sensor data from the bme680 into a json or csv file Plastefuchs84 1 3,149 Aug-23-2019, 03:04 AM
Last Post: Plastefuchs84
  save 2d array to file and load back ian 3 18,298 May-18-2018, 05:00 AM
Last Post: scidam

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020