Jul-16-2019, 12:00 PM
(Jul-16-2019, 11:48 AM)perfringo Wrote:(Jul-16-2019, 11:23 AM)amjass12 Wrote: Based on experience in R, reading an R object in to R is near instant and that is what i would consider satisfactory.I read csv files with 200K rows into dictionary and it's 'near instant'. Access to dictionary keys is instant (O(1)).
ok perfect! this was the kind of information i was looking for! if this is the quickest way to do it in python then great. indeed it is significantly faster in python than in R but i was thinking about the long term where i will be getting data sets of a similar size ~200k. they are essentially counts tables... in R these take a long time to read in!
thanks for the info! i shall continue reading in CSV files..