Jan-24-2023, 10:30 AM
Here's a blog (I didn't read the entire artcle) on how to effeciently deal with massive CSV files using pandas.
Optimized ways to Read Large CSVs in Python
More from google scholar:
Optimized ways to Read Large CSVs in Python
More from google scholar:
- Go to google scholar: https://scholar.google.com/
- Query on 'python solutions for reading massive csv files (over 100 Gb)'
You will get a large list of papers on the subject.
[/list