Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
memory saving in Python
#1
i am creating a script intended to fetch some large sets of data. this script is intended for public use. but it is very heavy on memory usage. part of this seems to be that underlying tools work with bulk data. that is they provide or expect all the data in one big list rather than work with a little at a time. i'm looking around for coding techniques to minimize memory use, such as sort() to sort in place instead of sorted() which makes a 2nd copy before the 1st is deleted. some argument combinations have used upwards of 12 GBs of memory. got any nice links?
Tradition is peer pressure from dead people

What do you call someone who speaks three languages? Trilingual. Two languages? Bilingual. One language? American.
Reply


Messages In This Thread
memory saving in Python - by Skaperen - Jan-20-2020, 01:18 AM
RE: memory saving in Python - by Larz60+ - Jan-20-2020, 02:16 AM
RE: memory saving in Python - by Skaperen - Jan-24-2020, 06:07 AM
RE: memory saving in Python - by perfringo - Jan-24-2020, 06:57 AM
RE: memory saving in Python - by Gribouillis - Jan-24-2020, 07:00 AM
RE: memory saving in Python - by Skaperen - Jan-24-2020, 09:09 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020