Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
advice needed
#6
I have tried different things, but these "popen or plocate" equivalents, seem very
complicated and tricky. And how this is going to behave on different user machines remains to be seen.

In the mean time I picked up some tips and tricks on how to speed up SQLite insert speed using PRAGMA settings
and batch inserts. 53.000 indexed records does not take forever, but 10 minutes tops. = 300.000/hour.
I guess I'll live with that.
thx,
Paul
Edit: there is one strange parameter:
" 'PRAGMA synchronous = 0' "
If you switch it off, insert of 53.000 records is almost instantaneous, like a .txt file.
The caveat is, that any problem with the program, the os, the environment, whist running,
can cause database corruption. Not a good idea ... except...
If it takes only a few seconds for zillions of records, I can create a new database every time.
And if it gets corrupted, no problem, we'll do it again.
Time is money, even when dealing with prayer cards.
Paul
Gribouillis likes this post
It is more important to do the right thing, than to do the thing right.(P.Drucker)
Better is the enemy of good. (Montesquieu) = French version for 'kiss'.
Reply


Messages In This Thread
advice needed - by DPaul - Oct-03-2023, 06:38 AM
RE: advice needed - by Gribouillis - Oct-03-2023, 09:56 AM
RE: advice needed - by DPaul - Oct-03-2023, 12:50 PM
RE: advice needed - by Gribouillis - Oct-03-2023, 02:31 PM
RE: advice needed - by DPaul - Oct-03-2023, 03:18 PM
RE: advice needed - by DPaul - Oct-05-2023, 06:07 AM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020