(Oct-03-2023, 09:56 AM)Gribouillis Wrote: file indexers in Python.Thanks, I had a look. Things like pyFileIndex , pyLucene and others.
What I found was that they do more or less what I plan to do,
sometimes with extra whistles ans bells, but there is no magic.
So I'm on the right track, but I can't create a directory list every time,
I need a permanent, indexed table.
I've looked at "fixed length" text files, doesn't really help.
The only thing stopping me from doing it in SQL is:
- traversing the file system with os.walk is lightning fast.
- But inserting, just 50.000 records into an indexed SQL table takes forever.
There would be multiple tables, each with a few million records at least.
Guess I'll do some more tests.
Paul
It is more important to do the right thing, than to do the thing right.(P.Drucker)
Better is the enemy of good. (Montesquieu) = French version for 'kiss'.
Better is the enemy of good. (Montesquieu) = French version for 'kiss'.