Jan-28-2024, 10:37 PM
Thanks for having a look. (ignore the import SQL - it was simply cloned from an earlier template - I also know the slashes are all over the place, but I literally spent hours on every permutation I could think of)
The basic problem is that I have circa 15-20 CSV files that all have a common key and maybe 30 columns in each. There will also be "1 to many' relationships in the data, or legitimate unmatched keys. The output will just be a single text file that is pulling in various bits of data from the multiple CSVs
It seems a good idea to me to host all the data in a database (could be temporary) to allow the data to be joined easily and to cater for unmatched rows etc.
This is just a proof of concept and I'm not set on a database, but I fear that if its done through other means it will be a behemoth
The basic problem is that I have circa 15-20 CSV files that all have a common key and maybe 30 columns in each. There will also be "1 to many' relationships in the data, or legitimate unmatched keys. The output will just be a single text file that is pulling in various bits of data from the multiple CSVs
It seems a good idea to me to host all the data in a database (could be temporary) to allow the data to be joined easily and to cater for unmatched rows etc.
This is just a proof of concept and I'm not set on a database, but I fear that if its done through other means it will be a behemoth