Which is Faster, List or SQL

[AceScottie]

If there isn't a special ordering, a set (instead of a list) should work very well.

isnt there a hard limit on python arrays or sets ?
i will be using this on ARM CPUs and about 1GB-2GB RAM and the list can go from 150k to over 1 million in less than an hour and needs to run for at least 8 hours non stop. (over 100 million items easily)