+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: General Coding Help (https://python-forum.io/forum-8.html)
+--- Thread: Need to run 100+ Chrome’s with Selenium but can’t get past ~15 without breaking (/thread-34827.html)
Need to run 100+ Chrome’s with Selenium but can’t get past ~15 without breaking - imillz - Sep-04-2021
I have a script with selenium where I need to run about 100 different chromes and 15 tabs per chrome. I can easily run 10 chromes with 15 tabs using an AWS instance with 16 VCPUs and 32GB of RAM, no problem. But when I upgrade my instance to 128 VCPUs and 512GB of RAM somehow I can still only run about 10 or 15 chromes before it just completely breaks. I am carrying out different automated processes on each Chrome.
At this point, I am considering just having 10 different instances running 10 chromes, but would like some way to centrally control them. It would be much more convenient to just run the 100 chromes on a single instance.
Please help with your experience or thoughts.