Python Forum
How to scraping data from dinamic site - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: How to scraping data from dinamic site (/thread-41086.html)



How to scraping data from dinamic site - sergio21124444 - Nov-08-2023

Usually for this task I used power automate or scrape instant, then entered them into Excel, which I calculated everything. I recently entered the gpt chat and he told me to learn python and give up power automet. I downloaded Python and Selenium, asked gPT for the code for scraping, he opened a page without authorization in my Google account, nothing worked at all. a lot of gimmicks, nothing is clear.
Tell me, as experienced programmers, is there any point in going further and trying? Website url = "ati.su", need to scrape distances and prices.
thank you all in advance.
What i should learn? How long it take? I prepare for long strugle, but will it successed? Mayby this site is very difficult?


RE: How to scraping data from dinamic site - noisefloor - Nov-08-2023

Webscraping of commercial platforms is in many cases not wanted by the company running of the website and counter-measures are taken. Except this, the terms of usage may even forbid scraping.
The best and easiest way is to check with the company providing the services if the offer an official API to access their services.

Regards, noisefloor


RE: How to scraping data from dinamic site - sergio21124444 - Nov-08-2023

(Nov-08-2023, 12:13 PM)noisefloor Wrote: Webscraping of commercial platforms is in many cases not wanted by the company running of the website and counter-measures are taken. Except this, the terms of usage may even forbid scraping.
The best and easiest way is to check with the company providing the services if the offer an official API to access their services.

Regards, noisefloor
i need 10 reguest for day, i just want it automate. my task is simple