Python Forum
How to scraping data from dinamic site
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to scraping data from dinamic site
#1
Usually for this task I used power automate or scrape instant, then entered them into Excel, which I calculated everything. I recently entered the gpt chat and he told me to learn python and give up power automet. I downloaded Python and Selenium, asked gPT for the code for scraping, he opened a page without authorization in my Google account, nothing worked at all. a lot of gimmicks, nothing is clear.
Tell me, as experienced programmers, is there any point in going further and trying? Website url = "ati.su", need to scrape distances and prices.
thank you all in advance.
What i should learn? How long it take? I prepare for long strugle, but will it successed? Mayby this site is very difficult?
Reply
#2
Webscraping of commercial platforms is in many cases not wanted by the company running of the website and counter-measures are taken. Except this, the terms of usage may even forbid scraping.
The best and easiest way is to check with the company providing the services if the offer an official API to access their services.

Regards, noisefloor
Reply
#3
(Nov-08-2023, 12:13 PM)noisefloor Wrote: Webscraping of commercial platforms is in many cases not wanted by the company running of the website and counter-measures are taken. Except this, the terms of usage may even forbid scraping.
The best and easiest way is to check with the company providing the services if the offer an official API to access their services.

Regards, noisefloor
i need 10 reguest for day, i just want it automate. my task is simple
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Scraping a site Henry467 0 598 Dec-10-2023, 11:26 AM
Last Post: Henry467
  Scraping data from table into existing dataframe vincer58 1 2,027 Jan-09-2022, 05:15 PM
Last Post: vincer58
  Web scraping data Mike_Eddy 2 2,554 Jul-03-2021, 05:49 PM
Last Post: Mike_Eddy
  Scraping lender data from Ren Ren Dai website using Python. I will pay for that 200$ Hafedh_2021 1 2,756 May-18-2021, 08:41 PM
Last Post: snippsat
  Scraping a page with log in data (security, proxies) iamaghost 0 2,156 Mar-27-2021, 02:56 PM
Last Post: iamaghost
  Scraping Data from Singapore Turf Club singaporeman 2 2,405 Dec-15-2020, 01:28 PM
Last Post: MrBitPythoner
Thumbs Up Issue facing while scraping the data from different websites in single script. Balamani 1 2,135 Oct-20-2020, 09:56 AM
Last Post: Larz60+
  POST request with form data issue web scraping hoff1022 1 2,705 Aug-14-2020, 10:25 AM
Last Post: kashcode
  Scraping Data issues TrexKikBut 1 3,915 Aug-14-2020, 10:20 AM
Last Post: kashcode
  Scraping a dynamic data-table in python through AJAX request filozofo 1 3,895 Aug-14-2020, 10:13 AM
Last Post: kashcode

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020