Python Forum
web scraping for new additions/modifed website?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
web scraping for new additions/modifed website?
#3
Thank you for the quick reply.

What if my task is as following:

1) Webscrape/scan https://www.ditur.dk/herre/sale/herreure#'s code for links with ''linktoken'' in the address e.g.

<button type="button" data-linktoken="xFXOjSAR3FTGeEVN" data-goto="https://www.ditur.dk/dissing-mk9-black-f...AR3FTGeEVN" class="jatak-campaign jatak-campaign--easteregg btn-link">
<img src="https://www.ditur.dk/skin/frontend/ditur/default/jataktilbud/campaigns/easteregg/easter-egg.svg?mt=1617104498">
</button>

2) Go to this link and scan for the price "799" in the code e.g.

<div class="jataktilbud--price">799&nbsp;kr</div>

3) If the price is 799 open the website in a browser or just show the link in the console

4) Keep 1-3 looping


A lot of links will be shown from 1) but only one will be shown from 2) at a random time in the day

Any ideas / point me in the directions of functions/methods which could solve the above...
- Have some experience with java, but not with python, yet...

Thank you in advance for your input
Reply


Messages In This Thread
RE: web scraping for new additions/modifed website? - by kingoman123 - Apr-14-2022, 09:06 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Scraping lender data from Ren Ren Dai website using Python. I will pay for that 200$ Hafedh_2021 1 2,797 May-18-2021, 08:41 PM
Last Post: snippsat
  Scraping all website text using Python MKMKMKMK 1 2,127 Nov-26-2020, 10:35 PM
Last Post: Larz60+
  Scraping a Website (HELP) LearnPython2 1 1,799 May-08-2020, 03:20 PM
Last Post: Larz60+
  scraping from a website that hides source code PIWI_Protein 1 2,011 Mar-27-2020, 05:08 PM
Last Post: Larz60+
  Scraping not moving to the next pages in a website jithin123 0 2,010 Mar-23-2020, 06:10 PM
Last Post: jithin123
  Random Loss of Control of Website When Scraping bmccollum 0 1,554 Aug-30-2019, 04:04 AM
Last Post: bmccollum
  MaxRetryError while scraping a website multiple times kawasso 6 17,653 Aug-29-2019, 05:25 PM
Last Post: kawasso
  scraping multiple pages of a website. Blue Dog 14 22,631 Jun-21-2018, 09:03 PM
Last Post: Blue Dog
  Scraping number in % from website santax 3 4,534 Mar-19-2017, 12:22 PM
Last Post: santax

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020