Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Web Scraping Sportsbook Websites
#17
Ok, I took a couple days off from looking at this to do some coding with logical statements comparing the data once I have it downloaded from the sites. Now revisiting this. I realized my error and installed lxml. I assume you just use that instead of html.parser. I will research the benefits of one over the other. Is there any method to just expand all html data without sending click commands to the websites. So take this page as an example:
https://nj.unibet.com/sports/#filter/foo...1006230344

If you click on "FULL TIME", "HALF", "ASIAN LINES", etc. The HTML page gets populated with additional data for everything in the list for that game. I thought you were originally saying that the lxml would do this, but that does not appear to be the case when I downloaded that page using lxml and writing it to a text document.

If you inspect the page that I put the link up. The elements that I am trying to expand the code for are all using this:

<li class="KambiBC-bet-offer-category KambiBC-collapsible-container">
<header class="KambiBC-bet-offer-category__header" data-touch-feedback="true">
<h2 class="KambiBC-bet-offer-category__title">Full Time&nbsp;</h2>
<div class="KambiBC-header-meta-wrapper"><div class="KambiBC-bet-offer-category__bet-offer-count">12</div></div>
</header>
</li>

So basically trying to automatically expand this element:
<li class="KambiBC-bet-offer-category KambiBC-collapsible-container">
Reply


Messages In This Thread
Web Scraping Sportsbook Websites - by Khuber79 - Mar-23-2020, 03:33 PM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-23-2020, 04:48 PM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-25-2020, 05:28 AM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-25-2020, 06:39 AM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-25-2020, 08:20 AM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-25-2020, 07:10 PM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-25-2020, 07:25 PM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-25-2020, 07:27 PM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-25-2020, 08:51 PM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-26-2020, 03:44 AM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-27-2020, 07:30 PM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-27-2020, 12:24 AM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-27-2020, 05:16 AM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-27-2020, 09:18 AM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-27-2020, 05:09 PM
RE: Web Scraping Sportsbook Websites - by Larz60+ - Mar-27-2020, 09:21 PM
RE: Web Scraping Sportsbook Websites - by Khuber79 - Mar-30-2020, 11:21 PM
RE: Web Scraping Sportsbook Websites - by Whitesox1 - Mar-17-2021, 12:06 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Webscrapping sport betting websites KoinKoin 3 5,606 Nov-08-2023, 03:00 PM
Last Post: LoriBrown
Thumbs Up Issue facing while scraping the data from different websites in single script. Balamani 1 2,169 Oct-20-2020, 09:56 AM
Last Post: Larz60+
  Can urlopen be blocked by websites? peterjv26 2 3,461 Jul-26-2020, 06:45 PM
Last Post: peterjv26
  Python program to write into websites for you pythonDEV333 3 2,583 Jun-08-2020, 12:06 PM
Last Post: pythonDEV333
  Scraping Websites to post on Telegram kobryan 1 2,702 Oct-19-2019, 07:03 AM
Last Post: metulburr
  Scraping Websites to post on Telegram kobryan 0 3,459 Oct-09-2019, 04:11 PM
Last Post: kobryan
  Scrapping .aspx websites boxingowl88 3 8,335 Oct-10-2018, 05:35 PM
Last Post: stranac
  Scrapper for websites stinger 0 2,409 Jul-20-2018, 02:11 AM
Last Post: stinger
  scraping javascript websites with selenium DoctorEvil 1 3,420 Jun-08-2018, 06:40 PM
Last Post: DoctorEvil
  Email extraction from websites stefanoste78 14 12,332 Aug-18-2017, 09:44 PM
Last Post: stefanoste78

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020