Mar-30-2020, 11:21 PM
Ok, I took a couple days off from looking at this to do some coding with logical statements comparing the data once I have it downloaded from the sites. Now revisiting this. I realized my error and installed lxml. I assume you just use that instead of html.parser. I will research the benefits of one over the other. Is there any method to just expand all html data without sending click commands to the websites. So take this page as an example:
https://nj.unibet.com/sports/#filter/foo...1006230344
If you click on "FULL TIME", "HALF", "ASIAN LINES", etc. The HTML page gets populated with additional data for everything in the list for that game. I thought you were originally saying that the lxml would do this, but that does not appear to be the case when I downloaded that page using lxml and writing it to a text document.
If you inspect the page that I put the link up. The elements that I am trying to expand the code for are all using this:
<li class="KambiBC-bet-offer-category KambiBC-collapsible-container">
<header class="KambiBC-bet-offer-category__header" data-touch-feedback="true">
<h2 class="KambiBC-bet-offer-category__title">Full Time </h2>
<div class="KambiBC-header-meta-wrapper"><div class="KambiBC-bet-offer-category__bet-offer-count">12</div></div>
</header>
</li>
So basically trying to automatically expand this element:
<li class="KambiBC-bet-offer-category KambiBC-collapsible-container">
https://nj.unibet.com/sports/#filter/foo...1006230344
If you click on "FULL TIME", "HALF", "ASIAN LINES", etc. The HTML page gets populated with additional data for everything in the list for that game. I thought you were originally saying that the lxml would do this, but that does not appear to be the case when I downloaded that page using lxml and writing it to a text document.
If you inspect the page that I put the link up. The elements that I am trying to expand the code for are all using this:
<li class="KambiBC-bet-offer-category KambiBC-collapsible-container">
<header class="KambiBC-bet-offer-category__header" data-touch-feedback="true">
<h2 class="KambiBC-bet-offer-category__title">Full Time </h2>
<div class="KambiBC-header-meta-wrapper"><div class="KambiBC-bet-offer-category__bet-offer-count">12</div></div>
</header>
</li>
So basically trying to automatically expand this element:
<li class="KambiBC-bet-offer-category KambiBC-collapsible-container">