Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
New in Python Amazon Scraping
#1
Hi Smile ,

I'm new in Python programmation. I have followed a tutorial and written the code down below. (in between the stars)
I don't understand why only a part of the code in scraped.

I was looking to scrape the "productTitle" id.
I can find in on the source code but not when Scraping.

Can anyone explain me why ?
And what should I do to scrape the whole code and not only a part ?

Thx


***************************************************************
import requests
from bs4 import BeautifulSoup

URL = "https://www.amazon.fr/Zoom-F1-LP-IF-Console-denregistrement/dp/B079NWS24D/ref=sr_1_2?__mk_fr_FR=%C3%85M%C3%85%C5%BD%C3%95%C3%91&dchild=1&keywords=zoom+f1&qid=1593959235&sr=8-2"
r = requests.get(URL)

soup=BeautifulSoup(r.content, 'html5lib')
print(soup.prettify())


***************************************************************
Reply
#2
(Jul-09-2020, 03:19 PM)brian1425 Wrote: Can anyone explain me why ?
And what should I do to scrape the whole code and not only a part ?
Look at Web-scraping part-2 under:
snippsat Wrote:JavaScript,why do i not get all content Wall
Search this forum eg my username and Selenium you will find a lot,think i help with eBay,AliExpress,...ect sites before.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Requests_HTML not getting all data on Amazon aaander 1 1,284 Nov-19-2022, 02:09 AM
Last Post: aaander
  Getting a URL from Amazon using requests-html, or beautifulsoup aaander 1 1,618 Nov-06-2022, 10:59 PM
Last Post: snippsat
  Can't open Amazon page Pavel_47 3 3,118 Oct-21-2020, 09:13 AM
Last Post: Aspire2Inspire
  Amazon AWS - how to install the library chatterbot wpaiva 9 3,762 Feb-01-2020, 08:18 AM
Last Post: brighteningeyes
  Execute search query on Amazon website Pavel_47 7 3,368 Nov-07-2019, 10:43 AM
Last Post: snippsat

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020