Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Web Scraping in Python
#1
Need some assistance on web scraping, the url is (https://m.imdb.com/name/nm1475594/filmotype/actor)

how can I parse the page to create a Pandas dataframe with the title, type (film, TV movie, TV series), release year, and character’s name
Reply
#2
We have a forum here called webscraping. Might be a good idea to post there. Also, we like to see some effort, some attempt at the problem and then we will help with problems that may arise there
cokicoki likes this post
Reply
#3
see:
web scraping part 1
web scraping part 2
Reply
#4
Web scraping is used to collect large information from websites.

To extract data using web scraping with python, you need to follow these basic steps:

Find the URL that you want to scrape
Inspecting the Page
Find the data you want to extract
Write the code
Run the code and extract the data
Store the data in the required format
Reply
#5
[Image: pix.jpg]web scraping is one of python's strong abilities, you have to first fetch the data from the web page, then you have to parse, there are many spider lib you can use such as requests and scrapy, in the field of html parsing ,you can use tools such as beautifulsoup 4 or lxml,spend some time to learn these tools, you will get what you want.. Smile Smile Smile
Reply
#6
Again, there are some good tutorials on the forum here:

web scraping part 1
web scraping part 2
Reply


Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020