Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
web scraping using selenium
#1
I want to learn web scraping using selenium(like login into the website with/without username & password then scrolling into the page). There are so many tutorials available in the web. But I don't have any idea, which tutorial is better to start from the basic and then to the deep/advanced level. If anyone in the forum recommend any tutorial like I mentioned, please let me know.
Reply
#2
Everyone's learning methods are different. You must choose the one which enable you understand better. I had quick a glimpse through this tutorial and I quite enjoyed it.
http://thiagomarzagao.com/2013/11/12/web...um-part-1/

Again, it might be easy for me to understand and follow, that doesn't necessarily mean the same to you.
Reply
#3
I have a couple of tutorial here part-1, part-2.
In part-2 there is a Selenium/PhantomJS example.
Should first try(if unsure what's used) with regular tool(Requests,BeautifuSoup,lxml),
if they can not solve it because of JavaScript then bring in Selenium/PhantomJS.
Reply
#4
in here there is an example of logging into facebook and scrolling down.
https://python-forum.io/Thread-Login-in-...4#pid34174
Recommended Tutorials:
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Scraping div tags with selenium, need help hfakoor2 1 1,032 Mar-12-2023, 08:31 AM
Last Post: hfakoor2
  Web scraping cookie in URL blocks selenium Alex06 2 2,384 Jan-10-2021, 01:43 PM
Last Post: Alex06
  Web scraping (selenium (i think)) Larz60+ 10 6,106 Jan-27-2019, 02:57 AM
Last Post: Larz60+
  Web Page not opening while web scraping through python selenium sumandas89 4 9,997 Nov-19-2018, 02:47 PM
Last Post: snippsat
  web scraping with selenium and bs4 Prince_Bhatia 2 3,721 Sep-18-2018, 10:59 AM
Last Post: Prince_Bhatia
  scraping javascript websites with selenium DoctorEvil 1 3,314 Jun-08-2018, 06:40 PM
Last Post: DoctorEvil
  Combining selenium and beautifulsoup for web scraping sumandas89 3 11,578 Jan-30-2018, 02:14 PM
Last Post: metulburr
  Error in Selenium: CRITICAL:root:Selenium module is not installed...Exiting program. AcszE 1 3,584 Nov-03-2017, 08:41 PM
Last Post: metulburr

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020