Python Forum
Easiest way to log into a site for web scraping?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Easiest way to log into a site for web scraping?
#1
What is the easiest way to log into a site to web scrape some data?

I tried using RoboBrowser and I can't get it to log in. What are some other ways I can try?

I'm very new to Python so please dumb down everything in your reply :)

Thanks in advance
Reply
#2
I tend to use mechanize. You could also look at Selenium, especially if you have to deal with Javascript. It would probably help to learn more about your use-case before suggesting anything else.
Reply
#3
I tend to use selenium mostly now, just because if i run into javascript, i dont have to rewrite it.
Recommended Tutorials:
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Probably easiest question ever VINCENZOOO 1 535 Jul-01-2023, 03:59 PM
Last Post: deanhystad

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020