Python Forum

Full Version: Easiest way to log into a site for web scraping?
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
What is the easiest way to log into a site to web scrape some data?

I tried using RoboBrowser and I can't get it to log in. What are some other ways I can try?

I'm very new to Python so please dumb down everything in your reply :)

Thanks in advance
I tend to use mechanize. You could also look at Selenium, especially if you have to deal with Javascript. It would probably help to learn more about your use-case before suggesting anything else.
I tend to use selenium mostly now, just because if i run into javascript, i dont have to rewrite it.