(Dec-29-2016, 08:03 AM)snippsat Wrote: So just standard web-scraping,but why you want to do that from a google search?
The source is large,and can fail with SEO changes.
Can you just parse out from one of the many websites that do this eg whatismyipaddress.
Remember that some have API that give back IP in json to.
i have seen random errors from more than on such site. i hame also seen them (or their providers) down for various lengths of time (mostly at night a one of them was down for 2 days in a row). i regulaly use them now to routinely confirm that my VPN (that hides my activity from my ISP, and gives me my own IPv6) is up. what i am trying to make is a tool that scrapes several of them in parallel, with timeouts, and gives me the address the majority find.
(Dec-29-2016, 08:22 AM)wavic Wrote: I prefer requests module too. Also it can handle cookies if it's needed.
But why are you asking Google for your IP? There are services which do exactly this. They even return different data format such a json for instance. Look at my first script ever.
http://python-forum.org/viewtopic.php?f=11&t=20075
google is just one the sites i will scrape. i also expect it to be the most reliable. i will be doing many of them.
Tradition is peer pressure from dead people
What do you call someone who speaks three languages? Trilingual. Two languages? Bilingual. One language? American.
What do you call someone who speaks three languages? Trilingual. Two languages? Bilingual. One language? American.