Dec-21-2017, 07:11 PM
You are really making it difficult for yourself,google use a lot of JavaScript.
JavaScript is rendered in browser,
so when you see
Can try to use Selenium/PhantomJs,i did a quick test and even using those tool is difficult to parse the mess getting back.
So i would try to avoid parse result from a google search,
start train with something simpler.
JavaScript is rendered in browser,
so when you see
div class='g'
(browser) it dos not mean that it will be download source(Requests can not render JavaScript).Can try to use Selenium/PhantomJs,i did a quick test and even using those tool is difficult to parse the mess getting back.
So i would try to avoid parse result from a google search,
start train with something simpler.