Python Forum

Hi Guys,

I am trying to parse this web link (http://insight.toba.fun/address/TVAWF6eD...sigfWK2oRB) using Python3 and requests. When we click the link it loads the details of the account. However, when calling from requests, it does not generate the HTML page that can be obtained by clicking the link. I tried putting a delay but didn't work. I'm unable to get the account the info using python. Can anyone point out a solution for this?
I tried using selenium webdriver, but I'm unable to find the search box in the html.

import requests
url='http://insight.toba.fun/address/TVAWF6eDfW9MRdLitCb7ag41sigfWK2oRB'
r = requests.get(url,verify=False)
print(r.text)

Quote:However, when calling from requests, it does not generate the HTML page that can be obtained by clicking the link.

You are not saving the file.
add after line 3:

with open('yourfilename', 'w') as f:
    f.write(r.text)

(of course, replace 'yourfilername' with a valid .html file name)

(May-01-2018, 11:04 AM)Larz60+ Wrote: [ -> ]

Quote:However, when calling from requests, it does not generate the HTML page that can be obtained by clicking the link.

You are not saving the file.
add after line 3:

with open('yourfilename', 'w') as f:
    f.write(r.text)

(of course, replace 'yourfilername' with a valid .html file name)

The OP probably meant - page is not rendered properly because of Javascript. Try https://html.python-requests.org/ which can render the page with Chromium.