Python Forum
Need advice how to scrape a Chinese webpage
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Need advice how to scrape a Chinese webpage
#1
I need to scrape a Chinese webpage on a website that needs logging in + verification by mobile.

I have a username and password. I can login and verify the login by SMS code that is sent.
It's OK, if the code is semi-automated - just not sure how I can get the login or session token passed to the Chinese website?

The page has images that only load after you scroll down - you need to scroll down progressively to get the entire content.

Any advice on where I need to start?

Thanks.
Reply
#2
Anyone?
I was thinking, maybe it's possible for Python to display the login page and allow the user to enter username and password + the SMS notification confirmation?
Reply
#3
Look at Selenium for this.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Python crawler reports errors for some Chinese characters yliu315 0 931 Sep-11-2022, 06:17 PM
Last Post: yliu315
  scrape data 1 go to next page scrape data 2 and so on alkaline3 6 5,091 Mar-13-2020, 07:59 PM
Last Post: alkaline3
  Scrape Multiple items from a webpage Prince_Bhatia 2 3,293 Sep-12-2017, 06:08 AM
Last Post: Prince_Bhatia

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020