Python Forum
Web Scraping and crawling - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: Web Scraping and crawling (/thread-23978.html)



Web Scraping and crawling - venkataramakrishna - Jan-25-2020

Hi Members,

I don't have any prior knowledge on Python. But i have a requirement to web scraping data from https://otexa.trade.gov/scripts/tqquantity.exe/HTS from this page, which has Multiple hyperlinks. i want data from hyperlinks for all HTS numbers. when you click on HTS number it takes you to new page and show the data in table format for that particular HTS number. I want get the data for all HTS numbers. final data should include HTS number and corresponding data. How can i get the data. Can some one help me. it is bit urgent.


RE: Web Scraping and crawling - Larz60+ - Jan-25-2020

I recommend first:
web scraping part 1
web scraping part 2