Python Forum
how to obtain header, data, pararms - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: General Coding Help (https://python-forum.io/forum-8.html)
+--- Thread: how to obtain header, data, pararms (/thread-21389.html)



how to obtain header, data, pararms - zarize - Sep-27-2019

Hi guys,

I found out a type of the page where i cannot find curl in Network section ... First time i can see a case like that.

How to handle case like this where you can't copy curl(bash) to requests?


RE: how to obtain header, data, pararms - Larz60+ - Sep-27-2019

Could you please explain what exactly you are trying to do, and example website
Your post doesn't contain enough information.
Please read: https://python-forum.io/misc.php?action=help&hid=19


RE: how to obtain header, data, pararms - zarize - Sep-29-2019

My apologies, i ll explain below:

Whenever i am trying to do scrapping script for X site i start with F12 in browser, then i go to "Network" section and then i copy it as cURL(bash) and then i type in google "curl to requests" and i got my first step for X website.

But how to manage when i can't do like that? I realized it's not always possible to do like this


RE: how to obtain header, data, pararms - Larz60+ - Sep-29-2019

what you want is explained in this tutorial
web scraping part1
web scraping part2


RE: how to obtain header, data, pararms - zarize - Sep-30-2019

Thank you! I ll read it definitely!