Python Forum

Full Version: how to obtain header, data, pararms
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hi guys,

I found out a type of the page where i cannot find curl in Network section ... First time i can see a case like that.

How to handle case like this where you can't copy curl(bash) to requests?
Could you please explain what exactly you are trying to do, and example website
Your post doesn't contain enough information.
Please read: https://python-forum.io/misc.php?action=help&hid=19
My apologies, i ll explain below:

Whenever i am trying to do scrapping script for X site i start with F12 in browser, then i go to "Network" section and then i copy it as cURL(bash) and then i type in google "curl to requests" and i got my first step for X website.

But how to manage when i can't do like that? I realized it's not always possible to do like this
what you want is explained in this tutorial
web scraping part1
web scraping part2
Thank you! I ll read it definitely!