Python Forum
how to obtain header, data, pararms
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
how to obtain header, data, pararms
#1
Hi guys,

I found out a type of the page where i cannot find curl in Network section ... First time i can see a case like that.

How to handle case like this where you can't copy curl(bash) to requests?
Reply
#2
Could you please explain what exactly you are trying to do, and example website
Your post doesn't contain enough information.
Please read: https://python-forum.io/misc.php?action=help&hid=19
Reply
#3
My apologies, i ll explain below:

Whenever i am trying to do scrapping script for X site i start with F12 in browser, then i go to "Network" section and then i copy it as cURL(bash) and then i type in google "curl to requests" and i got my first step for X website.

But how to manage when i can't do like that? I realized it's not always possible to do like this
Reply
#4
what you want is explained in this tutorial
web scraping part1
web scraping part2
Reply
#5
Thank you! I ll read it definitely!
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Python Resampling: How do I obtain the value of the last week of the month? JaneTan 2 972 Dec-12-2022, 12:49 AM
Last Post: JaneTan
  How to keep columns header on excel without change after export data to excel file? ahmedbarbary 0 1,129 May-03-2022, 05:46 PM
Last Post: ahmedbarbary
  Split the list and obtain a single value Gururaj 1 2,093 Jul-12-2019, 12:01 AM
Last Post: scidam
  How to obtain the background color of a cell using xlrd? Krszt 1 12,421 Mar-12-2019, 11:23 PM
Last Post: hshivaraj
  Obtain Geometric Information and name from a map-design website fyec 2 2,388 Aug-08-2018, 05:11 AM
Last Post: buran
  header of website but no data Brian1210 2 3,895 Oct-07-2017, 11:59 PM
Last Post: Brian1210

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020