Python Forum
POST requests - different requests return the same response - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: POST requests - different requests return the same response (/thread-36607.html)

POST requests - different requests return the same response - Default_001 - Mar-10-2022

Hi All,

I'm trying to retrieve data from a site by sending a POST request which appears to work, however, it returns the same result despite the request changing.

For example:
1. if I change the dates
2. submit the request
3. it will still return the same result as if I never changed the dates

I check this via the website manually incase it case the data was in fact the same and found the data was different so something is must be wrong with my request.

Any help would be greatly appreciated! I'm stuck with this.
Bdate = 20210220
Adate = 20220220   

#Prepare the column headers
BdateVal = str(Bdate) + " Est. value ($m)"
AdateVal = str(Adate) + " Est. value ($m)"

#retrive payload and enter index + dates
d =  {"__EVENTTARGET":"m$m$p1$p1$ITrakResults$DownloadButtoniTrak",
      "__EVENTARGUMENT":"",
      "__LASTFOCUS":"",
      "__VIEWSTATE":VS,
      "__VIEWSTATEGENERATOR":VSG ,
      "__SCROLLPOSITIONX":0,
      "__SCROLLPOSITIONY":0,
      "m$m$p1$p1$ITrakFilter$ddlInvestmentIn":352,
      "m$m$p1$p1$ITrakFilter$ddlComparisonPeriod":Bdate,
      "m$m$p1$p1$ITrakFilter$HiddenFieldLatterDate":Adate,
      "m$m$p1$p1$ITrakFilter$txtInvestorName":"",
      "m$m$p1$p1$ITrakFilter$ddlInvestmentStyle":"",
      "m$m$p1$p1$ITrakFilter$ddlInvestorList":"All Company Lists",
      "m$m$p1$p1$ITrakFilter$ddlInvestmentTrends":0,
      "m$m$p1$p1$ITrakFilter$slider_min":0,
      "m$m$p1$p1$ITrakFilter$slider_max":71000,
      "m$m$p1$p1$ITrakFilter$txtSliderLeftValue":0,
      "m$m$p1$p1$ITrakFilter$txtSliderRightValue":71000,
      "m$m$p1$p1$ITrakFilter$ucLocation$Location":"RadioButtonLocationIgnore",
      "m$m$p1$p1$ITrakFilter$ucLocation$DropDownRegions":0,
      "m$m$p1$p1$ITrakFilter$ucLocation$DropDownCountries":0}

params = {"InvIn":352,
          "FormerDateID":Bdate,
          "Holders":0,
          "ShowDetail":"True",
          "InvName":"",
          "sort":"LatterEstMarketSegmentValue",
          "sortAsc":"False"}
   
#Post request
GetCSV = s.post("https://secure.somewebsite.com/iTrak/Default.aspx?",params=params, headers=DownloadHeaders, data=d)
Snippet of Chrome Dev tool to view the payload with the request: https://ibb.co/yShrqdx

RE: POST requests - different requests return the same response - Larz60+ - Mar-10-2022

what package are you working with?
code cannot be run as posted.

RE: POST requests - different requests return the same response - Default_001 - Mar-10-2022

(Mar-10-2022, 10:07 AM)Larz60+ Wrote: what package are you working with?
code cannot be run as posted.

Sorry missed that detail! I'm working with requests, where s = requests.session().

The website is https://secure.miraqle.com/Login?ReturnUrl=%2f which requires a username + pw which I can't share and it costs to sign up.

However I can provide any other information as necessary.

Really appreciate the help

RE: POST requests - different requests return the same response - Default_001 - Mar-10-2022

Solved it! I needed to the post request to be in the same kernel as the With requests.session():