Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
requests post/get to HTML form
#1
Hey there,

I have application which pulls lottery numbers from official website of lottery.

Website allows search previous lottery games by it's date.

I have tried it by using
requests
module but after request was sent I still receiving website output before submit.

Could take a look and guide me what I am doing wrong?

from bs4 import BeautifulSoup
import requests

form = 'form-a4251ea9cfceec0e0003ead731f36e8d'
date = "2019-03-02"
web_page = 'https://www.lotto.pl/lotto/wyniki-i-wygrane/wyszukaj?'

request_id = str.format('data_losowania%5Bdate%5D={0}&op=&form_build_id={1}&form_id=lotto_wyszukaj_form', date.format("yyyy-mm-dd"), form)

def import_lotto():

    response = requests.get(web_page+request_id)

    soup = BeautifulSoup(response.content, 'html.parser')

    print(soup)
Reply
#2
Quote:Requests is an elegant and simple HTTP library for Python, built for human beings.
Requests is just that. I don't know what you expect to get other than html, which is what is does.
I suggest that you read: https://requests.kennethreitz.org/en/master/

I strongly suggest that you vist:
Web scraping part 1
Web scraping part 2
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Getting a URL from Amazon using requests-html, or beautifulsoup aaander 1 1,652 Nov-06-2022, 10:59 PM
Last Post: snippsat
  requests-html + Beautifulsoup klaarnou 0 2,434 Mar-21-2022, 05:31 PM
Last Post: klaarnou
  POST requests - different requests return the same response Default_001 3 1,935 Mar-10-2022, 11:26 PM
Last Post: Default_001
  Post Python to HTML/CSS Extra 3 1,886 Feb-17-2022, 06:07 PM
Last Post: snippsat
  POST Reply to Ajax/jQuery (mostly an HTML question) gw1500se 5 2,673 Nov-18-2021, 02:44 PM
Last Post: gw1500se
  Post HTML Form Data to API Endpoints Dexty 0 1,395 Nov-11-2021, 10:51 PM
Last Post: Dexty
  requests.post() does work Alto 1 2,004 Aug-13-2021, 07:58 AM
Last Post: ndc85430
  HTML multi select HTML listbox with Flask/Python rfeyer 0 4,617 Mar-14-2021, 12:23 PM
Last Post: rfeyer
  Using Python request without selenium on html form with javascript onclick submit but eraosa 0 3,168 Jan-09-2021, 06:08 PM
Last Post: eraosa
  Using python within an html form t4keheart 5 5,394 Aug-17-2020, 12:28 PM
Last Post: t4keheart

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020