Python Forum
Search Results
Post Author Forum Replies Views Posted [asc]
    Thread: POST request with form data issue web scraping
Post: POST request with form data issue web scraping

Please help. I'm trying to create a POST request on an .asp site that requires cookies, but the way I handle them seems not to return anything. Read through some questions of similar topic but can't f...
hoff1022 Web Scraping & Web Development 1 2,649 Apr-12-2020, 03:22 PM
    Thread: Selenium get data from newly accessed page
Post: RE: Selenium get data from newly accessed page

@metulburr 1) https://safer.fmcsa.dot.gov/keywordx.asp...SEARCHTYPE= this query only searches by the "name" = "JIM" what if I want to use the search by "USDOT Number" not name? 2) also when I do ...
hoff1022 Web Scraping & Web Development 2 2,903 Oct-09-2019, 06:52 PM
    Thread: Selenium get data from newly accessed page
Post: Selenium get data from newly accessed page

Don't know how to get data from a newly loaded/clicked page using Selenium. I have 2 questions: 1) I load a page with Selenium (asp) enter some value and a new page loads. On this new page I want t...
hoff1022 Web Scraping & Web Development 2 2,903 Oct-09-2019, 06:27 PM
    Thread: Scrape ASPX data with python...
Post: Scrape ASPX data with python...

I'm trying to use python to scrape an ASPX page for data. Website: https://safer.fmcsa.dot.gov/query.asp Select: US DOT Number Data to enter: 1485012 A page loads. I'm interested in the MCS-150 For...
hoff1022 Web Scraping & Web Development 0 4,500 Feb-26-2019, 06:16 PM
    Thread: Python + request from specific website - please help
Post: RE: Python + request from specific website - pleas...

Guys, can you check this out now. The code you suggested throws this error: 'message': "We've detected that you are using an old version of the website!\n Please do the...
hoff1022 Web Scraping & Web Development 8 4,209 Feb-14-2019, 06:16 PM
    Thread: Python + request from specific website - please help
Post: RE: Python + request from specific website - pleas...

Thanks buran! How did you figure out that the JS was using a json type api? Can you point me to literature where I can learn more about this? I feel like I've got Python basics covered but networkin...
hoff1022 Web Scraping & Web Development 8 4,209 Feb-06-2019, 06:35 PM
    Thread: Python + request from specific website - please help
Post: RE: Python + request from specific website - pleas...

Got it. I got this far: import requests from bs4 import BeautifulSoup url = "https://ucr.gov/enforcement/1712583" url_get = requests.get(url) soup = BeautifulSoup(url_get.content, "html.parser") pri...
hoff1022 Web Scraping & Web Development 8 4,209 Feb-05-2019, 09:41 PM
    Thread: Python + request from specific website - please help
Post: Python + request from specific website - please he...

I'm trying to write a Python code that sends a request to this website: https://ucr.gov/enforcement using the "search" form where I enter the input (example: 129123) and receive the data back. I'm int...
hoff1022 Web Scraping & Web Development 8 4,209 Feb-05-2019, 08:18 PM

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020