Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Website scrapping and download
#1
Dear coders,

I am new to this forum and my first post. I have started with python for dummies and trying to give few hours a week.

This is what I want and need to know if python can help me achieve the same and how.?

There is a website> I login , then I put the required fields and then go to a result page, where I am allowed to choose what data I want. After that I can download the info on pdf.

What I want.

Can I write a code in python which when run, will go to the website, enter the current date, select data I want and download pdf.

I know of data scrapping, I have been part of few web design teams and have seen this.

But using python can I write my own code and make this for my self.

My idea is not to just spend hours on typing hello world and see the output, but I would like to see practical use of the code by making a small system.

Apologies if I am on the wrong forum , but I am willing to spend time and learn.

Please help. Thank you
Reply
#2
Quote:Can I write a code in python which when run, will go to the website, enter the current date, select data I want and download pdf.
Yes, Selenium is a good candidate for this type of web scraping.
You can learn the basics here:
Web-scraping part 1
Web-scraping part 2
santoshrane likes this post
Reply
#3
(Apr-14-2021, 12:10 AM)Larz60+ Wrote:
Quote:Can I write a code in python which when run, will go to the website, enter the current date, select data I want and download pdf.
Yes, Selenium is a good candidate for this type of web scraping.
You can learn the basics here:
Web-scraping part 1
Web-scraping part 2

Thank you will give it a try
Reply
#4
You can give a try for selenium, but there is alternative using python requests lib.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Problem with scrapping Website giddyhead 1 1,582 Mar-08-2024, 08:20 AM
Last Post: AhanaSharma
  python web scrapping mg24 1 270 Mar-01-2024, 09:48 PM
Last Post: snippsat
  How can I ignore empty fields when scrapping never5000 0 1,355 Feb-11-2022, 09:19 AM
Last Post: never5000
  Suggestion request for scrapping html table Vkkindia 3 1,989 Dec-06-2021, 06:09 PM
Last Post: Larz60+
  web scrapping through Python Naheed 2 2,578 May-17-2021, 12:02 PM
Last Post: Naheed
  Login and download an exported csv file within a ribbon/button in a website Alekhya 0 2,617 Feb-26-2021, 04:15 PM
Last Post: Alekhya
  Cant Download Images from Unsplash Website firaki12345 1 2,259 Feb-08-2021, 04:15 PM
Last Post: buran
  Newbie help with lxml scrapping chelsealoa 1 1,828 Jan-08-2021, 09:14 AM
Last Post: Larz60+
  Scrapping Sport score laplacea 1 2,223 Dec-13-2020, 04:09 PM
Last Post: Larz60+
  How to export to csv the output of every iteration when scrapping with a loop efthymios 2 2,240 Nov-30-2020, 07:46 PM
Last Post: efthymios

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020