Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
California Public Salary Files
#1
California posts files containing salary and compensation of many (all?) public positions
on one of their websites. These files are all of the same .csv format which makes them very handy
for various applications.

I have been playing with them, and thanks to Snippsat am able to scrape the ASP.net catalog.

Keeping the list up to date was a pain, so I created a GUI to aid in the process.

In the next few days, I will add:
  • Automatic zip file extraction -- Done
  • command list so that specific files can be automatically loaded using command file.
This software is available here: https://github.com/Larz60p/CaliforniaPublicSalaries

Here's a screenshot:

   
Reply
#2
Added automatic unpacking of zip files
Reply
#3
You should add a way to run it.
Eg:
pip freeze > requirements.txt
This contain:
appdirs==1.4.3
beautifulsoup4==4.5.3
lxml==3.7.3
packaging==16.8
pyparsing==2.2.0
requests==2.13.0
six==1.10.0
Then run instruction would be:
git clone https://github.com/Larz60p/CaliforniaPublicSalaries.git
pip install -r requirements.txt
CaliforniaPublicSalaries\src\>python CaCompGui.py
This is one way of doing it,other more normal way is pip install my_module.
Then setup.py do it all,find and install 3-party requirements.
Reply
#4
As soon as I wake up completely from my nap (I never used to do that),
I am going to follow your advice.
It's high time I learned (and put into practice) how to create packages.
It's been on my list for quite some time.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Python Rest API Public/Secret Keys Authentication Nonce dn237 1 2,869 Oct-31-2019, 02:07 AM
Last Post: dn237
  how to place Flask code on a public web server rarevesselt 6 6,871 Oct-04-2017, 07:32 AM
Last Post: rarevesselt

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020