Python Forum
source of python-wstools has two corrupt .gz files in Ubuntu Linux
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
source of python-wstools has two corrupt .gz files in Ubuntu Linux
#4
if i was seriously going to use the package, i'd install it with pip, too. this is probably a good example why. i think it was a leftover from playing around (not serious usage) in an earlier Ubuntu.

i discovered these files while testing a script (zhash.py) that does a hash of the uncompressed form of files in a tree. it used my not-yet-released module named zopen that compresses or uncompresses files based on the file name extension(s). it also uses my ftrgen module to flatten the file tree. i wanted to give something big to do some long timing so i ran it for /usr. when writing a file, zopen() can write to a temporary file name and move the temporary name to the target name given when it is closed.

compressing_file = zopen('foo.gz.bz2.xz','w',tempname=True)
if the file name has multiple compression extensions (sometimes useful) it handles them. one hazard i ran into was a file with a few hundred trillion binary zeros that double compressed very small. it had no idea that this would take most of a day to uncompress. compressing it took a whole weekend.
Tradition is peer pressure from dead people

What do you call someone who speaks three languages? Trilingual. Two languages? Bilingual. One language? American.
Reply


Messages In This Thread
RE: source of python-wstools has two corrupt .gz files in Ubuntu Linux - by Skaperen - Jul-13-2021, 12:29 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Python on Linux ebn852_pan 6 552 May-17-2024, 06:13 AM
Last Post: ebn852_pan
  what stand-alone python-aware open-source editors are around? Skaperen 14 2,406 Jun-11-2023, 11:12 PM
Last Post: Skaperen
  Pandas + PIL on Linux (Python 32) Clives 3 2,304 Mar-25-2022, 07:46 PM
Last Post: snippsat
  python-3.10.0-amd64 build corrupt? lohphat 4 2,532 Nov-21-2021, 09:28 AM
Last Post: Axel_Erfurt
  New open-source Python SDK for NEO blockchain Marsum 0 2,186 Aug-28-2020, 09:16 AM
Last Post: Marsum
  Python 3.8 to be in Ubuntu 20.04 Focal Fossa LTS Skaperen 4 4,175 Oct-31-2019, 12:14 AM
Last Post: Skaperen
  finding which source files import a module Skaperen 3 2,554 Apr-22-2019, 09:28 PM
Last Post: Gribouillis
  Uninstall Python-3.5 source xion824 3 4,586 Dec-21-2018, 08:18 PM
Last Post: metulburr
  Where can I get information about internal logic of source code Python? AlekseyPython 1 2,622 Dec-17-2018, 05:27 AM
Last Post: siripriya
  how to install python on linux manchun 5 4,675 Mar-01-2018, 09:09 AM
Last Post: wavic

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020