Python Forum
Decompressing bz2 in multiple sub-directories
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Decompressing bz2 in multiple sub-directories
#1
Hi there! My root folder contains multiple sub-directories each of which contains multiple *.json.bz2 files. My goal is to decompress the bz2 files and place them in the same sub-directories where they are. Using examples found online, I am trying to run the following code (please note two additional questions mentioned there):

import sys
import os
import bz2
from bz2 import decompress

path = '/Users/mymac/Documents/Jupyter/Twitter/05'
for subdir, dirs, files in os.walk(path):
    for filename in files:
        filepath = os.path.join(dirpath, filename)
        newfilepath = os.path.join(dirpath, filename[:-4]) # Remove ".bz2" in the end
        with open(newfilepath, 'wb') as new_file, bz2.BZ2File(filepath, 'rb') as file:
            for data in iter(lambda : file.read(100 * 1024), b''):
                new_file.write(data)
#Question: how do I delete the the "*.json.bz2" after they are deompressed?
However, it returns the following error message:
---------------------------------------------------------------------------
IsADirectoryError                         Traceback (most recent call last)
<ipython-input-20-6e967e3c97bb> in <module>()
     9         filepath = os.path.join(dirpath, filename)
    10         newfilepath = os.path.join(dirpath, filename[:-4])
---> 11         with open(newfilepath, 'wb') as new_file, bz2.BZ2File(filepath, 'rb') as file:
    12             for data in iter(lambda : file.read(100 * 1024), b''):
    13                 new_file.write(data)

IsADirectoryError: [Errno 21] Is a directory: '/Users/mymac/Documents/Jupyter/Twitter/05/.'


Please advise what I am doing wrong here. Thank you in advance!
Reply


Messages In This Thread
Decompressing bz2 in multiple sub-directories - by kiton - Mar-28-2017, 04:59 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Organization of project directories wotoko 3 575 Mar-02-2024, 03:34 PM
Last Post: Larz60+
  Listing directories (as a text file) kiwi99 1 908 Feb-17-2023, 12:58 PM
Last Post: Larz60+
  Find duplicate files in multiple directories Pavel_47 9 3,420 Dec-27-2022, 04:47 PM
Last Post: deanhystad
  rename same file names in different directories elnk 0 769 Nov-04-2022, 05:23 PM
Last Post: elnk
  I need to copy all the directories that do not match the pattern tester_V 7 2,668 Feb-04-2022, 06:26 PM
Last Post: tester_V
  Moving specific files then unzipping/decompressing christophereccles 2 2,432 Apr-24-2021, 04:25 AM
Last Post: ndc85430
  Python create directories within directories mcesmcsc 2 2,282 Dec-17-2019, 12:32 PM
Last Post: mcesmcsc
  How to combine file names into a list from multiple directories? python_newbie09 3 5,344 Jul-09-2019, 07:38 PM
Last Post: python_newbie09
  Accessing files in various directories and folders ccuny 2 2,243 May-08-2019, 12:11 PM
Last Post: ccuny
  Creating directories from two lists QueenSveta 2 2,844 Jun-22-2018, 09:33 AM
Last Post: volcano63

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020