Python Forum
Decompressing bz2 in multiple sub-directories
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Decompressing bz2 in multiple sub-directories
#10
You could .enumerate() os.walk() and files, but that might just make your code hard to read (and your counter would skip a few, so you'd have 1.json, then a 3.json without a 2).  Here's how I'd do it, nice and simple:

for dirpath, dirname, files in os.walk('/Users/mymac/Documents/Jupyter/Twitter/1 day test'):
   file_counter = 0
   for filename in files:
       if filename.endswith('.json.bz2'):
           filepath = os.path.join(dirpath, filename)
           file_counter += 1
           newfilepath = os.path.join(dirpath, "{0}.json".format(file_counter))
Reply


Messages In This Thread
RE: Decompressing bz2 in multiple sub-directories - by nilamo - Mar-29-2017, 04:51 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Organization of project directories wotoko 3 513 Mar-02-2024, 03:34 PM
Last Post: Larz60+
  Listing directories (as a text file) kiwi99 1 882 Feb-17-2023, 12:58 PM
Last Post: Larz60+
  Find duplicate files in multiple directories Pavel_47 9 3,295 Dec-27-2022, 04:47 PM
Last Post: deanhystad
  rename same file names in different directories elnk 0 747 Nov-04-2022, 05:23 PM
Last Post: elnk
  I need to copy all the directories that do not match the pattern tester_V 7 2,572 Feb-04-2022, 06:26 PM
Last Post: tester_V
  Moving specific files then unzipping/decompressing christophereccles 2 2,408 Apr-24-2021, 04:25 AM
Last Post: ndc85430
  Python create directories within directories mcesmcsc 2 2,257 Dec-17-2019, 12:32 PM
Last Post: mcesmcsc
  How to combine file names into a list from multiple directories? python_newbie09 3 5,291 Jul-09-2019, 07:38 PM
Last Post: python_newbie09
  Accessing files in various directories and folders ccuny 2 2,215 May-08-2019, 12:11 PM
Last Post: ccuny
  Creating directories from two lists QueenSveta 2 2,823 Jun-22-2018, 09:33 AM
Last Post: volcano63

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020