Python Forum
Delete Lines that Contain Words - Loop through files in a folder - Write to new files
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Delete Lines that Contain Words - Loop through files in a folder - Write to new files
#1
Hi friends,

I am trying to loop through files and from each file delete the lines that contain the search keywords




import os

def remove_line_from_file(filename, line_to_remove, dirpath=''):
  
    filename = os.path.join(dirpath, filename)
    temp_path = os.path.join(dirpath, 'temp.txt')


    
    with open(filename, 'r') as f_read, open(temp_path, 'w') as temp:


        search_keywords=['Car','Train']                # Delete all sentences that contain these words
        
        for line in f_read:
            if (any(map(lambda word: word in line, search_keywords))):
                    
                if line.strip() == word:            #f line.strip() == line_to_remove:
                    continue
                temp.write(line)

        os.remove(filename)
        os.rename(temp_path, filename)
        directory = 'C:/Users/Home/Desktop/test/'
        dirpath, _, files = next(os.walk(directory))

        for f in files:
            remove_line_from_file(f, line, dirpath)
I dont get an error as such - but I cant work out why it doesnt work.

It may not be syntactically correct as i borrowed code from here and there.

Please may a kind person have a look at this

thank you for your time and help



:)


Python newbie trying to learn the ropes
Reply
#2
#!/usr/bin/python3
import os

def remove_line_from_file(filename, dirpath):
    filename  = os.path.join(dirpath, filename)
    temp_path = os.path.join(dirpath, filename + '.tmp')
    search_keywords = ['Car','Train']

    with open(filename, 'r') as f_read, open(temp_path, 'w') as temp:
        for line in f_read:
            found = False
            for word in search_keywords:
                if word in line:
                    found = True
            if not found:
                temp.write(line)

    #os.rename(temp_path, filename)

#main
directory = './'
for root, dirs, files in os.walk(directory):
    for f in files:
        remove_line_from_file(f, directory)
#done
Reply
#3
Thank you my dear friend heiner55.

I am so happy because I have been trying for days to work out the correct syntax for this.
I guess i didnt need the lambda thing
if (any(map(lambda word: word in line, search_keywords))):

Simplicity is the best

My files have so much garbage and it was very hard for me to find these line and manually delete them one after the other Wall

Thank you so much again for lending your programming eyes and time to help me.

Python hero!

I really apreciate it so much

Hope you have a great week! Big Grin

:)



:)


Python newbie trying to learn the ropes
Reply
#4
Glad to hear.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Trying to generating multiple json files using python script dzgn989 4 158 Yesterday, 03:09 PM
Last Post: deanhystad
  Filer and sort files by modification time in a directory tester_V 5 344 May-02-2024, 05:39 PM
Last Post: tester_V
  [SOLVED] Loop through directories and files one level down? Winfried 3 276 Apr-28-2024, 02:31 PM
Last Post: Gribouillis
  Loop through all files in a directory? Winfried 10 539 Apr-23-2024, 07:38 PM
Last Post: FortuneCoins
Question Right way to open files with different encodings? Winfried 2 307 Apr-23-2024, 05:50 PM
Last Post: snippsat
  Open files in an existing window instead of new Kostov 2 380 Apr-13-2024, 07:22 AM
Last Post: Kostov
  Using zipfile module - finding folders not files darter1010 2 323 Apr-06-2024, 07:22 AM
Last Post: Pedroski55
  Is it possible to extract 1 or 2 bits of data from MS project files? cubangt 8 1,127 Feb-16-2024, 12:02 AM
Last Post: deanhystad
  File loop curiously skipping files - FIXED mbk34 10 914 Feb-10-2024, 07:08 AM
Last Post: buran
  Copy Paste excel files based on the first letters of the file name Viento 2 493 Feb-07-2024, 12:24 PM
Last Post: Viento

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020