To fetch and iterate data from CSV file using python

[vyom1109]

Hi All,

Greetings!!!

I am new to coding and in python and hence need support to resolve following problem statement

The problem statement : We are automating find files from folders of WinSCP tool. We are using pywinauto to automate this scenario.
In the " Find file" search box we have two input text box i.e. one for file and one for corresponding folder. We are trying to use CSV file to fetch data and send it over these two input box as i mentioned. however not sure how to iterate over following data.

Example of CSV file:

Sr No FileName FilePath
1 xyz.txt D:\Documents\Loan documents\Details
2 abc.tar D:\Documents\Loan documents\tar


Expected : We would like to fetch values of row and put it in the input text box. Lets say we have, input box 1 and input box 2
Now i would like to put values from first row from above csv file i.e. 'xyz.txt' to input box 1 and 'D:\Documents\Loan documents\Details' to input box 2 and perform search operation by clicking search button.

Then again it should iterate and go to second row of the csv file and put 'abc.tar' in input box 1 and D:\Documents\Loan documents\tar'
[/b]


I tried using below piece of code but not able to iterate the way i need.

filename = 'file.csv'

with open(filename, 'r') as csvfile:
    datareader = csv.reader(csvfile)
    for x in datareader:
        win[u'Edit'].type_keys(x)

Kindly help me in solving this either for loop or any other method.

[menator01]

Since it is a csv file are those values separated by a comma? If so you can use split.

[DeaD_EyE]

Sr No FileName FilePath
1 xyz.txt D:\Documents\Loan documents\Details
2 abc.tar D:\Documents\Loan documents\tar

This is not valid CSV, because it's not clear where to split.
You could parse it without the csv module.

# this let you run this code also on Linux/Mac/Android/ios/etc...
# Path is platform depent
from pathlib import PureWindowsPath as Path


def row_iter(file):
    with open(file) as fd:
        # skipping header
        # fd is also a line iterator (line ending are not stripped)
        try:
            next(fd)
        except StopIteration:
            raise ValueError("File seems to be empty")
        
        # fd is still an iterator, iterating over the data rows
        for line in fd:
            try:
                # only two splits are allowed, which end into 3 elemnts
                # too less elements => ValueError
                # too much elements is not possible, because of maxsplit=2
                number, filename, filepath = map(str.rstrip, line.split(maxsplit=2))
            except ValueError:
                print("Error with line:", line)
                continue

            try:
                number = int(number)
            except ValueError:
                print(number, "is not an integer, skipping conversion")

            # the yield keyword converts this function into a generator function
            # calling this function, returns an generator
            # iterating over the generator yields number and the path
            yield number, Path(filepath, filename)
            

# reading a file:
rows = list(row_iter(r"C:\Users\XXXX\Desktop\xx.txt"))

Content of rows:

[(1, PureWindowsPath('D:/Documents/Loan documents/Details/xyz.txt')), (2, PureWindowsPath('D:/Documents/Loan documents/tar/abc.tar'))]

[Pedroski55]

Something like this maybe?

import csv

#path2csv = '/home/pedro/myPython/csv/csv/small_sample.csv'
savepath = '/home/pedro/temp/test1.csv'

# spaces in names will cause problems replace with _
# \t will cause problems. escape it \\t
string = """Sr_No FileName FilePath"
1 xyz.txt D:\Documents\Loan_documents\Details
2 abc.tar D:\Documents\Loan_documents\\tar"""

# normally the csv is given
# here just quickly make it from the string you provided
data = string.split()
rows = [data[i:i+3] for i in range(0, len(data), 3)]
with open(savepath, 'w') as csvfile:
    writer = csv.writer(csvfile)
    writer.writerows(rows)

# now we have the csv literally as comma separated variables
# if you have the csv to start with, you don't need the above

with open(savepath, "r") as file:
    dialect = csv.Sniffer().sniff(file.read())
    file.seek(0)
    for row in csv.reader(file, dialect=dialect):
        # each row is a list
        print(f'row is: {row}')
        # show each element of each row
        for element in row:
            print(f'elements in row are: {element}')

For each row as row, the file name will be row[1] and the path will be row[2]

Output:
0
row is: ['Sr_No', 'FileName', 'FilePath"']
elements in row are: Sr_No
elements in row are: FileName
elements in row are: FilePath"
row is: ['1', 'xyz.txt', 'D:\\Documents\\Loan_documents\\Details']
elements in row are: 1
elements in row are: xyz.txt
elements in row are: D:\Documents\Loan_documents\Details
row is: ['2', 'abc.tar', 'D:\\Documents\\Loan_documents\\tar']
elements in row are: 2
elements in row are: abc.tar
elements in row are: D:\Documents\Loan_documents\tar