Run function in parallel but inherite dynamic data from the previous function

[atizva]

I'm trying to run multiple functions simultaneously:

-or so called functions because they belong to a class:

1 2 3 4 5 6 7 8 9 10 11 12 13

from sh import tail data = {} class my_Class():     def __init__(self):         """Nothing to declare for initializing"""     def get_data(self, filepath):         """I'm trying to import the data from several files"""         for line in tail("-f", "-n 1", filepath, _iter=True):             data[filepath] = line             print(data) my_Class().get_data("path/to/file") #call 1 my_Class().get_data("path/to/another/file") #call 2 # ... 14 similar calls

I want each call to append it's data to the dictionary. And so, when I call:

1 2 3

my_Class().get_data("path/to/file") #call 1 my_Class().get_data("path/to/another/file") #call 2 # ... 14 similar calls

The result should print:

1 2 3 4

#1 {'filepath1' : line} #2 {'filepath1' : line, 'filepath2' : line} #3 {'filepath1' : line, 'filepath2' : line, 'filepath3' : line} # ... 13 more

At the same time I want the content of dictionary data{...} to keep changing dynamically; because of the data in the files is flexible. For example:

1 2 3 4

#1 {'filepath1' : line} #2 {'filepath1' : last_line_in_the_file}, 'filepath2' : line} #3 {'filepath1' : last_line_in_the_file, 'filepath2' : last_line_in_the_file, 'filepath3' : line} # ... 13 more

I've already checked these posts: but it doesn't do what I ask; https://stackoverflow.com/questions/7207...n-parallel, https://stackoverflow.com/questions/2054...-in-python
Thank you! Please tell me if something sounds obscure

[woooee]

You have not asked a specific question so there are no answers. What is wrong with the code you posted. Note that what is in the dictionary depends on the for statement so insert a print statement to make sure that it finds something. Note also that "data[filepath] = line" will only give you the final line found. Generally, the code would be more like

1 2 3 4 5 6 7 8 9 10 11

class my_Class():     def __init__(self, data, filepath):         for line in tail("-f", "-n 1", filepath, _iter=True):             if filepath not in data:                 data[filepath]=[]             data[filepath].append(line)             print(data)   data={} for filepath in many_paths:     instance=my_Class(data, filepath)

[atizva]

You have not asked a question so there are no answers. Note that what is in the dictionary depends on the for statement so insert a print statement to make sure that it finds something. Note also that "data[filepath] = line" will only give you the final line found.

Hello I'm asking if what I'm trying to do is possible by someway ? Thank you :)

[woooee]

I'm asking if what I'm trying to do is possible by someway ?

I'm not sure I know what that means, but it looks like your code already does that. Have you tried inserting a print statement as I suggested in the previous post/

[volcano63]

There are so many things wrong with this code (including PEP-8 non-compliance and non-specific names).

If you want to use a class - put your data in a class. Using methods (the proper name of class functions) to update external data is usually a bad idea - update object variable. Just create a class and a method that scans folder

1 2 3 4 5 6 7 8 9 10 11 12 13

class FileScanner:     def __init__(self):         self.data = {}       def collect_tail(self, file_name):         .....             if filepath not in data:                 data[filepath]=[]             self.data[filepath].append(line)   scanner = FileScanner() scanner.collect_tail(...) scanner.collect_tail(...)

This is the proper way

BTW, you are running "functions" neither in parallel nor simultaneously - your are running them sequentially, i.e. one after another.

---

1 2 3 4 5 6 7 8 9

class my_Class():     def __init__(self, data, filepath):         for line in tail("-f", "-n 1", filepath, _iter=True):             if filepath not in data:                 data[filepath]=[]             data[filepath].append(line)             print(data)   data={}

You are essentially updating external variable data - this is called side-effect and it is unhealthy coding practice.
Besides, __init__ method is usually used for initialization - not for actual actions

1 2	for filepath in many_paths:     instance=my_Class(data, filepath)

And instance will be overwritten on each iteration...

This is not a good advice...