Timing functions with multiprocessing

[mntfr]

Hi, I have a function that I execute with no problems with multiprocessing however I cant time it

import multiprocessing as mp
import timeit
poolTimes =  mp.Pool(processes=5)
poolResults = mp.Poool(processes=5)
results = [poolResults.apply(myLibrary.myFunction, args=(myObject,)) for myObject in listMyObjects]
times= [poolTimes.apply(timeit.Timer(lambda: myLibrary.myFunction), args=(myObject,)) for my Object in listMyObjects]

With that code I get: _pickle.PicklingError: Can't pickle attribute lookup inner on timeit failed

If I change it to use timeit.timeit I get: TypeError: 'float' object is not callable

Can you point me to what I am doing wrong?

[woooee]

Do you want to time how long it takes to finish? The simplest way to do that is to do it within the called function using a start and finish time/datetime.

[mntfr]

Do you want to time how long it takes to finish? The simplest way to do that is to do it within the called function using a start and finish time/datetime.

I want to time the function for each of the cases in my list of objects

[woooee]

I prefer to code these types of things myself

import datetime
import random
import time
from multiprocessing import Process, Manager


def test_f(process_num, time_limit, test_d, ):
    print(process_num, time_limit)

    ## you can set up the dictionary in many different ways
    test_d["start %d" % process_num] = datetime.datetime.now()  ## start time
    ctr=0
    while ctr < time_limit:
        ctr += 1
        time.sleep(0.5)
    test_d["stop %d" % process_num] = datetime.datetime.now()


if __name__ == '__main__':
    ## define the dictionary to be used to communicate
    manager = Manager()
    test_d = manager.dict()

    ## start 5 processes
    process_list=[]
    for ctr in range(5):
        p = Process(target=test_f, args=(ctr, random.randint(5, 15), test_d))
        p.start()
        process_list.append(p)

    alive=True
    while alive:     ## wait for all processes to finish
        alive=False
        for p in process_list:
            if p.is_alive():
                alive=True

    for ctr in range(5):
        process_list[ctr].join()
        print("process number", ctr, test_d["stop %d"  % ctr] -
              test_d["start %d" % ctr])