Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Optimize unittest loading
#1
Hello everyone,

I have a problem, let me describe it.

I've written a unittest (actually, an integration test) for the whole flow of my application (the flow from incoming request to outgoing response). All works fine, but...
When I run my test, the system is preparing (loads all imports, components, modules) for the whole flow, and this takes too much time (over 3 minutes) only for preparation, and only then it runs the test (which takes only 10 seconds).

How can I speedup my test runner? Is there a way to optimize the process? Maybe somehow disable forcing of *.pyc files regeneration or some other way?
Reply
#2
Missing information:
  • Code listing
  • Your OS
  • Memory available and other platform
  • Python version
Reply
#3
1. Code sample (this is only one file):
# TODO: this class will extends from core HttpCommunicator
from typing import Optional

from contracts import contract

from config import SPWContainerDsb
from provider.request.dsb_request import DsbRequest
from provider.service.request_builder.http import DsbHttpRequestBuilderFactory
from transport.http_entities import HttpRequest
from transport.http_request_to_spw_transformer import HttpRequestToSpwTransformer
from transport.spw_xml_element_transformer import SpwRequestXmlElementTransformer
from transport.transport import Message, TransportAsync


class DsbCommunicator:
    @contract(
        transport='$TransportAsync',
        http_request_builder_factory='$DsbHttpRequestBuilderFactory',
        spw_request_builder='$HttpRequestToSpwTransformer',
        spw_request_xml_element_transformer='$SpwRequestXmlElementTransformer'
    )
    def __init__(
            self,
            transport: TransportAsync,
            http_request_builder_factory: DsbHttpRequestBuilderFactory,
            spw_request_builder: HttpRequestToSpwTransformer,
            spw_request_xml_element_transformer: SpwRequestXmlElementTransformer
    ):
        self.__transport = transport
        self.__http_request_builder_factory = http_request_builder_factory
        self.__spw_request_builder = spw_request_builder
        self.__spw_request_xml_element_transformer = spw_request_xml_element_transformer
        self.__last_spw_message = None

    @contract(dsb_request='$DsbRequest')
    def send_request(self, dsb_request: DsbRequest):
        self.__last_spw_message = None
        http_request = self.__get_http_request(dsb_request)
        spw_message = self.__get_spw_message(http_request)
        self.__last_spw_message = spw_message

        self.__transport.send_message(spw_message)

    @contract(dsb_request='$DsbRequest', returns='$HttpRequest')
    def __get_http_request(self, dsb_request: DsbRequest) -> HttpRequest:
        http_request_builder = self.__http_request_builder_factory.get_http_request_builder(dsb_request)
        http_request = http_request_builder.create_http_request(dsb_request)

        return http_request

    @contract(http_request='$HttpRequest', returns='$Message')
    def __get_spw_message(self, http_request: HttpRequest) -> Message:
        spw_request = self.__spw_request_builder.to_spw_request(http_request)
        spw_request_element = self.__spw_request_xml_element_transformer.to_element(spw_request)
        spw_body = spw_request_element.to_string()
        message = Message(spw_body, SPWContainerDsb(spw_body))

        return message

    def get_last_spw_message(self) -> Optional[Message]:
        return self.__last_spw_message
2. Windows 10
3. 32Gb
4. Python 3.5
Reply
#4
I found performance problem in my code: using PyContracts library. It was analyse too match code and rules via inspect library.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  problem in using unittest akbarza 2 257 Feb-25-2024, 12:51 PM
Last Post: deanhystad
  How can I multithread to optimize a groupby task: davisc4468 0 672 Jun-30-2023, 02:45 PM
Last Post: davisc4468
Question Unwanted execution of unittest ThomasFab 9 1,944 Nov-15-2022, 05:33 PM
Last Post: snippsat
  unittest.mock for an api key silver 3 1,335 Aug-29-2022, 03:52 PM
Last Post: ndc85430
  do you have an idea to optimize this code[recursion]]? netanelst 4 1,238 May-20-2022, 06:41 PM
Last Post: jefsummers
  Ran 0 tests in 0.000s - unittest Peaches 8 4,924 Dec-31-2021, 08:58 AM
Last Post: Peaches
  Optimization using scipy.optimize KaneBilliot 3 1,867 Nov-30-2021, 08:03 AM
Last Post: Gribouillis
  Using curve_fit to optimize function (TypeError) Laplace12 4 2,452 Aug-30-2021, 11:15 AM
Last Post: Larz60+
Sad Problem with Unittest mhanusek 1 3,679 Nov-12-2020, 04:58 PM
Last Post: Gribouillis
  Unittest et patch mad31 2 2,071 Aug-09-2020, 06:16 AM
Last Post: mad31

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020