The maximum you would need would be 8 spaces for CRITICAL. So tell it you want to pad to 8 spaces and use a hyphen for left alignment.
Change
Change
format='%(asctime)s.%(msecs)04d:%(levelname)s: %(message)s',to
format='%(asctime)s.%(msecs)04d:%(levelname)-8s: %(message)s',
Output:2020-06-26 22:42:13.0384:DEBUG : A debug message
2020-06-26 22:42:13.0384:INFO : Info message
2020-06-26 22:42:13.0384:WARNING : Warning message
2020-06-26 22:42:13.0385:CRITICAL: Critical
(or -7 if you want WARNING to be the max and would put up with a bump if a CRITICAL ever appeared).