keeping logs for every success fail attempt

[robertkwild]

Use loguru as suggested by @snippsat. Much simpler to use.

you know what im going to as you guys are right it seems a lot simpler but do i need rotation and retention or just rotation?

[snippsat]

you know what im going to as you guys are right it seems a lot simpler but do i need rotation and retention or just rotation?

Easier file logging with rotation / retention / compression
So link over exaplin it,you should do small test so know that it works as it should.

from loguru import logger
logger.add("loop.log", rotation=".1h")
import time

start = logger.info('Start of loop')
targets = ["a", "b", "c"]
for target in targets:
    time.sleep(5)
    logger.debug(f"Log file: {target}")
end = logger.info('End of loop')

So after 0,1h(6-minutes) roation means that a new file with date will be created,and logging will continue in orginal(loop.log) file.

Output:
loop.2024-07-04_23-08-51_251022.log # Logs for 6-minutes
loop.log

[robertkwild]

ok trying to use loguru to log and its working but when i do rotation i get this error

heres my code

logger.add("password.log", rotation="1 seconds", retention="1 minute")

heres the error in console

2024-07-05 11:51:34.461 | WARNING  | __main__:password:66 - cant find user luke.pearson on the domain, please click back and try again
--- Logging error in Loguru Handler #1 ---
Record was: {'elapsed': datetime.timedelta(seconds=14, microseconds=157588), 'exception': None, 'extra': {}, 'file': (name='password.py', path='C:\\python\\password.py'), 'function': 'password', 'level': (name='WARNING', no=30, icon='⚠️'), 'line': 66, 'message': 'cant find user luke.pearson on the domain, please click back and try again', 'module': 'password', 'name': '__main__', 'process': (id=12552, name='MainProcess'), 'thread': (id=13804, name='Thread-2 (process_request_thread)'), 'time': datetime(2024, 7, 5, 11, 51, 34, 461422, tzinfo=datetime.timezone(datetime.timedelta(seconds=3600), 'GMT Summer Time'))}
Traceback (most recent call last):
  File "C:\Program Files\Python312\Lib\site-packages\loguru\_handler.py", line 206, in emit
    self._sink.write(str_record)
  File "C:\Program Files\Python312\Lib\site-packages\loguru\_file_sink.py", line 204, in write
    self._terminate_file(is_rotating=True)
  File "C:\Program Files\Python312\Lib\site-packages\loguru\_file_sink.py", line 276, in _terminate_file
    os.rename(old_path, renamed_path)
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\python\\password.log' -> 'C:\\python\\password.2024-07-05_10-34-12_310632.log'
--- End of logging error ---
127.0.0.1 - - [05/Jul/2024 11:51:34] "POST /password HTTP/1.1" 200 -

[snippsat]

Do not set rotation="1 seconds" give it some more time,and test first code before add it to Flask.
Example run this code many and see that it make logs file,wait some some time and see that retention do clean up.

from loguru import logger
logger.remove() # Only logg to file
logger.add("password.log", rotation="30 seconds", retention="2 minute")
import time

start = logger.info('Start of loop')
targets = ["a", "b", "c"]
for target in targets:
    time.sleep(5)
    logger.debug(f"Log file: {target}")
end = logger.info('End of loop')

PermissionError: [WinError 32]

Make sure you run from folder you have acess to like a make fiolder yourself,try run cmd as adminstrator then run python your_code.py
Also using Flask the common advice is to virtual enviroment(venv),then usally will not have PermissionError.

[robertkwild]

thanks for the venv, but still gettig same error in console, its writing it in

127.0.0.1 - - [07/Jul/2024 15:14:19] "POST /password HTTP/1.1" 200 -
--- Logging error in Loguru Handler #1 ---
Record was: {'elapsed': datetime.timedelta(seconds=3961, microseconds=202731), 'exception': None, 'extra': {}, 'file': (name='password.py', path='C:\\python\\venv\\password.py'), 'function': 'password', 'level': (name='WARNING', no=30, icon='⚠️'), 'line': 64, 'message': 'cant find user luke.pearson on the domain, please click back and try again', 'module': 'password', 'name': '__main__', 'process': (id=21828, name='MainProcess'), 'thread': (id=7012, name='Thread-159 (process_request_thread)'), 'time': datetime(2024, 7, 7, 15, 14, 20, 790425, tzinfo=datetime.timezone(datetime.timedelta(seconds=3600), 'GMT Summer Time'))}
Traceback (most recent call last):
  File "C:\python\venv\Lib\site-packages\loguru\_handler.py", line 206, in emit
    self._sink.write(str_record)
  File "C:\python\venv\Lib\site-packages\loguru\_file_sink.py", line 204, in write
    self._terminate_file(is_rotating=True)
  File "C:\python\venv\Lib\site-packages\loguru\_file_sink.py", line 276, in _terminate_file
    os.rename(old_path, renamed_path)
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\python\\venv\\password.log' -> 'C:\\python\\venv\\password.2024-07-07_14-04-50_079397.log'
--- End of logging error ---
2024-07-07 15:14:20.790 | WARNING  | __main__:password:64 - cant find user luke.pearson on the domain, please click back and try again
127.0.0.1 - - [07/Jul/2024 15:14:20] "POST /password HTTP/1.1" 200 -
2024-07-07 15:14:22.354 | WARNING  | __main__:password:64 - cant find user luke.pearson on the domain, please click back and try again
127.0.0.1 - - [07/Jul/2024 15:14:22] "POST /password HTTP/1.1" 200 -

and my code

logger.remove()
logger.add("password.log", format="{time:YYYY-MM-DD HH:mm:ss} {level} {message}", rotation="3 seconds", retention=3)
logger.add(sys.stderr, level="DEBUG")

[robertkwild]

same error when i try to run cmd as admin

[robertkwild]

im def confident its a flask etf logging problem as when i do a test normally ie make a new py script it renames it no problem, even when ive opened the document, this is a windows issue as i found posts with simular issues, from the main website

This handler is not appropriate for use under Windows, because under Windows open log files cannot be moved or renamed - logging opens the files with exclusive locks - and so there is no need for such a handler. Furthermore, ST_INO is not supported under Windows; stat() always returns zero for this value.

[robertkwild]

at last got logging working

logger = logging.getLogger("Rotating Log")
logger.setLevel(logging.DEBUG)
handler = TimedRotatingFileHandler(filename='password.log', when='S', interval=30, backupCount=5, delay=True)
logger.addHandler(handler)

the key is delay=True

[snippsat]

loguru works fine with Flask i have used many times.
I do think you doing something wrong,and your making of virtual envioment looks wrong.

To give example look at this post.
So starting from scratch and i gone add loguru,so can log all Chuck Norris👀 jokes.
You can test this should only take 5-10 minutes to set this up.

# Make virtual enviroment
G:\div_code
λ python -m venv joke_env

# Cd in
G:\div_code
λ cd joke_env

# Activate
G:\div_code\joke_env
λ G:\div_code\joke_env\Scripts\activate.bat

# Install required packages,nothing you have install before will work this is the point is isolated enviroment.
G:\div_code\joke_env
(joke_env) λ pip install flask requests loguru
Collecting flask
...... 
Successfully installed Jinja2-3.1.4 MarkupSafe-2.1.5 Werkzeug-3.0.3 blinker-1.8.2 certifi-2024.7.4 charset-normalizer-3.3.2 click-8.1.7
colorama-0.4.6 flask-3.0.3 idna-3.7 itsdangerous-2.2.0 loguru-0.7.2 requests-2.32.3 urllib3-2.2.2 win32-setctime-1.1.0

# mkdir 
G:\div_code\joke_env
(joke_env) λ mkdir joke

# cd in
G:\div_code\joke_env
(joke_env) λ cd joke

# mkdir
G:\div_code\joke_env\joke
(joke_env) λ mkdir templates

G:\div_code\joke_env\joke
(joke_env) λ ls
templates/

Now only need to add files in post,the change to app.py is this add loguru.
index.html is the same

from flask import Flask, render_template, jsonify, request
import requests
import random
import loguru
from loguru import logger
logger.add("chuck.log", rotation="5 minute")

app = Flask(__name__)

@app.route("/")
def index():
    return render_template("index.html")

@app.route("/chuck")
def chuck():
    url = "https://api.chucknorris.io/jokes/random"
    response = requests.get(url)
    chuck_joke = response.json()["value"]
    logger.debug(chuck_joke)
    return chuck_joke

if __name__ == "__main__":
    app.run(debug=True)

To run it stay in virtual enviroment or it will not work,
can setup editor,but if you don't know how do not mess with that now.

G:\div_code\joke_env\joke
(joke_env) λ flask --app app run
 * Serving Flask app 'app'
 * Debug mode: off
WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
 * Running on http://127.0.0.1:5000
Press CTRL+C to quit

Now go to adress and click on buttons to make some jokes and see save to chuck.log works.

Output:
2024-07-10 20:19:35.141 | DEBUG    | app:chuck:19 - Everyone is born naked and crying, except Chuck Norris. Chuck Norris was born dressed as a little soldier, and came out marching.
2024-07-10 20:19:37.379 | DEBUG    | app:chuck:19 - children check under their beds and in there closets for the boogeyman but the boogeyman checks under his bed and in his closet for Chuck Norris.
2024-07-10 20:19:38.981 | DEBUG    | app:chuck:19 - Chuck Norris was asked if he had seen Cindy, his new girlfriends Schnauzer. Chuck said "of course I have, Cindy and I had sex on our first date".
2024-07-10 20:19:42.042 | DEBUG    | app:chuck:19 - In ancient China there is a legend that one day a child will be born from a dragon, grow to be a man, and vanquish evil from the land. That man is not Chuck Norris, because Chuck Norris killed that man.
2024-07-10 20:19:51.682 | DEBUG    | app:chuck:19 - Chuck Norris's skateboard has 22" spinning rims.
2024-07-10 20:19:52.171 | DEBUG    | app:chuck:19 - Chuck Norris can get Mexican food at a Japanese restaurant.

[robertkwild]

loguru works fine with Flask i have used many times.
I do think you doing something wrong,and your making of virtual envioment looks wrong.

To give example look at this post.
So starting from scratch and i gone add loguru,so can log all Chuck Norris👀 jokes.
You can test this should only take 5-10 minutes to set this up.

# Make virtual enviroment
G:\div_code
λ python -m venv joke_env

# Cd in
G:\div_code
λ cd joke_env

# Activate
G:\div_code\joke_env
λ G:\div_code\joke_env\Scripts\activate.bat

# Install required packages,nothing you have install before will work this is the point is isolated enviroment.
G:\div_code\joke_env
(joke_env) λ pip install flask requests loguru
Collecting flask
...... 
Successfully installed Jinja2-3.1.4 MarkupSafe-2.1.5 Werkzeug-3.0.3 blinker-1.8.2 certifi-2024.7.4 charset-normalizer-3.3.2 click-8.1.7
colorama-0.4.6 flask-3.0.3 idna-3.7 itsdangerous-2.2.0 loguru-0.7.2 requests-2.32.3 urllib3-2.2.2 win32-setctime-1.1.0

# mkdir 
G:\div_code\joke_env
(joke_env) λ mkdir joke

# cd in
G:\div_code\joke_env
(joke_env) λ cd joke

# mkdir
G:\div_code\joke_env\joke
(joke_env) λ mkdir templates

G:\div_code\joke_env\joke
(joke_env) λ ls
templates/

Now only need to add files in post,the change to app.py is this add loguru.
index.html is the same

from flask import Flask, render_template, jsonify, request
import requests
import random
import loguru
from loguru import logger
logger.add("chuck.log", rotation="5 minute")

app = Flask(__name__)

@app.route("/")
def index():
    return render_template("index.html")

@app.route("/chuck")
def chuck():
    url = "https://api.chucknorris.io/jokes/random"
    response = requests.get(url)
    chuck_joke = response.json()["value"]
    logger.debug(chuck_joke)
    return chuck_joke

if __name__ == "__main__":
    app.run(debug=True)

To run it stay in virtual enviroment or it will not work,
can setup editor,but if you don't know how do not mess with that now.

G:\div_code\joke_env\joke
(joke_env) λ flask --app app run
 * Serving Flask app 'app'
 * Debug mode: off
WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
 * Running on http://127.0.0.1:5000
Press CTRL+C to quit

Now go to adress and click on buttons to make some jokes and see save to chuck.log works.

Output:
2024-07-10 20:19:35.141 | DEBUG    | app:chuck:19 - Everyone is born naked and crying, except Chuck Norris. Chuck Norris was born dressed as a little soldier, and came out marching.
2024-07-10 20:19:37.379 | DEBUG    | app:chuck:19 - children check under their beds and in there closets for the boogeyman but the boogeyman checks under his bed and in his closet for Chuck Norris.
2024-07-10 20:19:38.981 | DEBUG    | app:chuck:19 - Chuck Norris was asked if he had seen Cindy, his new girlfriends Schnauzer. Chuck said "of course I have, Cindy and I had sex on our first date".
2024-07-10 20:19:42.042 | DEBUG    | app:chuck:19 - In ancient China there is a legend that one day a child will be born from a dragon, grow to be a man, and vanquish evil from the land. That man is not Chuck Norris, because Chuck Norris killed that man.
2024-07-10 20:19:51.682 | DEBUG    | app:chuck:19 - Chuck Norris's skateboard has 22" spinning rims.
2024-07-10 20:19:52.171 | DEBUG    | app:chuck:19 - Chuck Norris can get Mexican food at a Japanese restaurant.

can i get loguru to log debug messages aswell that the system throws aswell ie what i see in the console window aswell