Python Forum
SaltStack: MySQL returner save less data into Database table columns
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
SaltStack: MySQL returner save less data into Database table columns
#1
I'm trying to modify the existing SaltStack MySQL returner to only save a handful of data instead of the default columns
(| fun | jid | return | id | success | full_ret) to something like

(| fun | jid | return | id | success)

The file I'm working on is this one:
https://github.com/saltstack/salt/blob/m...s/mysql.py

I installed this python module python3-mysqldb so Salt can communicate with MySQL v8.0.25

The part that I modified (line 313)


  try:
        with _get_serv(ret, commit=True) as cur:
            sql = """INSERT INTO `salt_returns`
                     (`fun`, `jid`, `id`, `success`)
                     VALUES (%s, %s, %s, %s)"""
But I'm getting this error when running something like
salt '*' test.ping --return mysql

Error:
2021-07-01 11:46:05,693 [salt.minion :2055][ERROR ][16794] The return failed for job 20210701174605511891: not all arguments converted during string formatting Traceback (most recent call last): File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py", line 238, in execute query = query % args TypeError: not all arguments converted during string formatting During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/salt/minion.py", line 2044, in _thread_return minion_instance.returners[returner_str](ret) File "/usr/lib/python3/dist-packages/salt/loader.py", line 1235, in __call__ return self.loader.run(run_func, *args, **kwargs) File "/usr/lib/python3/dist-packages/salt/loader.py", line 2268, in run return self._last_context.run(self._run_as, _func_or_method, *args, **kwargs) File "/usr/lib/python3/dist-packages/salt/loader.py", line 2283, in _run_as return _func_or_method(*args, **kwargs) File "/usr/lib/python3/dist-packages/salt/returners/mysql.py", line 327, in returner salt.utils.json.dumps(ret), File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py", line 240, in execute self.errorhandler(self, ProgrammingError, str(m)) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py", line 52, in defaulterrorhandler raise errorclass(errorvalue) _mysql_exceptions.ProgrammingError: not all arguments converted during string formatting
I'm guessing it comes down to how each column in the table was defined, but I'm not sure where to make further modifications to write data in only those columns.
Reply
#2
First we are not fond of providing code as a link. We are a bit scared of where a link brings us.
Second: when you delete "full_ret" from the query, you should also remove it from the tuple. So delete line 327.
    salt.utils.json.dumps(ret),
Reply
#3
(Jul-02-2021, 11:32 AM)ibreeden Wrote: First we are not fond of providing code as a link. We are a bit scared of where a link brings us.
Second: when you delete "full_ret" from the query, you should also remove it from the tuple. So delete line 327.
    salt.utils.json.dumps(ret),

Thanks!

That was what I needed, also had to modify the column to be able to accept NULL values.

Appreciated
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  How to create a table with different sizes of columns in MS word pepe 8 1,417 Dec-08-2023, 07:31 PM
Last Post: Pedroski55
  how to save to multiple locations during save cubangt 1 509 Oct-23-2023, 10:16 PM
Last Post: deanhystad
  Mysql and mysql.connector error lostintime 2 611 Oct-03-2023, 10:25 PM
Last Post: lostintime
  Using pyodbc&pandas to load a Table data to df tester_V 3 747 Sep-09-2023, 08:55 PM
Last Post: tester_V
  How to detect abnormal data in big database python vanphuht91 5 1,064 Jun-27-2023, 11:22 PM
Last Post: Skaperen
  Database that can compress a column, or all data, automatically? Calab 3 1,120 May-22-2023, 03:25 AM
Last Post: Calab
  Pymodbus read and save to database stewietopg 3 1,767 Mar-02-2023, 09:32 AM
Last Post: stewietopg
  Mysql Workbench table not updated CatBall 2 1,045 Feb-13-2023, 05:37 PM
Last Post: CatBall
Photo How to select NULL and blank values from MySQL table into csv python300 9 2,329 Dec-27-2022, 09:43 PM
Last Post: deanhystad
  Extracting Data into Columns using pdfplumber arvin 17 5,194 Dec-17-2022, 11:59 AM
Last Post: arvin

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020