Python Forum
SaltStack: MySQL returner save less data into Database table columns
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
SaltStack: MySQL returner save less data into Database table columns
#1
I'm trying to modify the existing SaltStack MySQL returner to only save a handful of data instead of the default columns
(| fun | jid | return | id | success | full_ret) to something like

(| fun | jid | return | id | success)

The file I'm working on is this one:
https://github.com/saltstack/salt/blob/m...s/mysql.py

I installed this python module python3-mysqldb so Salt can communicate with MySQL v8.0.25

The part that I modified (line 313)


  try:
        with _get_serv(ret, commit=True) as cur:
            sql = """INSERT INTO `salt_returns`
                     (`fun`, `jid`, `id`, `success`)
                     VALUES (%s, %s, %s, %s)"""
But I'm getting this error when running something like
salt '*' test.ping --return mysql

Error:
2021-07-01 11:46:05,693 [salt.minion :2055][ERROR ][16794] The return failed for job 20210701174605511891: not all arguments converted during string formatting Traceback (most recent call last): File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py", line 238, in execute query = query % args TypeError: not all arguments converted during string formatting During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/salt/minion.py", line 2044, in _thread_return minion_instance.returners[returner_str](ret) File "/usr/lib/python3/dist-packages/salt/loader.py", line 1235, in __call__ return self.loader.run(run_func, *args, **kwargs) File "/usr/lib/python3/dist-packages/salt/loader.py", line 2268, in run return self._last_context.run(self._run_as, _func_or_method, *args, **kwargs) File "/usr/lib/python3/dist-packages/salt/loader.py", line 2283, in _run_as return _func_or_method(*args, **kwargs) File "/usr/lib/python3/dist-packages/salt/returners/mysql.py", line 327, in returner salt.utils.json.dumps(ret), File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py", line 240, in execute self.errorhandler(self, ProgrammingError, str(m)) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py", line 52, in defaulterrorhandler raise errorclass(errorvalue) _mysql_exceptions.ProgrammingError: not all arguments converted during string formatting
I'm guessing it comes down to how each column in the table was defined, but I'm not sure where to make further modifications to write data in only those columns.
Reply
#2
First we are not fond of providing code as a link. We are a bit scared of where a link brings us.
Second: when you delete "full_ret" from the query, you should also remove it from the tuple. So delete line 327.
    salt.utils.json.dumps(ret),
Reply
#3
(Jul-02-2021, 11:32 AM)ibreeden Wrote: First we are not fond of providing code as a link. We are a bit scared of where a link brings us.
Second: when you delete "full_ret" from the query, you should also remove it from the tuple. So delete line 327.
    salt.utils.json.dumps(ret),

Thanks!

That was what I needed, also had to modify the column to be able to accept NULL values.

Appreciated
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
Photo How to select NULL and blank values from MySQL table into csv python300 9 403 Dec-27-2022, 09:43 PM
Last Post: deanhystad
  Extracting Data into Columns using pdfplumber arvin 17 661 Dec-17-2022, 11:59 AM
Last Post: arvin
  How to properly format rows and columns in excel data from parsed .txt blocks jh67 7 398 Dec-12-2022, 08:22 PM
Last Post: jh67
  Basic SQL query using Py: Inserting or querying sqlite3 database not returning data marlonbown 3 262 Nov-08-2022, 07:16 PM
Last Post: marlonbown
  How to keep columns header on excel without change after export data to excel file? ahmedbarbary 0 561 May-03-2022, 05:46 PM
Last Post: ahmedbarbary
  How to save specific variable in for loop in to the database? ilknurg 1 585 Mar-09-2022, 10:32 PM
Last Post: cubangt
  panda table data kucingkembar 0 562 Mar-01-2022, 10:38 PM
Last Post: kucingkembar
  Sorting table data Blacktime2 1 768 Feb-26-2022, 07:05 PM
Last Post: ibreeden
  Mysql error message: Lost connection to MySQL server during query tomtom 6 6,366 Feb-09-2022, 09:55 AM
Last Post: ibreeden
  Save data frame to .csv df.to.csv() mcva 1 852 Feb-03-2022, 07:05 PM
Last Post: mcva

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020