Python Forum
Python Based Data QA Automation tool suggestion
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Python Based Data QA Automation tool suggestion
#1
My Source system is DB2 and Target System is Hive. i have used Apache Spark to perform ETL data cleansing and standardization.

I am trying to create a testing Automation using Python. May someone please share their expertise knowledge, which python based tool and Library is best for Data QA testing like type checking,validating Data Structure,check if a value is valid and ability to create own custom script.
and How can i automate that python script for periodic Run.
Please help me, kindly share your precious thoughts.
Many Thanks
Reply
#2
Take a look at SQLAlchemy for this: https://www.freecodecamp.org/news/sqlalc...2bd0df928/
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Automation of GUI by python function dghosal 4 824 Aug-18-2023, 10:23 AM
Last Post: dghosal
  Grouping Data based on 30% bracket purnima1 4 1,196 Mar-10-2023, 07:38 PM
Last Post: deanhystad
  conditionals based on data frame mbrown009 1 900 Aug-12-2022, 08:18 AM
Last Post: Larz60+
  home automation using python barryjo 1 1,196 Jul-24-2022, 09:09 PM
Last Post: Larz60+
  I have written a program that outputs data based on GPS signal kalle 1 1,175 Jul-22-2022, 12:10 AM
Last Post: mcmxl22
  Is there software/tool for coding Python? dee 11 2,860 Jun-14-2022, 02:32 PM
Last Post: dee
Question Change elements of array based on position of input data Cola_Reb 6 2,136 May-13-2022, 12:57 PM
Last Post: Cola_Reb
  How to map two data frames based on multiple condition SriRajesh 0 1,483 Oct-27-2021, 02:43 PM
Last Post: SriRajesh
  Can you give me some suggestion about PCEP Newbie1114 0 1,022 Oct-14-2021, 03:02 PM
Last Post: Newbie1114
  instagram followers name without suggestion for you jacklee26 1 3,168 Oct-02-2021, 04:57 AM
Last Post: ndc85430

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020