Nov-19-2019, 11:48 AM
My Source system is DB2 and Target System is Hive. i have used Apache Spark to perform ETL data cleansing and standardization.
I am trying to create a testing Automation using Python. May someone please share their expertise knowledge, which python based tool and Library is best for Data QA testing like type checking,validating Data Structure,check if a value is valid and ability to create own custom script.
and How can i automate that python script for periodic Run.
Please help me, kindly share your precious thoughts.
Many Thanks
I am trying to create a testing Automation using Python. May someone please share their expertise knowledge, which python based tool and Library is best for Data QA testing like type checking,validating Data Structure,check if a value is valid and ability to create own custom script.
and How can i automate that python script for periodic Run.
Please help me, kindly share your precious thoughts.
Many Thanks