Python Forum
Data Validation script in python
Thread Rating:
  • 1 Vote(s) - 1 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Data Validation script in python
#1
Hello Techie,

may someone please help me how to do Data validation automation using Python.
my source is SQL SERVER and Target is SNOWFLAKE. i am using informatica to load data from source (sql)
to target snowflake.

may someone if possible kindly share their expertise, how to approach for python way.

Thanks a lot

My Idea is to pass date as parameter to compare source and target count.
Will it be something like this.
1. Established connection with snowflake.
2. Established Connection with Source
Two Parameter : Lastmodified Parameter or CreatedDatetime: Supply value for these 2 parameter.
Based on the Parameter value total record count will fetch and store in array[x] for Source And ARRAY [Y]
For target.
Compare the 2 and saved the result in table in sql with column, parameter and Count Diff of src and target.

The challenge here is how to connect to snowflake and sql.
May someone please share their expertise with some other way.
Thanks
Reply
#2
May someone please suggest if any better way to achieve this.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  data validation with specific regular expression shaheen07 0 329 Jan-12-2024, 07:56 AM
Last Post: shaheen07
  Is there a *.bat DOS batch script to *.py Python Script converter? pstein 3 3,196 Jun-29-2023, 11:57 AM
Last Post: gologica
  script to calculate data in csv-files ledgreve 0 1,094 May-19-2023, 07:24 AM
Last Post: ledgreve
  python create function validation mg24 1 832 Nov-15-2022, 01:57 AM
Last Post: deanhystad
  How to modify python script to append data on file using sql server 2019? ahmedbarbary 1 1,215 Aug-03-2022, 06:03 AM
Last Post: Pedroski55
  input data validation plumberpy 2 1,775 Aug-11-2021, 12:04 PM
Last Post: plumberpy
  Refresh data in python script while running in Terminal frankenchrist 4 7,248 Feb-03-2021, 09:54 AM
Last Post: Larz60+
  How to kill a bash script running as root from a python script? jc_lafleur 4 5,881 Jun-26-2020, 10:50 PM
Last Post: jc_lafleur
  crontab on RHEL7 not calling python script wrapped in shell script benthomson 1 2,291 May-28-2020, 05:27 PM
Last Post: micseydel
  python script fails with a lot of data bluethundr 2 2,140 Nov-11-2019, 01:35 PM
Last Post: bluethundr

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020