Python Forum
Data Validation script in python
Thread Rating:
  • 1 Vote(s) - 1 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Data Validation script in python
#1
Hello Techie,

may someone please help me how to do Data validation automation using Python.
my source is SQL SERVER and Target is SNOWFLAKE. i am using informatica to load data from source (sql)
to target snowflake.

may someone if possible kindly share their expertise, how to approach for python way.

Thanks a lot

My Idea is to pass date as parameter to compare source and target count.
Will it be something like this.
1. Established connection with snowflake.
2. Established Connection with Source
Two Parameter : Lastmodified Parameter or CreatedDatetime: Supply value for these 2 parameter.
Based on the Parameter value total record count will fetch and store in array[x] for Source And ARRAY [Y]
For target.
Compare the 2 and saved the result in table in sql with column, parameter and Count Diff of src and target.

The challenge here is how to connect to snowflake and sql.
May someone please share their expertise with some other way.
Thanks
Reply
#2
May someone please suggest if any better way to achieve this.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  data validation with specific regular expression shaheen07 0 296 Jan-12-2024, 07:56 AM
Last Post: shaheen07
  Is there a *.bat DOS batch script to *.py Python Script converter? pstein 3 3,008 Jun-29-2023, 11:57 AM
Last Post: gologica
  python create function validation mg24 1 807 Nov-15-2022, 01:57 AM
Last Post: deanhystad
  How to modify python script to append data on file using sql server 2019? ahmedbarbary 1 1,176 Aug-03-2022, 06:03 AM
Last Post: Pedroski55
  input data validation plumberpy 2 1,746 Aug-11-2021, 12:04 PM
Last Post: plumberpy
  Refresh data in python script while running in Terminal frankenchrist 4 7,105 Feb-03-2021, 09:54 AM
Last Post: Larz60+
  How to kill a bash script running as root from a python script? jc_lafleur 4 5,790 Jun-26-2020, 10:50 PM
Last Post: jc_lafleur
  crontab on RHEL7 not calling python script wrapped in shell script benthomson 1 2,248 May-28-2020, 05:27 PM
Last Post: micseydel
  python script fails with a lot of data bluethundr 2 2,102 Nov-11-2019, 01:35 PM
Last Post: bluethundr
  Package python script which has different libraries as a single executable or script tej7gandhi 1 2,583 May-11-2019, 08:12 PM
Last Post: keames

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020