Python Forum
Create multiple/single csv file for each sql records
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Create multiple/single csv file for each sql records
#6
Hi Buran,

I did what you suggested, code is working fine. thanks again.
I have one question ,

1) if there is no record in sql. does it go in infinite loop, we are not using break condition / checking are there any records.
2) is there any chance of memory full issue if (SQL Table is big one)

below is attempted as code. is this correct now.

import pyodbc
import csv
import os

connection = pyodbc.connect(
    'DRIVER={ODBC Driver 17 for SQL Server};SERVER=DESKTOP-GQK64O6;DATABASE=Customer;Trusted_Connection=yes;')
with connection.cursor() as crsr:
    qry = "Select * from employee"
    crsr.execute(qry)

    folderPath = "C:\\Users\\malle\\OneDrive\\Desktop\\C\\test_data\\output"
    header = next(zip(*crsr.description))

    fname = "main.csv"
    fullpath = os.path.join(folderPath, fname)
    with open(fullpath, "w", newline="") as outfile:
        writer = csv.writer(outfile, delimiter="|", quoting=csv.QUOTE_NONNUMERIC)
        writer.writerows([header])
        for idx, row in enumerate(crsr, start=1):
            writer.writerows(crsr)
Reply


Messages In This Thread
RE: Create multiple csv file for each sql records - by mg24 - Sep-29-2022, 07:32 AM
Extract sql table data into CSV - by mg24 - Sep-29-2022, 05:22 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Create Choices from .ods file columns cspower 3 681 Dec-28-2023, 09:59 PM
Last Post: deanhystad
  Recommended way to read/create PDF file? Winfried 3 2,986 Nov-26-2023, 07:51 AM
Last Post: Pedroski55
  Use PM4PY and create working file thomaskissas33 0 745 Nov-14-2023, 06:53 AM
Last Post: thomaskissas33
  Create csv file with 4 columns for process mining thomaskissas33 3 821 Nov-06-2023, 09:36 PM
Last Post: deanhystad
  create exe file for linux? korenron 2 1,013 Mar-22-2023, 01:42 PM
Last Post: korenron
  validate large json file with millions of records in batches herobpv 3 1,334 Dec-10-2022, 10:36 PM
Last Post: bowlofred
  my first file won't create itself MehHz2526 2 946 Nov-27-2022, 12:58 AM
Last Post: MehHz2526
  python Multithreading on single file mg24 3 1,821 Nov-05-2022, 01:33 PM
Last Post: snippsat
  Reshaping a single column in to multiple column using Python sahar 7 2,140 Jun-20-2022, 12:35 PM
Last Post: deanhystad
Sad pandas writer create "corrupted" file freko75 1 2,899 Jun-14-2022, 09:57 PM
Last Post: snippsat

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020