Trying to find the fastest way to bulk extract from oracle

[python300]

Hi all,
We are on RHEL 8, Oracle DB 12+ and Python 3.9
I am trying to find the fastest way to extract large data from Oracle DB to local Linux file system in form of flat file (csv, txt, etc)
Data we extract from some Oracle tables could be in GBs with 2-3 billion records.

I am planning to use oracle_cx or it’s replacement oracledb module and 4 threads.

I would greatly appreciate any recommendations from more experienced members who might have done this. Any options using Python would work and we can try those out.

Thank you in advance.

[Larz60+]

I have used Pandas https://pandas.pydata.org/ with impressive results

specifically:

• for database read - https://pandas.pydata.org/docs/reference...d_sql.html
  
• and to write csv - https://pandas.pydata.org/docs/reference...o_csv.html
  

Also sqlalchemy to be very efficient https://www.sqlalchemy.org/

I was surprised by the speed that I've seen with PostgreSQL and SQLite (both packages), haven't tried with Oracle, but would expect similar results.

Search google and this forum for tutorials.

[python300]

I have used Pandas https://pandas.pydata.org/ with impressive results

specifically:

• for database read - https://pandas.pydata.org/docs/reference...d_sql.html
  
• and to write csv - https://pandas.pydata.org/docs/reference...o_csv.html
  

Also sqlalchemy to be very efficient https://www.sqlalchemy.org/

I was surprised by the speed that I've seen with PostgreSQL and SQLite (both packages), haven't tried with Oracle, but would expect similar results.

Search google and this forum for tutorials.

Thank you for your response. I'll definitely check it out.