merge two csv files into output.csv using Subprocess

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Thread Modes

merge two csv files into output.csv using Subprocess

mg24
Lumberjack

Posts: 118

Threads: 65

Joined: Sep 2022

Reputation: 0

Dec-11-2022, 02:12 PM

Hi snippsat,

Regarding ----> pandas cant handle 20gb of sql data or csv data.

Can we read data in small chunk and write small chunksize data to csv. this way cant we achieve.

Thanks
mg

Find

Messages In This Thread

merge two csv files into output.csv using Subprocess - by mg24 - Dec-07-2022, 08:11 AM

RE: merge two csv files into output.csv using Subprocess - by DeaD_EyE - Dec-07-2022, 09:53 AM

RE: merge two csv files into output.csv using Subprocess - by Pedroski55 - Dec-07-2022, 11:01 PM

RE: merge two csv files into output.csv using Subprocess - by snippsat - Dec-08-2022, 01:02 AM

RE: merge two csv files into output.csv using Subprocess - by mg24 - Dec-08-2022, 05:37 AM

RE: merge two csv files into output.csv using Subprocess - by DeaD_EyE - Dec-08-2022, 10:12 AM

RE: merge two csv files into output.csv using Subprocess - by Pedroski55 - Dec-08-2022, 10:36 PM

RE: merge two csv files into output.csv using Subprocess - by snippsat - Dec-09-2022, 12:55 AM

RE: merge two csv files into output.csv using Subprocess - by mg24 - Dec-11-2022, 02:12 PM

RE: merge two csv files into output.csv using Subprocess - by Larz60+ - Dec-11-2022, 09:58 PM

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	merge all xlsb files into csv	mg24	0	364	Nov-13-2023, 08:25 AM Last Post: mg24
	Merge all json files in folder after filtering	deneme2	10	2,418	Sep-18-2022, 10:32 AM Last Post: deneme2
	Merge htm files with shutil library (TypeError: 'module' object is not callable)	Melcu54	5	1,660	Aug-28-2022, 07:11 AM Last Post: Melcu54
	Increment text files output and limit contains	Kaminsky	1	3,243	Jan-30-2021, 06:58 PM Last Post: bowlofred
	How to merge all the files in a directory in to one file	sutra	3	2,683	Dec-10-2020, 12:09 AM Last Post: sutra
	opening files and output of parsing	leodavinci1990	4	2,579	Oct-12-2020, 06:52 AM Last Post: bowlofred
	Merge JSON Files	Ugo	4	4,669	Aug-20-2020, 06:25 AM Last Post: ndc85430
	How to get program output from subprocess.Popen?	glestwid	1	2,392	Aug-19-2020, 05:44 AM Last Post: buran
	How to read multiple csv files and merge data	rajeshE	0	1,966	Mar-28-2020, 04:01 PM Last Post: rajeshE
	error merge text files	ledgreve	3	2,725	Nov-18-2019, 12:41 PM Last Post: DeaD_EyE

Users browsing this thread: 1 Guest(s)

View a Printable Version

merge two csv files into output.csv using Subprocess

User Panel Messages

Announcements