Search Results
|
Post |
Author |
Forum |
Replies |
Views |
Posted
[asc]
|
|
|
Thread: python web scrapping
Post: python web scrapping
from this URL.
Using python selenium I want to take screenshot all charts.
https://www.tiaa.org/public/investment-p...=268569116
please share code.
Thanks
mg |
|
mg24 |
Web Scraping & Web Development |
1 |
270 |
Mar-01-2024, 12:49 PM |
|
|
Thread: merge all xlsb files into csv
Post: merge all xlsb files into csv
Hi Team,
I have 20 xlsb files, my task to combine all xlsb files data into single csv files , with Pipe delimiter
later this CSV I need to import it into SQL Table.
Challenges
18 xlsb files contai... |
|
mg24 |
General Coding Help |
0 |
303 |
Nov-13-2023, 08:25 AM |
|
|
Thread: python Read each xlsx file and write it into csv with pipe delimiter
Post: RE: python Read each xlsx file and write it into c...
Hi Team,
This is code I am using for cosolidation of xlsx files into Main file, Do ou see any error or suggest please
from pathlib import Path
import pandas as pd
foldername = "your_folder_name... |
|
mg24 |
General Coding Help |
4 |
1,308 |
Nov-09-2023, 10:56 AM |
|
|
Thread: python Read each xlsx file and write it into csv with pipe delimiter
Post: python Read each xlsx file and write it into csv ...
Hi Team,
I am trying to Read xlsx file and I want to write it into CSV File with pipe delimited.all decimal values wanted to round up 6 decimal places.
Challenges I am facing for Negative Numbers
x... |
|
mg24 |
General Coding Help |
4 |
1,308 |
Aug-29-2023, 11:13 PM |
|
|
Thread: Insert 10gb csv files into sql table via python
Post: Insert 10gb csv files into sql table via python
Hi Team,
I want to insert CSV Records into sql table via python,
my csv file size is 10 gb,
I found this code on google, Can you suggest better way if someone has done this.
import pyodbc
import... |
|
mg24 |
General Coding Help |
2 |
1,832 |
Apr-28-2023, 09:33 AM |
|
|
Thread: help how to get size of pandas dataframe into MB\GB
Post: help how to get size of pandas dataframe into MB\G...
Hi Team,
I want to convert memory usage of DataFrame into MB OR GB. in a Pythonic way.
below value I want to get size 19647323
import pandas as pd
data = pd.read_csv(r'E:\data\mobile_list.csv')
d... |
|
mg24 |
General Coding Help |
1 |
2,230 |
Jan-28-2023, 09:13 AM |
|
|
Thread: python print all files which contain specific word in it
Post: RE: python print all files which contain specific ...
Hi Deanhystad,
I liked your solution, one more help
LF = 'life'
how to pass LF variable in below syntax.
pattern = re.compile(r'\blife\b')
Thanks
mg |
|
mg24 |
General Coding Help |
5 |
1,188 |
Jan-27-2023, 07:20 AM |
|
|
Thread: python print all files which contain specific word in it
Post: RE: python print all files which contain specific ...
Hi Team,
I am trying to move files from one location to another location.
I want to move few files, by filtering ,
existing code moving all files, how to use glob module correctly.
import glob
im... |
|
mg24 |
General Coding Help |
5 |
1,188 |
Jan-25-2023, 07:21 AM |
|
|
Thread: python print all files which contain specific word in it
Post: python print all files which contain specific word...
Hi Team,
how to print all files which contains specific word in files.
how to concat source path and word to search for.
import glob
SOURCE_PATH = r"E:\data\src"
with open(r'E:\data\mobile_list.cs... |
|
mg24 |
General Coding Help |
5 |
1,188 |
Jan-25-2023, 04:30 AM |
|
|
Thread: python move specific files from source to destination including duplicates
Post: RE: python move specific files from source to des...
Hi deanhystad,
thanks for your help. I agree duplicate files are not allowed in a folder.
below files I want to move from source location to destination.
file naming convention 10 digit mobile no.... |
|
mg24 |
General Coding Help |
3 |
1,050 |
Jan-21-2023, 03:16 AM |
|
|
Thread: pandas dataframe into csv .... exponent issue
Post: RE: pandas dataframe into csv .... exponent issue
Hi Rob.
your code seems works. if I increase width in excels cells, exponent issue goes.
is there any pythonic way to auto adjust excels cell widths. in vba it has a feature.
-0.000005 |
|
mg24 |
General Coding Help |
10 |
1,706 |
Jan-20-2023, 08:04 PM |
|
|
Thread: python move specific files from source to destination including duplicates
Post: python move specific files from source to destina...
Hi Team,
I have 2000 csv files in a source folder. airtel,jio data files etc.
file naming convention start with mobile no and then string value concatenation.
I have list of 800 mobile phones , I ha... |
|
mg24 |
General Coding Help |
3 |
1,050 |
Jan-20-2023, 07:41 PM |
|
|
Thread: pandas dataframe into csv .... exponent issue
Post: RE: pandas dataframe into csv .... exponent issue
Hi Rob,
in both cases you are printing values into console window.
if you check actual data into csv you come across some changes in data. exponent value comes.
these csv values When I try to impor... |
|
mg24 |
General Coding Help |
10 |
1,706 |
Jan-20-2023, 07:33 PM |
|
|
Thread: pandas dataframe into csv .... exponent issue
Post: RE: pandas dataframe into csv .... exponent issue
Hi Team,
pandas dataframe prints values correctly in console window.
but when I try to write data into csv files , I see Exponent symbols in csv.
Actual issue I face when I try to import csv files ... |
|
mg24 |
General Coding Help |
10 |
1,706 |
Jan-20-2023, 07:10 PM |
|
|
Thread: pandas dataframe into csv .... exponent issue
Post: pandas dataframe into csv .... exponent issue
Hi Team,
I am trying to write pandas Dataframe into csv,
wrong values getting printed into csv. exponent issue.
-5.00E-06
import pandas as pd
Net_Income = [0.00000,-0.000005,-1.859603,-55.78808... |
|
mg24 |
General Coding Help |
10 |
1,706 |
Jan-20-2023, 06:20 PM |
|
|
Thread: export sql table to csv using BCP with headers
Post: export sql table to csv using BCP with headers
Hi Team,
Can we export SQL Table into csv using BCP Approach.
bcp "SELECT (SELECT STUFF((SELECT '|'+name FROM sys.columns
WHERE object_id = OBJECT_ID('mydb.dbo.mytable') FOR XML PATH('')),1,1,'')) ... |
|
mg24 |
General Coding Help |
0 |
684 |
Jan-19-2023, 05:36 AM |
|
|
Thread: merge two csv files into output.csv using Subprocess
Post: RE: merge two csv files into output.csv using Subp...
Hi snippsat,
Regarding ----> pandas cant handle 20gb of sql data or csv data.
Can we read data in small chunk and write small chunksize data to csv. this way cant we achieve.
Thanks
mg |
|
mg24 |
General Coding Help |
9 |
1,689 |
Dec-11-2022, 02:12 PM |
|
|
Thread: python pandas sql table with header
Post: RE: python pandas sql table with header
Hi Larz60,
thanks for help need still more help, I am using Microsoft SQL server
1) is sqlite3 Support for extracting data from Microsoft SQL Server.[/b]
2) I want to extract sql data in chunk si... |
|
mg24 |
General Coding Help |
3 |
1,855 |
Dec-08-2022, 12:52 PM |
|
|
Thread: python pandas sql table with header
Post: python pandas sql table with header
Hi Team,
please help me first time using pandas for extracting sql table with headers into csv file.
how to write below header line to csv.
writer.writerow(col[0] for col in cursor.description) ... |
|
mg24 |
General Coding Help |
3 |
1,855 |
Dec-08-2022, 09:22 AM |
|
|
Thread: merge two csv files into output.csv using Subprocess
Post: RE: merge two csv files into output.csv using Subp...
Hi Dead_Eye and Snippsat,
Thanks again for you help, I was looking for BCP or SCP Approach,
because with the below code, I have extracted big sql table data directly into csv .
I wanted combine both... |
|
mg24 |
General Coding Help |
9 |
1,689 |
Dec-08-2022, 05:37 AM |