Python Forum
read complex file with both pandas and not
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
read complex file with both pandas and not
#1
Dear all,

I have this complex file:

# ID ,116
# Localita  ,SB16
# Lon/Lat ,11.138574,46.886774
# Quota ,1839
DATA ORA, T, RH,PSFC,DIR,VEL10, PREC, RAD, CC,FOG
yyyy-mm-dd hh:mm, °C, %, hPa, °N, m/s, mm/h,W/m², %,-
2012-01-01 06:00, -0.1,100, 815,313, 2.6, 0.0, 0, 0,0
2012-01-01 07:00, -1.2, 93, 814,314, 4.8, 0.0, 0, 0,0
2012-01-01 08:00, 1.7, 68, 815,308, 7.5, 0.0, 41, 11,0
2012-01-01 09:00, 2.4, 65, 815,308, 7.4, 0.0, 150, 33,0
2012-01-01 10:00, 3.0, 64, 816,305, 8.4, 0.0, 170, 44,0
2012-01-01 11:00, 2.6, 65, 816,303, 6.3, 0.0, 321, 22,0
....
....

I would like to read the value 1839 and store it in a variable. After that, I would like to read all the data after the # with pandas and store it in a dataframe. However, I would like to use "DATA ORA, T, RH,PSFC,DIR,VEL10, PREC, RAD, CC,FOG" as header and not the six line.

I am able to do read it with Pandas but I have to skip the first row and cancel the 6-th line from the file.

What do you think? Is it better to move to simpler file.
Thanks in advance for any help,

Diedro
Reply


Messages In This Thread
read complex file with both pandas and not - by Diedro - Jan-29-2019, 04:07 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  problem with opening csv file in pandas saratha 2 535 Jul-21-2020, 10:55 AM
Last Post: saratha
  Can't read text file with pandas zinho 6 3,861 May-24-2020, 06:13 AM
Last Post: azajali43
  how to solve the 'NO SUCH DIRECTORY OR FILE' in pandas, python MohammedSohail 10 1,225 May-08-2020, 07:45 AM
Last Post: nnk
  Read json array data by pandas vipinct 0 400 Apr-13-2020, 02:24 PM
Last Post: vipinct
  Read file Into array with just $0d as Newline lastyle 5 798 Feb-03-2020, 11:58 PM
Last Post: lastyle
  getting trailing zeros with 1 during pandas read fullstop 1 1,069 Jan-05-2020, 04:01 PM
Last Post: ichabod801
  Read csv file from Yahoo Finance ian 3 1,370 Sep-22-2019, 06:47 AM
Last Post: ndc85430
  Read Nested JSON with pandas.io.json palo173 4 5,775 Apr-29-2019, 01:25 PM
Last Post: palo173
  loading a csv file into python from pandas. Variable is not recognized vijjumodi 2 1,005 Apr-19-2019, 04:09 AM
Last Post: kus
  Load .abf file and for analysis with Pandas finalcode 0 1,095 Nov-10-2018, 09:51 AM
Last Post: finalcode

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020