Add column headers to dataframe

[chisox721]

Hey guys-I'm working on a script that grabs weather information from different locations. The only thing I'm missing within the dataframe is replacing "0_x" and "0_y" (below) with a reference to the location.

Ref 0_x 0_y
0 temp 83 71
1 humid 19% 45%
2 pressure 29 29
3 dew 37 49
4 wind_dir 157 227
5 wind_mph 6.5 1.2
6 wind_gust 9.8 3.7

Within the csv file that holds the location info, there is a 3rd column with specific location names. All I need to add is a line in the script that references the 3rd column and inserts it as a column header. Hopefully this all makes sense. Any help would be greatly appreciated.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33

import requests import csv import pandas as pd   stadiums = pd.read_csv('ParkLocations1.csv') stadiums.to_dict('series')   all_loc_data = pd.DataFrame() col_1 = ['temp','humid','pressure','dew','wind_dir','wind_mph','wind_gust'] all_loc_data.insert(loc=0, column='Ref', value=col_1)   url_template = "http://api.wunderground.com/api/88fb15b49e765a43/conditions/q/{state}/{city}.json"   for state,city in zip(stadiums.loc[ : ,"State"],stadiums.loc[ : ,"City"]):     url = requests.get(url_template.format(state=state,city=city))     parsed = url.json()       temp = parsed['current_observation']['temp_f']     humid = parsed['current_observation']['relative_humidity']     pressure = parsed['current_observation']['pressure_in']     dew = parsed['current_observation']['dewpoint_f']     wind_dir = parsed['current_observation']['wind_degrees']     wind_mph = parsed['current_observation']['wind_mph']     wind_gust = parsed['current_observation']['wind_gust_mph']       data_list = [temp,humid,pressure,dew,wind_dir,wind_mph,wind_gust]     loc_data = pd.DataFrame(data_list)     loc_data.insert(loc=0, column='Ref', value=col_1)           all_loc_data = all_loc_data.merge(loc_data, on='Ref',how='outer')         all_loc_data.to_csv('WUEx.csv')

[volcano63]

Without examples of state/city pairs (as int your file) not much I can do, but you really have to learn to work with DataFrame.apply. This is extremely inefficient use of pandas

[chisox721]

Without examples of state/city pairs (as int your file) not much I can do, but you really have to learn to work with DataFrame.apply. This is extremely inefficient use of pandas

Here is a sample of what the parklocations1.csv looks like:

Team State City
SFG CA San Francisco
NYY NY Bronx

[volcano63]

OK, here is a simple example how to use apply in your code

1 2 3 4 5 6 7 8 9 10 11

url_template = "http://api.wunderground.com/api/88fb15b49e765a43/conditions/q/{state}/{city}.json" def get_weather(row, *fileds):     url = requests.get(url_template.format(state=row['State'],city=row['City']))     observation = url.json()['current_observation']           return [observation[field] for field in fields]   fields = ['temp_f', 'relative_humidity'] stadiums = pd.DataFrame([['SFG', 'CA', 'San Francisco'], ['NYY', 'NY', 'Bronx']],                         columns=['Team', 'State', 'City']) print(stadiums.apply(lambda r: get_weather(r, *fields), axis=1).values)

And the result is

Output:
[list([54.7, '82%']) list([63.0, '83%'])]

now,

1	stadium[fields] = pd.DataFrame(<result>)

will update your stadiums DataFrame with new fields - but you have to convert the result to a form accepted by pandas.DataFrame constructor. I will let you experiment with that on your own.

PS pandas is an amazing tool which I just started learning myself - but you have to understand, DataFrame and Series are objects intended for processing as a whole - otherwise, you abuse pandas. Learn it properly

[chisox721]

PS pandas is an amazing tool which I just started learning myself - but you have to understand, DataFrame and Series are objects intended for processing as a whole - otherwise, you abuse pandas. Learn it properly

Thank you for the response and advice. I knew I was taking a round-a-bout approach but wasn't really sure how to improve on it. Your input made things a lot clearer for me.

[volcano63]

PS I just took a second look - I don't know why I did not suggest

1 2 3

url_template = http://api.wunderground.com/api/88fb15b49e765a43/conditions/q/{State}/{City}.json" ....     url = requests.get(url_template.format(**row))