Upload takes too long.

[BrendanD]

Here is my example of just reading the csv into values and parsing the date. I have added code that will abort if it tries to read more than one line from a csv. Note that your code reads each line of the csv and tries to upload each line to WOW without any pauses, because your requests call is inside the loop reading your csv file.

import csv
import datetime

with open('test.csv', 'r') as csv_file:
    csv_reader = csv.reader(csv_file)
    total_rows = 0
    for row in csv_reader:
        total_rows +=1
        assert total_rows == 1
        year = row[1]
        day_of_year = row[2]
        hhmm = row[3]
        hh = hhmm[:2]
        mm = hhmm[2:]
        winddir = row[12]
        windspeedmph = row[17]
        windgustmph = row[19]
        windgustdir = row[16]
        humidity = row[8]
        dewptf = row[7]
        tempf = row[5]
        rainin = row[27]
        dailyrainin = row[25]
        baromin = row[10]
        solarradiation = row[23]
        l = row[16]
softwaretype=1
year = int(year)
day_of_year = int(day_of_year) - 1
hour = int(hhmm[:2])
minute = int(hhmm[2:])
first_day_of_year = datetime.date(year, 1, 1)
dateutc = first_day_of_year + datetime.timedelta(days=day_of_year)
dateutc = datetime.datetime.combine(dateutc, datetime.time(hour, minute))
dateutc_string = f'&dateutc={dateutc:%Y-%m-%d+%H:%M:%S}'
dateutc_string = dateutc_string.replace(':', '%3a')

Finally, it does not make sense to have a python script running continuously for a scheduled task. If you are on windows you should set up a scheduled task that runs your python code every five minutes. On linux you would have to use crontab or one of its more modern variants. Personally, as someone who works regularly with ocean and met data, five minutes is overkill. If you change your AWS output frequency to 10 minutes and your upload frequency to ten minutes, you will never be rejected by WOW. You trade frequency for reliability. Also, if you are clever, you can catch when the WOW upload fails, wait five minutes and try the same upload string again. You get two chances over ten minutes to upload. If you choose 15 minutes, you could have three upload attempts.

Finally (I am full of hot air...), I would suggest using pywws instead of a home-baked solution.