Bottom Page

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
 Why does Python/gpx save data as Latin1?
#1
Hello,

For some reason, the input data that are in UTF8 in SQLite end up as Latin1 in the output file:

import gpxpy.gpx
import sqlite3

gpx = gpxpy.gpx.GPX()
con = sqlite3.connect('input.sqlite')

con.row_factory = sqlite3.Row
cur = con.cursor()
cur.execute("SELECT name,latitude,longitude FROM table1");
results = cur.fetchall()
for row in results:
	w1 = gpxpy.gpx.GPXWaypoint(row["latitude"],row["longitude"])
	w1.name = row["name"]
	gpx.waypoints.append(w1)
	print("Waypoint: ",w1.name)

with open("map.gpx", "w") as f:
    f.write( gpx.to_xml())
I'm pretty sure data in SQLIte are in UTF8 because a run of ".output test.csv ; SELECT …" shows data in UTF8, so it looks like the issue lies in the code above.

Am I missing a switch somewhere?

Thank you.
Quote
#2
From Python built-in help (>>> help('open')):

Quote:open(file, mode='r', buffering=-1, encoding=None, errors=None, newline=None, closefd=True, opene
r=None)

/.../

encoding is the name of the encoding used to decode or encode the
file. This should only be used in text mode. The default encoding is
platform dependent, but any encoding supported by Python can be
passed.

One can check (and set) default encoding in locale:

import locale
locale.getlocale()
However, more robust is to specify encoding while writing into file:

with open("map.gpx", "w", encoding='UTF-8') as f:
I'm not 'in'-sane. Indeed, I am so far 'out' of sane that you appear a tiny blip on the distant coast of sanity. Bucky Katt, Get Fuzzy

Da Bishop: There's a dead bishop on the landing. I don't know who keeps bringing them in here. ....but society is to blame.
Quote
#3
You nailed it. Thank you very much.
Quote

Top Page

Possibly Related Threads...
Thread Author Replies Views Last Post
  save data in .txt after certain interval Shaswat 1 159 Oct-13-2019, 07:07 AM
Last Post: Gribouillis
  Looking to Save Data Corwin 3 530 Oct-27-2018, 08:40 AM
Last Post: Corwin
  How to save data into next columns Prince_Bhatia 3 567 Oct-15-2018, 08:20 AM
Last Post: wavic
  Read data and save in excel parthi1705 0 639 Apr-09-2018, 09:37 AM
Last Post: parthi1705
  cant save data to text file. darktitan 28 4,438 Oct-29-2017, 06:31 AM
Last Post: darktitan
  QSqlRelationalTableModel: how do I save combobox data? panoss 2 2,885 Feb-08-2017, 08:13 PM
Last Post: Larz60+

Forum Jump:


Users browsing this thread: 1 Guest(s)