Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
UnicodeDecodeError:
#15
(May-16-2018, 01:46 PM)garikhgh0 Wrote: If I found such errors in my file, how to handle them?
What are using and how do you read file?

\xa0 is non-breaking space in Latin1 (ISO 8859-1).
To read it with utf-8 you can just ignore error as posted before.
>>> s = b'"2016-02-01","Htech 6605 Wired\xa0 selfie HV-BTM 11","Accessories","Dalma RSC","1","Sales"\r\n'
>>> print(s)
b'"2016-02-01","Htech 6605 Wired\xa0 selfie HV-BTM 11","Accessories","Dalma RSC","1","Sales"\r\n'
>>> type(s)
<class 'bytes'>
>>> print(s.decode('utf-8', errors='ignore'))
"2016-02-01","Htech 6605 Wired selfie HV-BTM 11","Accessories","Dalma RSC","1","Sales"

>>> # latin-1 will work
>>> print(s.decode('latin-1'))
"2016-02-01","Htech 6605 Wired  selfie HV-BTM 11","Accessories","Dalma RSC","1","Sales"
Can do replace then decode utf-8.
>>> s = b'"2016-02-01","Htech 6605 Wired\xa0 selfie HV-BTM 11","Accessories","Dalma RSC","1","Sales"\r\n'
>>> new_string = s.replace(b'\xa0', b'')
>>> print(new_string.decode('utf-8'))
"2016-02-01","Htech 6605 Wired selfie HV-BTM 11","Accessories","Dalma RSC","1","Sales"
Reply


Messages In This Thread
UnicodeDecodeError: - by garikhgh0 - Apr-10-2018, 07:05 AM
RE: UnicodeDecodeError: - by Gribouillis - Apr-10-2018, 08:16 AM
RE: UnicodeDecodeError: - by garikhgh0 - Apr-10-2018, 09:47 AM
RE: UnicodeDecodeError: - by Gribouillis - Apr-10-2018, 10:00 AM
RE: UnicodeDecodeError: - by garikhgh0 - Apr-10-2018, 10:32 AM
RE: UnicodeDecodeError: - by Gribouillis - Apr-10-2018, 11:40 AM
RE: UnicodeDecodeError: - by garikhgh0 - Apr-10-2018, 12:01 PM
RE: UnicodeDecodeError: - by Gribouillis - Apr-10-2018, 12:22 PM
RE: UnicodeDecodeError: - by snippsat - Apr-10-2018, 12:40 PM
RE: UnicodeDecodeError: - by garikhgh0 - Apr-10-2018, 01:02 PM
RE: UnicodeDecodeError: - by Gribouillis - Apr-10-2018, 01:32 PM
RE: UnicodeDecodeError: - by snippsat - Apr-10-2018, 01:51 PM
RE: UnicodeDecodeError: - by garikhgh0 - Apr-10-2018, 01:54 PM
RE: UnicodeDecodeError: - by garikhgh0 - May-16-2018, 01:46 PM
RE: UnicodeDecodeError: - by snippsat - May-16-2018, 03:09 PM
RE: UnicodeDecodeError: - by PythonGuy888 - May-31-2018, 03:35 PM
RE: UnicodeDecodeError: - by PythonGuy888 - May-31-2018, 05:09 PM
RE: UnicodeDecodeError: - by garikhgh0 - Jun-04-2018, 05:41 AM
RE: UnicodeDecodeError: - by volcano63 - Jun-04-2018, 08:41 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  UnicodeDecodeError while installing polyglot draems 2 8,366 Feb-10-2017, 07:43 PM
Last Post: draems

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020