Python Forum
utf-8 decoding failed every time i try
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
utf-8 decoding failed every time i try
#11
(Aug-23-2019, 11:54 PM)adnanahsan Wrote: but on terminal some thing is wrong. strange issue i am facing bro :(
for example
i see this " Bebês " in terminal instead of " Bebês "
This is a typical error that can come if run Python 2,are you sure you running python 3 on server?
# Python 3.7
>>> s = 'Bebês'
>>> print(s)
Bebês

# Python 2.7,the error you get
>>> s = 'Bebês'
>>> print(s)
Bebês

# Python 2.7 fix
>>> s = u'Bebês'
>>> print(s)
Bebês
Put in sys.executable in script so see what python version you run.
import sys

print(sys.executable)

s = u'Bebês'
print(s)
Reply
#12
ok see here http://prntscr.com/ox21gf
when i simply entered s = 'Bebês' and press enter key, see in the image what i got, this is the issue ..
i tried s = u'Bebês' too, same error.
python version is 3.6

And on python 2 its showing like this
>>> s = u'Bebês'
>>> print(s)
Bebês
i tried this on 2 servers, same issue on both server .. working fine on my windows pc though, and also on my ubuntu installed on vmware on my windows pc.. but problem is only on servers




(Aug-24-2019, 01:30 PM)snippsat Wrote:
(Aug-23-2019, 11:54 PM)adnanahsan Wrote: but on terminal some thing is wrong. strange issue i am facing bro :(
for example
i see this " Bebês " in terminal instead of " Bebês "
This is a typical error that can come if run Python 2,are you sure you running python 3 on server?
# Python 3.7
>>> s = 'Bebês'
>>> print(s)
Bebês

# Python 2.7,the error you get
>>> s = 'Bebês'
>>> print(s)
Bebês

# Python 2.7 fix
>>> s = u'Bebês'
>>> print(s)
Bebês
Put in sys.executable in script so see what python version you run.
import sys

print(sys.executable)

s = u'Bebês'
print(s)
Reply
#13
Hello everyone,

i am facing a strange issue for last several days, no one could solve this problem so far for me..
i am sharing the problem in a simple words here

Whenever i enter this line or similar in my server python3.6 and 3.7 versions. i got unicodedecodeerror.

>>> s = 'Bebês'
exactly after this line i get error. http://prntscr.com/ox21gf
this is causing the problem i am unable to match / query such unicode strings in mysql too

btw this is all working perfectly on my Windows PC .. and a ubuntu linux i installed on VMWare on my Windows PC .
But on my servers, i am facing the above problem .. i am waiting for your replies guyz, Kindly help me out.
Python version i am using is 3.6 and 3.7

Thanks
Reply
#14
Hi!

Have you tried using the unicode number inside the string as here in my s2 variable?:
s1 = 'Bebês'
s2 = "Beb\u00EAs"
s3 = '\u00EA'
print(s1, s2, s3)
that produces the following output (on my Windows PC, so I'm not sure if it will work on your servers):
Output:
Bebês Bebês ê
All the best,
newbieAuggie2019

"That's been one of my mantras - focus and simplicity. Simple can be harder than complex: You have to work hard to get your thinking clean to make it simple. But it's worth it in the end because once you get there, you can move mountains."
Steve Jobs
Reply
#15
what is the system locale?
(Aug-26-2019, 11:55 PM)adnanahsan Wrote: i am facing a strange issue for last several days,
Also - did it work before that, i.e. any recollections what have you done/ change "several days" ago?
If you can't explain it to a six year old, you don't understand it yourself, Albert Einstein
How to Ask Questions The Smart Way: link and another link
Create MCV example
Debug small programs

Reply
#16
You should at least make a link to your previous Thread.
(Aug-27-2019, 08:44 AM)buran Wrote: what is the system locale?
I have already ask about this in previous Thread.
Reply
#17
(Aug-27-2019, 10:03 AM)snippsat Wrote: I have already ask about this in previous Thread.
I was away for few days and still catching-up with the old threads. I think we need to lock this thread or even soft-delete it. I merge it into the first one
If you can't explain it to a six year old, you don't understand it yourself, Albert Einstein
How to Ask Questions The Smart Way: link and another link
Create MCV example
Debug small programs

Reply
#18
Locale is utf-8. Or en_us utf-8
I m just trying to have someone who can identify the issue
Reply
#19
I am fairly sure your terminal encoding is latin-1 not utf-8
Can you provide a screenshot for the output of $ locale on your server terminal?
If you can't explain it to a six year old, you don't understand it yourself, Albert Einstein
How to Ask Questions The Smart Way: link and another link
Create MCV example
Debug small programs

Reply
#20
http://prntscr.com/oy8j83 see this, can you tell me how can i solve this issue
(Aug-27-2019, 11:44 AM)buran Wrote: I am fairly sure your terminal encoding is latin-1 not utf-8
Can you provide a screenshot for the output of $ locale on your server terminal?
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Decoding lat/long in file name johnmcd 4 270 Mar-22-2024, 11:51 AM
Last Post: johnmcd
  Enigma Decoding Problem krisarmstrong 4 631 Dec-14-2023, 10:42 AM
Last Post: Larz60+
  json decoding error deneme2 10 3,395 Mar-22-2023, 10:44 PM
Last Post: deanhystad
  flask app decoding problem mesbah 0 2,310 Aug-01-2021, 08:32 PM
Last Post: mesbah
  Decoding a serial stream AKGentile1963 7 8,339 Mar-20-2021, 08:07 PM
Last Post: deanhystad
  xml decoding failure(bs4) roughstroke 1 2,211 May-09-2020, 04:37 PM
Last Post: snippsat
  python3 decoding problem but python2 OK mesbah 0 1,767 Nov-30-2019, 04:42 PM
Last Post: mesbah
  hex decoding in Python 3 rdirksen 2 4,541 May-12-2019, 11:49 AM
Last Post: rdirksen
  Decoding log files in binary using an XML file. captainfantastic 1 2,375 Apr-04-2019, 02:24 AM
Last Post: captainfantastic
  decoding sub.process output with multiple \n? searching1 2 2,745 Feb-24-2019, 12:00 AM
Last Post: searching1

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020