Python .json problem with UTF-8 file

Python .json problem with UTF-8 file - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: General Coding Help (https://python-forum.io/forum-8.html)
+--- Thread: Python .json problem with UTF-8 file (/thread-1338.html)

Python .json problem with UTF-8 file - PickyBiker - Dec-25-2016

When my program tries to deserialize a .json file, it chokes on the UTF-8 designation (EF BB BF) at the beginning of the .json file.
The error is: "No JSON object could be decoded"

Is there a way to ignore those three characters while reading .json files short of doing a binary read to strip them out?

RE: Python .json problem with UTF-8 file - snippsat - Dec-25-2016

Is the json file valid JSON Formatter.

RE: Python .json problem with UTF-8 file - PickyBiker - Dec-26-2016

Yes it is. When you copy the text and put it tn the verifier the special characters do not show up. They are all unprintable and you can't copy them wit a text editor. It is only when you open the json with a hex editor that you can see them. Strip them out and json deserializes the file just fine.

RE: Python .json problem with UTF-8 file - wavic - Dec-26-2016

Are you using python 2.7? Python 3 handles utf-8 naturally but for python 2.7 you have to put #-*- coding: utf-8 -*- under the shebang

#!/usr/bin/env python
# -*- coding: utf-8 -*-
    .....code here.....

RE: Python .json problem with UTF-8 file - snippsat - Dec-26-2016

The file is saved with UTF-8 Byte Order Mark (BOM).
You can try with utf-8-sig

import json
import codecs

json.load(codecs.open('sample.json', 'r', 'utf-8-sig'))

RE: Python .json problem with UTF-8 file - PickyBiker - Dec-28-2016

This one was actually resolved by the person who created the json file. He removed the UTF-8 BOM at the front of the file. However, the solutions above have been noted for the future. Thank you !