i think i need to use my own UTF-8 decoder code

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Thread Modes

i think i need to use my own UTF-8 decoder code

Gribouillis

Super Moderators

Posts: 4,564

Threads: 71

Joined: Jan 2018

Reputation: 341

Aug-31-2021, 08:55 AM

Skaperen Wrote:so i am wondering what tokenize.tokenize() put in there that is non-ASCII enough to get up to Unicodes that are multi-byte UTF-8.

I think I would first investigate this point thoroughly to determine exactly what happened. This is a case where the error can be fully exposed and understood, why not do this?

Find

Messages In This Thread

i think i need to use my own UTF-8 decoder code - by Skaperen - Aug-28-2021, 01:34 AM

RE: i think i need to use my own UTF-8 decoder code - by Gribouillis - Aug-31-2021, 08:55 AM

RE: i think i need to use my own UTF-8 decoder code - by Skaperen - Sep-02-2021, 06:03 AM

Users browsing this thread: 1 Guest(s)

View a Printable Version

i think i need to use my own UTF-8 decoder code

User Panel Messages

Announcements