In my code I used something like file = open(path +'/'+filename, 'wb') to write the file but in my attempt to support non-ascii filenames, I encode it as such naming = path+'/'+filename file = open(naming.encode('utf-8', 'surrogateescape'), 'wb') write binary data...…
I have discovered that the reason I am getting weirdness with my strings being written to MySQL (5.6) from Kotlin is that, occasionally, they are being double encoded. I've verified this by printing the hex() of the column of two…
Here are the hex values of two strings stored in a MySQL database using two different methods. 20C3AFC2BBC2BFC3A0C2A4E280A2C3A0C2A4C2BEC3A0C2A4C5A1C3A0C2A4E2809A20C3A0C2A4C2B6C3A0C2A4E280A2C3A0C2A5C28DC3A0C2A4C2A8C3A0C2A5E280B9C3A0C2A4C2AEC3A0C2A5C28DC3A0C2A4C2AFC3A0C2A4C2A4C3A0C2A5C28DC3A0C2A4C2A4C3A0C2A5C281C3A0C2A4C2AEC3A0C2A5C28D20C3A0C2A5C2A420C3A0C2A4C2A8C3A0C2A5E280B9C3A0C2A4C2AAC3A0C2A4C2B9C3A0C2A4C2BFC3A0C2A4C2A8C3A0C2A4C2B8C3A0C2A5C28DC3A0C2A4C2A4C3A0C2A4C2BF20C3A0C2A4C2AEC3A0C2A4C2BEC3A0C2A4C2AEC3A0C2A5C28D20C3A0C2A5C2A5 and E0A495E0A4BEE0A49AE0A48220E0A4B6E0A495E0A58DE0A4A8E0A58BE0A4AEE0A58DE0A4AFE0A4A4E0A58DE0A4A4E0A581E0A4AEE0A58D20E0A5A420E0A4A8E0A58BE0A4AAE0A4B9E0A4BFE0A4A8E0A4B8E0A58DE0A4A4E0A4BF20E0A4AEE0A4BEE0A4AEE0A58D20E0A5A5 They represent the string काचं शक्नोम्यत्तुम् । नोपहिनस्ति माम् ॥. The former appears to be encoded badly, but works in…
I have problems with the output of icons within a text from a mysql database (InnoDB DEFAULT CHARSET=utf8) via php (online - PHP version 7.3.23). Text like this: Alles gut✅✅✅ In the phpMyadmin view (OFFLINE and ONLINE) they are displayed…
I'm querying the Facebook API in PHP to get a list of posts and display it on a website. // $facebook is an instance of FacebookFacebook $response = $facebook->get('posts?fields=id,message,created_time,full_picture,permalink_url,status_type&limit=20'); $graphEdge = $response->getGraphEdge(); $posts = []; foreach ($graphEdge as $post) {…
I use Python 3.9.1 and Linux (CentOS 7). I want to print unicode characters to the console. I want to do everything in UTF-8. If I open the python interactive console and write: print("├") all goes well and it prints:…
For User Agents and Image EXIF data, my system tries to convert any UTF-8 characters, using iconv(). However, sometimes I get the following error: PHP Warning [8]: iconv(): Detected an illegal character in input string For examples like these: iconv('UTF-8',…
Background: I am using PostgreSQL 11 on CentOS. I have a database having UTF-8 encoding, in specific tables I have some Latin characters as follows [ÄéÒçòý] Objective: I want to replace those with standard English characters for that I am…
Feeling a bit crazy here. I've got Apache set up with mod_wsgi, but I can't get the encoding to work properly. I have: tested that mod_wsgi is running in daemon mode read Graham Dumpleton's blog post about setting up the…
I've stumbled across a problem in PHP and it's proving much harder to solve than I would have expected. On the English version of my site, I have a plaintext-fragment: about-us which I can straightforwardly change into the capitalised text…