News Feed
Sections




News Archive
Looking for more information on how to do PHP the right way? Check out PHP: The Right Way

Ahmed Shreef's Blog:
iconv misunderstands UTF-16 strings with no BOM
August 27, 2010 @ 13:36:56

Ahmed Shreef has a recent post to his blog about an issue he had converting UTF-16 strings over to UTF-8 with the iconv functionality in PHP. Specifically, he ended up with "rubbish unreadable characters" after the conversion.

I had a problem last week with converting UTF-16 encoded strings to UTF-8 using PHP's iconv library on a Linux server. my code worked fine on my machine but the same code resulted in a rubbish unreadable characters on our production server.

In his example (a basic "Hello World" in Arabic) he notes that there's no byte order mark on the string and, because of this, the iconv feature tries to guess if it's big-endian or little-endian. This guessing varies from machine to machine resulting in the inconsistencies he saw. The solution is to define the "to" and "from" for the conversion manually rather than letting it just guess.

0 comments voice your opinion now!
byteordermark bom iconv utf16 utf8 convert


blog comments powered by Disqus

Similar Posts

Danne Lundqvist's Blog: Detecting UTF BOM - byte order mark

Nessa's Blog: Convert Database to UTF-8

Ahmed Shreef's Blog: iconv misunderstands UTF-16 strings with no BOM

Edd Mann: Reversing a Unicode String in PHP using UTF-16BE/LE

PHPBuilder.com: Securing Data Sent Via GET Requests


Community Events





Don't see your event here?
Let us know!


library podcast security opinion series version symfony laravel package community update composer framework interview voicesoftheelephpant tool application introduction release language

All content copyright, 2014 PHPDeveloper.org :: info@phpdeveloper.org - Powered by the Solar PHP Framework