News Feed
Sections




News Archive
Looking for more information on how to do PHP the right way? Check out PHP: The Right Way

Ahmed Shreef's Blog:
iconv misunderstands UTF-16 strings with no BOM
August 27, 2010 @ 13:36:56

Ahmed Shreef has a recent post to his blog about an issue he had converting UTF-16 strings over to UTF-8 with the iconv functionality in PHP. Specifically, he ended up with "rubbish unreadable characters" after the conversion.

I had a problem last week with converting UTF-16 encoded strings to UTF-8 using PHP's iconv library on a Linux server. my code worked fine on my machine but the same code resulted in a rubbish unreadable characters on our production server.

In his example (a basic "Hello World" in Arabic) he notes that there's no byte order mark on the string and, because of this, the iconv feature tries to guess if it's big-endian or little-endian. This guessing varies from machine to machine resulting in the inconsistencies he saw. The solution is to define the "to" and "from" for the conversion manually rather than letting it just guess.

0 comments voice your opinion now!
byteordermark bom iconv utf16 utf8 convert


blog comments powered by Disqus

Similar Posts

Nikita Popov's Blog: htmlspecialchars() improvements in PHP 5.4

Nessa's Blog: Convert Database to UTF-8

Kevin van Zonneveld's Blog: Convert anything to Tree Structures in PHP

Aaron Wormus' Blog: Migrating to Unicode

Perplexed Labs: Convert HTML to PDF in PHP (libwkhtmltox extension)


Community Events





Don't see your event here?
Let us know!


api series development release framework zendserver community threedevsandamaybe laravel podcast introduction interview conference tips language bugfix code list deployment symfony

All content copyright, 2014 PHPDeveloper.org :: info@phpdeveloper.org - Powered by the Solar PHP Framework