UTF-8 breaks on Ubuntu (minimal install) server applications

Posted on August 8, 2017 by Sreekumar Kj

Problem : UTF-8 content is displayed and treated as garbage (eg: DL4J vector search misses all the time)

Reason: User’s default encoding not set to UTF-8.

Fix: Set default encoding to UTF-8

Edit ~/.profile to include this –

export LC_CTYPE=en_US.UTF-8

Save, logout of SSH, login back and restart applications.

Sreekumar Kj

Sreekumar (KJ) has been a hobby programmer from school days. Codemarvels is his personal blog from the year 2010, where he writes about technology, philosophy, society and a bit about physics.

He now runs a conversational AI company – DheeYantra – focusing his efforts to help businesses improve operational efficiency using digital employees powered by AI.

diamonds with question marks, dl4j, utf8, utf8 displayed as garbage, w2v not working on server

Sreekumar Kj

Sreekumar (KJ) has been a hobby programmer from school days. Codemarvels is his personal blog from the year 2010, where he writes about technology, philosophy, society and a bit about physics. He now runs a conversational AI company - DheeYantra - focusing his efforts to help businesses improve operational efficiency using digital employees powered by AI. View all posts by Sreekumar Kj →