Integrating autoconversion: Facebook’s path from Zawgyi to Unicode

This post details the technical implementation of font converters for Facebook and Messenger to handle the transition from Zawgyi to Unicode encoding in Myanmar. It explains the challenges of content encoding detection (using an ML model trained on Facebook content), device encoding detection (by measuring string width on-device), and the conversion process itself. The post highlights the integration of Google's open-source myanmar-tools library and the challenges of applying this at Facebook's scale across various content types and delivery mechanisms.