Names in translation and social language modeling

What this post added

This post details the technical implementation of Facebook's community-driven translation application, focusing on handling "Named Entities" within phrases. It introduces "Glossary" for consistent vocabulary, "Dynamic Explosion" to manage language-specific variations based on token values (e.g., gender, number), and "Linguistic Rules" for orthographic and phonological adjustments. The post also discusses the development of over 250 million individual language models to capture user dialects and their applications in spam detection and speech recognition, and mentions dialectometrical methods on the social graph.