FAIR turns five: What we’ve accomplished and where we’re headed

What this post added

This post details FAIR's five-year anniversary and highlights key technical accomplishments. It introduces memory networks for improved long-term memory in neural networks, discusses the advancement and application of self-supervised learning (SSL) and generative adversarial networks (GANs) including the development of Wasserstein GAN (WGAN) for more stable training, and presents fastText for rapid and scalable text classification that handles subword units and supports numerous languages. The post also mentions contributions to cutting-edge translation research.