Bringing AI-powered answers and summaries to file previews on the web
Jul 11, 2024Binoy Dash

Summary
This post details the integration of AI-powered summarization and Q&A features into Dropbox's web file preview experience. It describes how the existing Riviera file conversion framework was extended to handle AI embeddings. The summarization plugin uses k-means clustering on text embeddings to identify key concepts and generate summaries, improving topic diversity and reducing LLM hallucinations compared to map-reduce approaches. The Q&A plugin uses embedding similarity to find relevant text chunks for answering user questions.
More from the Universal Content Processing Platform trail
- Evolving our calendar assistant Reclaim to be AI-native without starting over
- How our universal content processing platform Riviera evolved for AI and beyond
- How we used DSPy to turn AI evaluations into better responses in Dash chat
- How we optimized Dash's relevance judge with DSPy
- Using LLMs to amplify human labeling and improve Dash search relevance