Clio: Privacy-preserving insights into real-world AI use

Introduced Clio, an automated analysis tool for privacy-preserving insights into real-world AI model usage. Clio extracts conversation facets, performs semantic clustering, generates cluster descriptions, and builds hierarchies, all powered by Claude. It employs multi-stage privacy protections including anonymization, aggregation, minimum user thresholds, and Claude-based verification of summaries. Clio has been used to analyze 1 million conversations, revealing emphasis on coding and educational tasks, and has helped identify coordinated misuse, novel risks, and refine Trust and Safety classifiers by addressing false positives and negatives.