Harvey is building legal agents and workflows with OpenAI o1

This post details Harvey's evaluation and integration strategy for OpenAI's new o1 models. It highlights the use of objective benchmarks (BigLaw Bench) and expert preference evaluations to assess model performance. The key technical contribution is the focus on "step-change" review to identify novel functionalities in agentic capabilities like reasoning, planning, and collaboration. The post discusses how Harvey aligns these generalist model capabilities with domain-specific legal reasoning by supplementing foundation models with legal and process data, and outlines the development of collaborative agents that can iteratively solve complex, underspecified problems like drafting an S-1.