Rebuilding Harvey's Review Algorithm | Harvey

This post details the rebuilding of Harvey's review algorithm for review tables. Key changes include: 1) Reconciling the 'summary' and 'additional context' fields into a single 'answer' field, and introducing a 'reasoning' field to explain the model's interpretation and conclusion. 2) Rethinking the citation methodology to move from cell-level to sentence-level citations for greater granularity and verifiability. 3) Illuminating model reasoning by providing the analytical picture behind the answer. The post also outlines the evaluation process, which involved ALRs generating datasets to measure quality (via preference testing) and latency, and reports a four-fold increase in user preference for the new algorithm, particularly on complex document types.