30.8% Faster PRs: How AI-Driven Rovo Dev Code Reviewer Improved the Developer Productivity at Atlassian - Inside Atlassian

What this post added

Details the architecture and implementation of Rovo Dev Code Reviewer, an AI-driven code review agent. It describes the zero-shot structured prompting approach, including persona definition, chain-of-thought, and review guidelines. It also explains the two-stage quality check mechanism: an LLM-as-a-Judge for factual correctness and a ModernBERT-based classifier for comment actionability, trained on a proprietary dataset. The post quantifies the impact through a large-scale online evaluation, reporting metrics on PR cycle time reduction, human comment reduction, and code resolution rates.