Atlassian Rovo Dev Research: What Types of Code Review Comments Do Developers Most Frequently Resolve?

This post details research on code review comment types and their resolution rates, comparing human reviewers with the Rovo Dev AI agent. It introduces a classification system for comments (readability, bug, maintainability, design, no issue) and uses GPT-4 for classification with expert validation. The research found Rovo Dev generates more bug and maintainability comments, while humans focus more on readability and design. Crucially, developers resolve readability, bug, and maintainability comments at higher rates (36-43%) than design comments. This research informs Rovo Dev's focus on actionable, resolvable comments to improve code review efficiency and quality.