Question Decomposition Improves the Faithfulness of Model-Generated Reasoning

This post introduces question decomposition as a method to improve the faithfulness of model-generated reasoning. By breaking down complex questions into simpler subquestions and answering them in separate contexts, the model's stated reasoning more accurately reflects its actual reasoning process, while still achieving performance gains comparable to Chain-of-Thought (CoT).