Generative AI for software engineers: How to build the right AI stack

This post outlines a layered architecture for generative AI in software engineering, emphasizing the need for a context platform to bridge the gap between coding assistants and broader engineering systems. It details how a context platform, exemplified by Glean, connects code, tickets, incidents, and documentation to provide engineers with grounded, permission-aware answers. The post also discusses the importance of observability AI and agent platforms within this stack, and evaluates AI tools based on their context awareness, trust mechanisms, data governance, and workflow integration. It highlights how this layered approach addresses common adoption challenges like downstream rework, trust issues, and safety concerns by providing a system of context around AI tools.