Your coding harness shouldn't be a black box

This post introduces NCode, an open-source AI model harness developed by Noumena. It highlights the 'black-box' problem of proprietary harnesses and the benefits of an inspectable and modifiable infrastructure layer. NCode allows users to bring their own models (open-weight or proprietary), fine-tune them, and integrate them with tools for code editing and execution. The post emphasizes the importance of vertically integrating the model with the harness for productivity and reliability, showcasing how NCode was used internally for six months on millions of lines of code and dozens of services. It also details NCode's flexibility in model integration (e.g., OpenAI API, OpenAI-compatible endpoints, self-hosted models) and its tiered intelligence structure based on real-world usage. The post concludes by linking NCode integration with Lambda's GPU serving capabilities for open-weight models.