How to run any open model inside DeepSeek Harness
Aug 25, 2026
Summary
This post details how to integrate the DeepSeek Harness with Baseten's inference APIs. It describes configuring Baseten as a custom model provider within the DeepSeek Harness, specifying the base URL and API protocol. It also highlights how the harness fetches and displays supported models from Baseten's `/v1/models` endpoint and demonstrates inspecting per-request latency and throughput signals like time-to-first-token and cache hit rate.
More from the Baseten AI Model Deployment and Serving Platform trail
- LangChain trains custom models for LangSmith Engine with Baseten Loops
- DeepSeek-V4.1-Flash: more efficient prefill for coding agents
- Blaxel is joining Baseten to build the future of agentic infrastructure
- How Baseten makes pyannote’s diarization models 9.6x faster
- Optimizing delta weight syncs for managed rollouts