New observability features: activity logging, LLM metrics, and metrics dashboard customization
Dec 20, 2024

Summary
This post introduces three new observability features: activity logging for timestamped changes to workspace and models, request-level LLM metrics (request size, response size, time to first byte) to aid in debugging latency spikes, and customizable metrics dashboards for unified views, reordering, and direct log access from metric plots. These features aim to improve monitoring, debugging, and optimization of production AI workloads.
More from the Baseten AI Model Deployment and Serving Platform trail
- LangChain trains custom models for LangSmith Engine with Baseten Loops
- DeepSeek-V4.1-Flash: more efficient prefill for coding agents
- Blaxel is joining Baseten to build the future of agentic infrastructure
- How Baseten makes pyannote’s diarization models 9.6x faster
- Optimizing delta weight syncs for managed rollouts