Introducing Baseten Hosted Tools

Introduces Baseten Hosted Tools, an ecosystem for integrating external capabilities (like web search) into models and agents running on Baseten. Specifically details 'Baseten Grounded Inference' for web search, enabling models to access real-time web data. Highlights server-side tool execution to reduce latency and round trips, with live SSEs for observability. Demonstrates a curl example for enabling web search via a configuration change in Messages, Chat Completions, or Responses requests. Mentions integration with partner search providers (Exa, Keenable, Parallel, You.com) and future plans for code execution and browser automation. Benchmarks show a 15% decrease in end-to-end latency with server-side tool execution.