Hugging Face Models on Foundry Managed Compute

Hugging Face models are now integrated into Microsoft Foundry's Managed Compute platform, offering a curated catalog of open-weight models deployable with enterprise-grade security, governance, and observability. This integration streamlines the process of discovering, deploying, and operating open-source AI models within the Foundry ecosystem, leveraging managed GPU infrastructure and a variety of optimized inference runtimes like vLLM, SGLang, TensorRT-LLM, NIM, TEI, and llama.cpp. The platform provides a unified endpoint, SDKs, authentication, observability, and billing for all models, including open-source ones, enabling seamless integration with Foundry Agents. Managed Compute offers global and data zone deployments, with quota aligned to accelerator families for future hardware generations. The curation pipeline ensures models are security-screened, use SafeTensors format, and are deployed with appropriate runtimes. Weights are pre-staged in Azure storage, and runtime images are managed by Microsoft, allowing for deployments within private networks without outbound access to Hugging Face Hub.