Hugging Face

Run a vLLM Server on HF Jobs in One Command

Jun 26, 2026
Run a vLLM Server on HF Jobs in One Command
SummaryAI, from the source post

This post details how to run a vLLM server on Hugging Face Jobs with a single command, leveraging the `hf jobs run` CLI. It covers launching the server with specific GPU flavors, exposing ports, and querying the endpoint using cURL or the OpenAI Python client. It also provides guidance on scaling to larger models with tensor parallelism, setting up a Gradio UI for chat interactions, enabling SSH access for debugging, and using the endpoint as a backend for coding agents with Pi. The post contrasts HF Jobs with Inference Endpoints for different use cases.

More from the CI/CD Orchestration with Hugging Face Jobs trail