Run a vLLM Server on HF Jobs in One Command
Jun 26, 2026
Summary
This post details how to run a vLLM server on Hugging Face Jobs with a single command, leveraging the `hf jobs run` CLI. It covers launching the server with specific GPU flavors, exposing ports, and querying the endpoint using cURL or the OpenAI Python client. It also provides guidance on scaling to larger models with tensor parallelism, setting up a Gradio UI for chat interactions, enabling SSH access for debugging, and using the endpoint as a backend for coding agents with Pi. The post contrasts HF Jobs with Inference Endpoints for different use cases.