vLLM
Serve language models with a high-throughput inference engine and OpenAI-compatible API.
What’s included for free?
Ongoing free, open-source software. Hosting, hardware, model downloads, storage or third-party services may cost extra.
Where it runs: Self-hosted
Provider information ↗Checked 2026-10-26
Before you use it
Apache-2.0 software; model licences and accelerator dependencies apply separately.
Provider terms can change. Check current pricing and usage rights before starting a project.