inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
🎭 Best For
🏷️ Topics & Ecosystem
artificial-intelligence
deployment
diffusers
gemma
glm
glm-5-3
inference
kimi
kimi-k3
llama-cpp
llamacpp
llm
machine-learning
openai-api
pytorch
qwen
sglang
transformers
vllm
whisper
📊 Activity
Latest commit: 2026-10-08. Over the past 49 days, this repository gained 100 stars (+1.1% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.