OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

12.6k

Stars

+631

Gained

5.3%

Growth

Python

Language

View on GitHub → ↑0.0% this week

🎭 Best For

Machine Learning and AI Engineer

🏷️ Topics & Ecosystem

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

📊 Activity

Latest commit: 2026-10-12. Over the past 342 days, this repository gained 631 stars (+5.3% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.