OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

12.4k

Stars

+470

Gained

3.9%

Growth

Python

Language

View on GitHub → ↑0.0% this week

🎭 Best For

Machine Learning and AI Engineer

🏷️ Topics & Ecosystem

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

📊 Activity

Latest commit: 2026-07-20. Over the past 253 days, this repository gained 470 stars (+3.9% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.