cube-studio

sglang 是用 Python 编写的 AI 工具，用于大模型与智能体应用开发，主打高性能。

SGLang is a high-performance serving framework for large language models and multimodal models.

DeepSpeed 是用 Python 编写的学习资料，用于系统学习与查阅，主打易用、可伸缩。

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

vllm 是用 Python 编写的 AI 工具，用于大模型与智能体应用开发。

A high-throughput and memory-efficient inference and serving engine for LLMs

主流预训练模型库，NLP、视觉、多模态模型开箱即用，是 Hugging Face 生态的核心。

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both…

ColossalAI 是用 Python 编写的 AI 工具，用于人工智能方向的建模与推理，主打速度快。

Making large AI models cheaper, faster and more accessible

gradio 是用 Python 编写的学习资料，用于系统学习与查阅，主打界面美观。

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!