SGLang is a high-performance serving framework for large language models and multimodal models.

The open source coding agent.

A high-throughput and memory-efficient inference and serving engine for LLMs

Autonomous coding agent as an SDK, IDE extension, or CLI assistant.

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

MLX: An array framework for Apple silicon

Fast and memory-efficient exact attention

Development repository for the Triton language and compiler

Ongoing research training transformer models at scale

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.