Transformer related optimization, including BERT, GPT
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a fast serving framework for large language models and vision language models.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
A framework for few-shot evaluation of autoregressive language models.
New blog site using hexo.
Development repository for the Triton language and compiler
PArallel Distributed Deep LEarning （PaddlePaddle核心框架，高性能单机、分布式训练和跨平台部署）
PyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT
