One framework. Mobile & desktop.

A self-paced course to learn Rust, one exercise at a time.

LLM inference in C/C++

Booster - open platform for serving LLM models

Pluggable RTP/RTCP processors for building real time communication

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit flo...