Learning material for CMU10-714: Deep Learning System

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

TinySTL is a subset of STL(cut some containers and algorithms) and also a superset of STL(add some other containers and algorithms)

从入门到精通，该项目力求做到最清晰、最系统的中文Prompt指北

VideoSys: An easy and efficient system for video generation

Efficient Triton Kernels for LLM Training

PyQt5 implementation of YOLOv5 GUI

A curated list for Efficient Large Language Models

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

本项目旨在分享大模型相关技术原理以及实战经验。

🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

计算机自学指南

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

flash attention tutorial written in python, triton, cuda, cutlass

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

4 bits quantization of LLaMA using GPTQ

Development repository for the Triton language and compiler

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Universal LLM Deployment Engine with ML Compilation

Inference Llama 2 in one file of pure C

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

Mamba SSM architecture

Making large AI models cheaper, faster and more accessible

🎉 Modern CUDA Learn Notes with PyTorch: fp32, fp16, bf16, fp8/int8, flash_attn, sgemm, sgemv, warp/block reduce, dot, elementwise, softmax, layernorm, rmsnorm.

《Effective Modern C++》- 完成翻译