LLM inference in C/C++

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

🔥 Linux下C++轻量级WebServer服务器

Development repository for the Triton language and compiler

A C++ header-only HTTP/HTTPS server and client library

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

机器人视觉 移动机器人 VS-SLAM ORB-SLAM2 深度学习目标检测 yolov3 行为检测 opencv PCL 机器学习 无人驾驶

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Transformer related optimization, including BERT, GPT

CUDA Templates for Linear Algebra Subroutines

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

TinySTL is a subset of STL(cut some containers and algorithms) and also a superset of STL(add some other containers and algorithms)

MLIR For Beginners tutorial

🚧《C++并发编程实战》的读书笔记，供以后工作中查阅。

Hands-On Practical MLIR Tutorial

KnowledgeDistillation Layer (Caffe implementation)

PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)