All Categories - Wentao's Blog

All Categories

Pytorch ¹⁸

Deep Dive to Pytorch Contiguous Operator(4)

Distributed Training Strategy Introduction

Deep Dive into PyTorch Device Copy Operations

Paper_summary ¹³

Summary: Efficient Memory Management for Large Language Model Serving with PagedAttention

Summary: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Summary: ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

Summary: Communication-Efficient Learning of Deep Networks from Decentralized Data

Summary: Large Scale Distributed Deep Networks

Csapp ¹⁰

CSAPP Class Notes(4)

Server ⁷

Ceph Learning Notes

Nginx Learning Notes

Kafka Learning Notes

Protobuf Learning Notes

Mysql Learning Notes

Tvm ⁵

TVM: 2D Depth Conv GPU Optimization

TVM: GEMM GPU Optimization

TVM: 1D convolution GPU Optimization

TVM: 1D convolution CPU Optimization

Summary: TVM: An Automated End-to-End Optimizing Compiler for Deep Learning

Technical_notes ³

2025 Technical Notes(2)

2025 Technical Notes(1)

2024 Technical Notes

Algorithm ²

Understand Dynamic Programming

Understand Lightgbm

Llm ²

Llama_index Source Code Analysis(1)

Llama_index Source Code Analysis(2)

Vllm ¹

Summary: Efficient Memory Management for Large Language Model Serving with PagedAttention