All Categories - Wentao's Blog

All Categories

Paper_summary ²⁵

Summary: DeepSeek-V3 Technical Report

Summary: FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision

Summary: FLASHINFER: EFFICIENT AND CUSTOMIZABLE ATTENTION ENGINE FOR LLM INFERENCE SERVING

Summary: Training Compute-Optimal Large Language Models

Summary: Outrageously Large Neural Networks: The Sparsely-Gated Mixture-Of-Experts Layer

Pytorch ¹⁸

Deep Dive to Pytorch Contiguous Operator(4)

Distributed Training Strategy Introduction

Deep Dive into PyTorch Device Copy Operations

Csapp ¹⁰

CSAPP Class Notes(4)

Server ⁷

Ceph Learning Notes

Nginx Learning Notes

Kafka Learning Notes

Protobuf Learning Notes

Mysql Learning Notes

Tvm ⁵

TVM: 2D Depth Conv GPU Optimization

TVM: GEMM GPU Optimization

TVM: 1D convolution GPU Optimization

TVM: 1D convolution CPU Optimization

Summary: TVM: An Automated End-to-End Optimizing Compiler for Deep Learning

Technical_notes ⁴

2025 Technical Notes（3）

2025 Technical Notes(2)

2025 Technical Notes(1)

2024 Technical Notes

Algorithm ²

Understand Dynamic Programming

Understand Lightgbm

Llm ²

Llama_index Source Code Analysis(1)

Llama_index Source Code Analysis(2)

Vllm ¹

Summary: Efficient Memory Management for Large Language Model Serving with PagedAttention