Shanghai

Shiqing Fan

Expert
@fanshiqing

NVIDIA, Senior Performance Architect, Full-stack LLM Training Optimization.

fanshiqing.github.io/

grouped_gemm. PyTorch bindings for CUTLASS grouped GEMM.

190

moe_grouped_gemm. A PyTorch Toolbox for Grouped GEMM in MoE Model Training

6

jnicookbook. JNI Cook Book samples

2

Qix. Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

1

tensorflow-1. An Open Source Machine Learning Framework for Everyone

1

MyLeetcodeSolutions. My leetcode/lintcode solutions in JAVA.

1

Megatron-LM. Ongoing research training transformer language models at scale, including: BERT & GPT-2

1
7
Apply