Beijing

Songming Zhang

Intermediate
@songmzhang

PhD student at Beijing Jiaotong University

songmzhang.github.io/

KDFlow. A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, on-policy (OPD), cross-tokenizer, multimodal, and on-policy self-distillation.

222

DSKD. Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same-tokenizer and cross-tokenizer LLM distillation.

63

DSKDv2. The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".

16

CBMI. The code of ACL2022 paper "Conditional Bilingual Mutual Information based Adaptive Training for Neural Machine Translation"..

14

NMT-KD. Repo for ACL2023 paper "Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation".

5

AlignDistil. Code for ACL 2025 Paper "AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation"

4
6
Apply