Shanghai, China

Siyu Ren

Advanced
@DRSY

Efficient Methods for NLP/LLMs

EMO. [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)

129

MoTIS. [NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP)

126

EasyKV. Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)

62

KV_Compression. [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens

25

DGen. [AAAI 2021]Knowledge-Driven Distractor Generation for Cloze-Style Multiple Choice Questions

22

LAMP. [NAACL 2022 Findings]Specializing Pre-trained Language Models for Better Relational Reasoning via Network Pruning

11

Template_Repo. template project structure for NLP research

6

poetry-gen. 利用LSTM生成七言律诗

5

Rsynet. a simple deep learning library

3

SpeculativeDecoding. Pytorch and HF implementation of standard auto-regressive decoding and speculative decoding

3

PINS. [ACL2023 Findgins]Pruning Pre-trained Language Models with Principled Importance and Self-regularization

2

MyBTree. A toy implementation of B-Tree

2

AbstractSoul.

2

MyRBTree. A c++ implementation of red-black tree

2

MAML_CP_VAE. Roff

2

ConceptConceptualization.

2

LLCSA. Lifelong Commonsense Knowledge Acquisition

2

DRSY.

2

dotfiles. Personal dotfiles including zshrc/vimrc/tmux.conf

1

LanguageGrounding. Python

1

CommonsenseVAE. Diverse and Informative Commonsense Inference with Relation-Specific Gaussian Mixture Prior

1

CommonsenseArgConceptualization.

1

Transformer. A Pytorch implementation of Transformer and Weighted Transformer

1
23
Apply