Yuan Gong

ast. Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

ltu. Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".

ssast. Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".

whisper-at. Code and Pretrained Models for Interspeech 2023 Paper "Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong Audio Event Taggers"

cav-mae. Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".

gopt. Code for the ICASSP 2022 paper "Transformer-Based Multi-Aspect Multi-Granularity Non-native English Speaker Pronunciation Assessment".

vocalsound. Dataset and baseline code for the VocalSound dataset (ICASSP2022).

psla. Code for the TASLP paper "PSLA: Improving Audio Tagging With Pretraining, Sampling, Labeling, and Aggregation".

uavm. Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".

python-compute-eer. Simple Python script to compute equal error rate (EER) for machine learning model evaluation.

ReMASC. ReMASC: Realistic Replay Attack Corpus for Voice Controlled Systems

llm_speech_emotion_challenge. Jupyter Notebook

realtime-adversarial-attack. Code for IJCAI 2019 paper "Real-time Adversarial Attack".

multichannel-antispoof. Code for SPL paper "Detecting Replay Attacks Using Multi-Channel Audio: A Neural Network-Based Method"

awesome-whisper. 🔊 Awesome list for Whisper — an open-source AI-powered speech recognition system developed by OpenAI

efficient-voice-antispoof. Jupyter Notebook

Awesome-Multimodal-Large-Language-Models. Latest Papers and Datasets on Multimodal Large Language Models

ESC-50. ESC-50: Dataset for Environmental Sound Classification

Best-Audio-Classification-Resources-with-Deep-learning. List of articles related to deep learning applied to music

kaldi-abbr. kaldi name convention note

Facebook-Interview-Coding-1. 个人整理的Facebook实习面试题目解法，时间范围2016.8-2017.3

yuangongnd.github.io. HTML

SincNet. SincNet is a neural architecture for efficiently processing raw audio samples.

Speech_DB_Engine. Python