This is your work, valued
Research Scientist
MIL.pytorch. PyTorch implementation of Multiple-instance learning
★ 117Stack-Captioning. Stack-Captioning: Coarse-to-Fine Learning for Image Captioning
★ 63unpaired_image_captioning. Unpaired Image Captioning
★ 36online_eval_tools. Human evaluation tool for image captioning
★ 5mellea. Mellea is a library for writing generative programs.
★ 1.7kal-folio. A beautiful, simple, clean, and responsive Jekyll theme for academics
★ 16kfiftyone. Refine high-quality datasets and visual AI models
★ 11kTransformers-Tutorials. This repository contains demos I made with the Transformers library by HuggingFace.
★ 12kyanmtt. Yet Another Neural Machine Translation Toolkit
★ 178Spurious_OOD. Python
★ 23sim2real-docs. Synthesize image datasets of documents in natural scenes with Python+Blender3D
★ 60lightseq. LightSeq: A High Performance Library for Sequence Processing and Generation
★ 3.3kgenalog. Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and text alignment capabilities.
★ 359PrefixTuning. Prefix-Tuning: Optimizing Continuous Prompts for Generation
★ 961TextRecognitionDataGenerator. A synthetic data generator for text recognition
★ 3.7kcuad. CUAD (NeurIPS 2021)
★ 532bbox-visualizer. Make drawing and labeling bounding boxes a piece of cake
★ 414PrivateDeepLearning. Differential Privacy Preservation in Deep Learning under Model Attacks
★ 135simple-faster-rcnn-pytorch. A simplified implemention of Faster R-CNN that replicate performance from origin paper
★ 4kbottom-up-attention.pytorch. A PyTorch reimplementation of bottom-up-attention models
★ 301ark-funds-monitor. A small React app to monitor ARK funds daily transactions
★ 180Control_3D_Objects_with_Camera. Limbo
★ 4Split_Merge_table_recognition. An implementation of the Splitting and Merging table recognition method.
★ 80fairseq. Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
★ 22kit. 🧱 Describe your site, AI builds it, you own it as Markdown. Snap together Tailwind blocks like Lego — landing pages, blogs, portfolios, docs & more. No AI slop. Free to deploy anywhere 👇
★ 9.6kinjecting_numeracy. The accompanying code for "Injecting Numerical Reasoning Skills into Language Models" (Mor Geva*, Ankit Gupta* and Jonathan Berant, ACL 2020).
★ 90Integrated-Gradients. Attributing predictions made by the Inception network using the Integrated Gradients method
★ 651hiersumm. Code for paper Hierarchical Transformers for Multi-Document Summarization in ACL2019
★ 237tokenizers. 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
★ 11kfast-transformers. Pytorch library for fast transformer implementations
★ 1.8kreformer-pytorch. Reformer, the efficient Transformer, in Pytorch
★ 2.2ktransformers. 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
★ 162kAwesome-Visual-Captioning. This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
★ 410SAN. Exploring Self-attention for Image Recognition, CVPR2020.
★ 751CMC. [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis
★ 1.3khyperbolic-image-embeddings. Supplementary code for the paper "Hyperbolic Image Embeddings".
★ 393fourier-feature-networks. Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
★ 1.4kCVPR2026-Papers-with-Code. CVPR 2026 论文和开源项目合集
★ 23kdetr. End-to-End Object Detection with Transformers
★ 15kGoogleConceptualCaptioning. Python
★ 54Amazon-Fresh-Whole-Foods-delivery-slot-finder. A Mac tool that finds available delivery slots for Amazon's Whole Foods delivery and Amazon Fresh services
★ 1kClass-balanced-loss-pytorch. Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"
★ 803SimCLR. PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
★ 2.5kNLP-Cube. Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing
★ 562udify. A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology tags, lemmas, and dependency trees.
★ 225UNITER. Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
★ 800py-bottom-up-attention. PyTorch bottom-up attention with Detectron2
★ 239ContrastiveLosses4VRD. Implementation for the CVPR2019 paper "Graphical Contrastive Losses for Scene Graph Generation"
★ 199pytorch-privacy. simple Differential Privacy in PyTorch
★ 49layout2im. Official PyTorch Implementation of Image Generation from Layout - CVPR 2019
★ 194GatedConvolution_pytorch. A modified reimplemented in pytorch of inpainting model in Free-Form Image Inpainting with Gated Convolution [http://jiahuiyu.com/deepfill2/]
★ 452vilbert_beta. Jupyter Notebook
★ 478structural-probes. Codebase for testing whether hidden states of neural networks encode discrete structures.
★ 403bertviz. BertViz: Visualize Attention in Transformer Models
★ 8.1kctrl. Conditional Transformer Language Model for Controllable Generation
★ 1.9kGMNN. Graph Markov Neural Networks
★ 413OpenCat-Old. A programmable and highly maneuverable robotic cat for STEM education and AI-enhanced services.
★ 1.4kPoseEstimationForMobile. :dancer: Real-time single person pose estimation for Android and iOS.
★ 1kSimGNN. A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).
★ 814ChatterBot. ChatterBot is a machine learning, conversational dialog engine for creating chat bots
★ 15kvisual-chatbot. :cloud: :eyes: :speech_balloon: Visual Chatbot
★ 1sg2im-demo. A web based demo of Google's sg2im neural network to convert a scene graph to a photorealistic image.
★ 35grounded-video-description. Video Grounding and Captioning
★ 332AnyNet. (ICRA) Anytime Stereo Image Depth Estimation on Mobile Devices
★ 520Pi_Self_Driving_Car. 使用树莓派3b来实现无人驾驶汽车
★ 272Self-Driving-Car. HTML
★ 1kAutopilot. A simple self-driving car module for humans 🚘 🛣️
★ 517unsupervised_captioning. Code for Unsupervised Image Captioning
★ 223easyquotation. 实时获取免费股票行情,支持新浪 / 腾讯(港股) / 集思录
★ 5.3kpytorch-spectral-normalization-gan. Paper by Miyato et al. https://openreview.net/forum?id=B1QRgziT-
★ 676UNMT. Code inspired by Unsupervised Machine Translation Using Monolingual Corpora Only
★ 50MUSE. A library for Multilingual Unsupervised or Supervised word Embeddings
★ 3.2ktopic-rnn. Implementation (in progress) of Dieng et al.'s TopicRNN: a neural topic model & RNN hybrid.
★ 52transferlearning-tutorial. 《迁移学习简明手册》LaTex源码
★ 2.5kChatbot. Python ChatBot 💬
★ 868unsupervised-NMT. Unsupervised neural machine translation; weight sharing; GAN
★ 94UNIT. Unsupervised Image-to-Image Translation
★ 2kmaskrcnn-benchmark. Fast, modular reference implementation of Instance Segmentation and Object Detection algorithms in PyTorch.
★ 9.4kPerceptualSimilarity. LPIPS metric. pip install lpips
★ 4.3kHDGan. Pytorch implementation of HDGan
★ 148introvae.pytorch. Python
★ 11AccSGD. Implements pytorch code for the Accelerated SGD algorithm.
★ 216mAP. mean Average Precision - This code evaluates the performance of your neural net for object recognition.
★ 3kObject-Detection-Metrics. Most popular metrics used to evaluate object detection algorithms.
★ 5.1kVQA-Chatbot. :eyes: A Chatbot based on VQA (Visual Question Answering)
★ 17AoAReader. PyTorch implementation of Attention-over-Attention Neural Networks for Reading Comprehension
★ 59PyTorch-AdaHAN. An unofficial PyTorch implementation of the HAN and AdaHAN models presented in the "Learning Visual Question Answering by Bootstrapping Hard Attention" research paper.
★ 54Differentiable-Hard-Attention-Module. A modified version of Spatial Transformer Networks to attend regions on the input image.
★ 44graph-rcnn.pytorch. [ECCV 2018] Official code for "Graph R-CNN for Scene Graph Generation"
★ 748motifs-test. Code for Neural Motifs: Scene Graph Parsing with Global Context (CVPR 2018)
★ 2neural-motifs. Code for Neural Motifs: Scene Graph Parsing with Global Context (CVPR 2018)
★ 545Dynamic-memory-networks-plus-Pytorch. Implementation of Dynamic memory networks plus in Pytorch
★ 127Relation-Networks-for-Object-Detection. Relation Networks for Object Detection
★ 1.1kmobilefacenet-V2. 🔥improve the accuracy of mobilefacenet(insight face) reached 99.733 in the cfp-ff、 the 99.68+ in lfw,96.71+ in agedb30.🔥
★ 424DRIT. Learning diverse image-to-image translation from unpaired data
★ 856gconvRNN. Graph convolutional recurrent neural network
★ 182FactorizableNet. Factorizable Net (Multi-GPU version): An Efficient Subgraph-based Framework for Scene Graph Generation
★ 220MSDN. This is our PyTorch implementation of Multi-level Scene Description Network (MSDN) proposed in our ICCV 2017 paper.
★ 229Pytorch-TextureGAN. TextureGAN in Pytorch
★ 165commonsense-rc. Code for Yuanfudao at SemEval-2018 Task 11: Three-way Attention and Relational Knowledge for Commonsense Machine Comprehension
★ 119BicycleGAN. Toward Multimodal Image-to-Image Translation
★ 1.5khuman-pose-estimation.pytorch. The project is an official implement of our ECCV2018 paper "Simple Baselines for Human Pose Estimation and Tracking(https://arxiv.org/abs/1804.06208)"
★ 3kGraphGAN. A tensorflow implementation of GraphGAN (Graph Representation Learning with Generative Adversarial Nets)
★ 539ReferringRelationships. Python
★ 258vrd-dsr. Code for Visual Relationship Detection with Deep Structural Ranking (AAAI2018)
★ 123e2e_dialog_challenge. End-To-End Task-Completion Dialogue Challenge
★ 194faster-rcnn.pytorch. A faster pytorch implementation of faster r-cnn
★ 7.9kVQA-DataAugmentation. Data Augmentation for Visual Question Answering
★ 6PSLQA. An implementation of Probabilistic Soft Logic Engine using Python/Gurobi
★ 53Sparqly. Python API for SPARQL Endpoints
★ 1conceptnet5. Code for building ConceptNet from raw data.
★ 2.9kconceptnet. ConceptNet: a semantic network of common sense knowledge
★ 283Image-OutPainting. 🏖 Keras Implementation of Painting outside the box
★ 1.1kfact-extractor. Fact Extraction from Wikipedia Text
★ 542w2vv. Word2VisualVec : Predicting Visual Features from Text for Image and Video Caption Retrieval
★ 70vqa-counting. [ICLR 2018] Learning to Count Objects in Natural Images for Visual Question Answering
★ 208extraction-framework. The software used to extract structured data from Wikipedia
★ 937DeepVariationStructuredRL. A PyTorch implementation of the "Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detection" paper by Liang et. al.
★ 64pseudo-3d-pytorch. pytorch version of pseudo-3d-residual-networks(P-3D), pretrained model is supported
★ 451PyTorch-Encoding. A CV toolkit for my papers.
★ 2kpytorch-openai-transformer-lm. 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
★ 1.5kmultimodal_vtt. Joint Embedding with Multimodal Cues for Cross-Modal Video-Text Retrieval
★ 68bist-parser. Scene Graph Parsing as Dependency Parsing
★ 41VAT-pytorch. Virtual Adversarial Training (VAT) implementation for PyTorch
★ 296NeurboParser. A neural TurboSemanticParser as described in "Deep Multitask Learning for Semantic Dependency Parsing", Peng et al., ACL 2017.
★ 71Switchable-Normalization. Code for Switchable Normalization from "Differentiable Learning-to-Normalize via Switchable Normalization", https://arxiv.org/abs/1806.10779
★ 868DQN-pytorch. A PyTorch implementation of Human-Level Control through Deep Reinforcement Learning
★ 24vrn-pytorch. PyTorch Code for "Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression"
★ 82MatchLSTM-PyTorch. a pytorch implementation of match lstm question answering model
★ 43sg2im. Code for "Image Generation from Scene Graphs", Johnson et al, CVPR 2018
★ 1.3kmace. MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.
★ 5kc3d-pytorch. Pytorch porting of C3D network, with Sports1M weights
★ 363fgvc5-cvpr2018-food-fashion. Fine Grained Visual Categorization
★ 11thor-iqa-cvpr-2018. Repository containing code for the paper "IQA: Visual Question Answering in Interactive Environments"
★ 126self-imitation-learning. ICML 2018 Self-Imitation Learning
★ 277EmbodiedQA. Train embodied agents that can answer questions in environments
★ 315coco-caption. Adds SPICE metric to coco-caption evaluation server codes
★ 10DCC. Implementation of CVPR 2016 paper
★ 74planetoid. Semi-supervised learning with graph embeddings
★ 960graph-generation. GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
★ 734PyTorch-GAN. PyTorch implementations of Generative Adversarial Networks.
★ 17kPPO-Pytorch. Implementation of PPO in Pytorch
★ 41pytorch-sentiment-analysis. Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
★ 4.6kJoint-GAN. Python
★ 19online_eval_tools. Human evaluation tool for image captioning
★ 5knowledge-distillation-pytorch. A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
★ 2kDiscCaptioning. Code for Discriminability objective for training descriptive captions(CVPR 2018)
★ 109Deep-Reinforcement-Learning-for-Dialogue-Generation-in-tensorflow. Deep-Reinforcement-Learning-for-Dialogue-Generation-in-tensorflow
★ 190zero-shot-gcn. Zero-Shot Learning with GCN (CVPR 2018)
★ 915Style_Migration_For_Artistic_Font_With_CNN. 基于卷积神经网络的风格迁移,制造出带有艺术风格的字体(艺术字),部分效果可达PS水平,可以辅助设计人员做设计;Convolutional neural network based style migration to create a font with artistic style (WordArt), some effects up to PhotoShop level, it can assist designers to do design
★ 235visdial-amt-chat. [CVPR 2017] AMT chat interface code used to collect the Visual Dialog dataset
★ 78DeepTracking. Source code of DeepTracking research project
★ 130StackNN. Experiments with differentiable stacks and queues in PyTorch
★ 145Detectron.pytorch. A pytorch implementation of Detectron. Both training from scratch and inferring directly from pretrained Detectron weights are available.
★ 1pytorch-maml. PyTorch implementation of MAML: https://arxiv.org/abs/1703.03400
★ 567joint-vae. Pytorch implementation of JointVAE, a framework for disentangling continuous and discrete factors of variation :star2:
★ 470naacl18tutorial. NAACL 2018 Tutorial: Modelling Natural Language, Programs, and their Intersection
★ 102MSDNet-GCN. ICLR 2018 reproducibility challenge - Multi-Scale Dense Convolutional Networks for Efficient Prediction
★ 132brats17. Brain tumor segmentation for MICCAI 2017 BraTS challenge
★ 330pytorch-MNIST-CelebA-cGAN-cDCGAN. Pytorch implementation of conditional Generative Adversarial Networks (cGAN) and conditional Deep Convolutional Generative Adversarial Networks (cDCGAN) for MNIST dataset
★ 533deep_trader. This project uses reinforcement learning on stock market and agent tries to learn trading. The goal is to check if the agent can learn to read tape. The project is dedicated to hero in life great Jesse Livermore.
★ 8TradingGym. Trading and Backtesting environment for training reinforcement learning agent or simple rule base algo.
★ 1.9krl-portfolio-management. Attempting to replicate "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem" https://arxiv.org/abs/1706.10059 (and an openai gym environment)
★ 562visDial.pytorch. visual dialog model in pytorch
★ 110Transformer_Captioning. Use transformer for captioning
★ 156stock_market_reinforcement_learning. This project provides a stock market environment using OpenGym with Deep Q-learning and Policy Gradient.
★ 794deep_trader. This project uses reinforcement learning on stock market and agent tries to learn trading. The goal is to check if the agent can learn to read tape. The project is dedicated to hero in life great Jesse Livermore.
★ 1.5kStockPricePrediction. Stock Price Prediction using Machine Learning Techniques
★ 1.5kUnpaired-Sentiment-Translation. Code for "Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach" (ACL 2018)
★ 108QuestionGeneration. Python
★ 108CharadesDet. Charades Object Detection Dataset (ICCV 2017)
★ 31stylenet. A pytorch implemention of "StyleNet: Generating Attractive Visual Captions with Styles"
★ 63gancaption_iccv2017. Towards Diverse and Natural Image Descriptions via a Conditional GAN
★ 75extension-cpp. C++ extensions in PyTorch
★ 1.2khiggsfield. Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
★ 3.9kvisual-attribution. Pytorch Implementation of recent visual attribution methods for model interpretability
★ 146text2shape.pytorch. This is the implementation of text2shape in pytorch
★ 4Facelet_Bank. Facelet-Bank for Fast Portrait Manipulation (pytorch)
★ 208pyGAT. Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
★ 3.1kbinary-human-pose-estimation. This code implements a demo of the Binarized Convolutional Landmark Localizers for Human Pose Estimation and Face Alignment with Limited Resources paper by Adrian Bulat and Georgios Tzimiropoulos.
★ 214translate. Translate - a PyTorch Language Library
★ 841FC-DenseNet. Fully Convolutional DenseNets for semantic segmentation.
★ 489sbvqa. Python
★ 12videoqa. Unifying the Video and Question Attentions for Open-Ended Video Question Answering
★ 22neural-acoustic-word-embeddings. Shell
★ 45pytorch-dual-learning. Implementation of Dual Learning NMT on PyTorch
★ 165wavenet_vocoder. WaveNet vocoder
★ 2.4kseg_every_thing. Code release for Hu et al., Learning to Segment Every Thing. in CVPR, 2018.
★ 423pytorch_compact_bilinear_pooling. Compact Bilinear Pooling for PyTorch
★ 254lstm-crf-pytorch. LSTM-CRF in PyTorch
★ 463REGAN. ReGAN: Sequence GAN using RE[INFORCE|LAX|BAR] based PG estimators
★ 41phrase-based_image_captioning. Torch implementation of ICML 2015 paper about image captioning
★ 9Structured-Self-Attention. A Structured Self-attentive Sentence Embedding
★ 492dirt-t. A DIRT-T Approach to Unsupervised Domain Adaptation (ICLR 2018)
★ 176nlp1-2017-projects. Info for NLP1 2017 projects
★ 23toward-controlled-generation-of-text-pytorch. A PyTorch Implementation of "Toward Controlled Generation of Text"
★ 105hred. Implements the paper " Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models" by Serban et al (currently on the MovieTriples dataset)
★ 116deep-learning-model-convertor. The convertor/conversion of deep learning models for different deep learning frameworks/softwares.
★ 3.2kRealtime_Multi-Person_Pose_Estimation. Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)
★ 5.1kMegaDepth. Code of single-view depth prediction algorithm on Internet Photos described in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos, Z. Li and N. Snavely, CVPR 2018".
★ 777light_head_rcnn. Light-Head R-CNN
★ 830spatial_graph_convnets. PyTorch implementation of residual gated graph ConvNets, ICLR’18
★ 124VIN_PyTorch_Visdom. PyTorch implementation of Value Iteration Networks (VIN): Clean, Simple and Modular. Visualization in Visdom.
★ 223Wasserstein-AutoEncoders. PyTorch implementation of Wasserstein Auto-Encoders
★ 298