Rohan Paul

Kocoro. A Mac-compatible AI partner with memory. — local computer access, browser control, IM channels, MCP-native. Built on Shannon.

world2agent. World2Agent(W2A) is an open protocol that standardizes how Al agents perceive the real world.

gstack. Use Garry Tan's exact Claude Code setup: 23 opinionated tools that serve as CEO, Designer, Eng Manager, Release Manager, Doc Engineer, and QA

Anemoi. Anemoi: A Semi-Centralized Multi-agent Systems Based on Agent-to-Agent Communication MCP server from Coral Protocol

openai-imo-2025-proofs.

context-engineering-intro. Context engineering is the new vibe coding - it's the way to actually make AI coding assistants work. Claude Code is the best for this so that's what this repo is centered around, but you can apply this strategy with any AI coding assistant!

CL4R1T4S. LEAKED SYSTEM PROMPTS FOR CHATGPT, CLAUDE, GEMINI, GROK, PERPLEXITY, CURSOR, LOVABLE, REPLIT, AND MORE! - AI SYSTEMS TRANSPARENCY FOR ALL! 👐

glass. Digital Mind Extension

Paddle. PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

cuopt-examples. NVIDIA cuOpt examples for decision optimization

Machine-Learning-Case-Studies-Interviews-Question. WORLD'S MOST COMPREHENSIVE RESOURCE FOR MACHINE LEARNING CASE-STUDY BASED INTERVIEW QUESTIONS

model2vec. Fast State-of-the-Art Static Embeddings

GamingAgent. [ICLR 2026] LLM/VLM gaming agents and model evaluation through games.

Awesome_Latext_for_MachineLearning_DeepLearning. Collection of all Awesome Latext for MachineLearning DeepLearning

Awesome_Machine_Learning_Interview_Question. WORLD'S MOST COMPREHENSIVE RESOURCE FOR MACHINE LEARNING INTERVIEW QUESTIONS

gumroad. See what sticks

the-algorithm-ml. Source code for Twitter's Recommendation Algorithm

ai-agents-for-beginners. 12 Lessons to Get Started Building AI Agents

live-api-web-console. A react-based starter app for using the Live API over websockets with Gemini

MegaTTS3. Python

Rohan-Paul-AI-Daily-Newsletter_Codes. Codes for my Daily AI newsletter

Awesome-Code-LLM. [TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.

openai-agents-python. A lightweight, powerful framework for multi-agent workflows

langgraph-swarm-py. For your multi-agent needs

FlashMLA. FlashMLA: Efficient Multi-head Latent Attention Kernels

goku. [CVPR2025 Highlight] Video Generation Foundation Models: https://saiyan-world.github.io/goku/

openpi. Python

weathernext. Python

generative-ai. Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform

DeepSeek-V3. Python

flashrnn. FlashRNN - Fast RNN Kernels with I/O Awareness

Star-Attention. Efficient LLM Inference over Long Sequences

backtrack_sampler. An easy-to-understand framework for LLM samplers that rewind and revise generated tokens

ECHO. Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)

sonar. Large-scale LLM inference engine

PDF2Audio. Jupyter Notebook

skorch. A scikit-learn compatible neural network library that wraps PyTorch

RobustSAM. RobustSAM: Segment Anything Robustly on Degraded Images (CVPR 2024 Highlight)

openinterpreter. A lightweight coding agent for open models like Deepseek, Kimi, and Qwen

LARS. An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.

rerankers. A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.

LaTeX-OCR. pix2tex: Using a ViT to convert images of equations into LaTeX code.

DocChat. GPT-4 Level Conversational QA Trained In a Few Hours

nyuntam. Python

TEAL. Python

DeepLearningExamples. State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

How_Much_VRAM. Jupyter Notebook

Nanoflow. A throughput-oriented high-performance serving framework for LLMs

writing-in-the-margins. Python

auto-round. A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.

mamba-ssm. Implementation of mamba with rust

uncertain_ground_truth. Dermatology ddx dataset, Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncertain ground truth (TMLR'23 and ArXiv pre-print).

Jobs_Applier_AI_Agent_AIHawk. AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

edge. On-device intelligence.

biniou. a self-hosted webui for 30+ generative ai

kotaemon. An open-source RAG-based tool for chatting with your documents.

claude-engineer. Claude Engineer is an interactive command-line interface (CLI) that leverages the power of Anthropic's Claude-3.5-Sonnet model to assist with software development tasks.This framework enables Claude to generate and manage its own tools, continuously expanding its capabilities through conversation. Available both as a CLI and a modern web interface

novel-writer. Automated LLM novelist

tabby. Self-hosted AI coding assistant

ragbuilder. A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

LongWriter. [ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

whisper-plus. WhisperPlus: Faster, Smarter, and More Capable 🚀

Liger-Kernel. Efficient Triton Kernels for LLM Training

exo. Run frontier AI locally.

ivy. Convert Machine Learning Code Between Frameworks

llm-price-compass. This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table

gallama. Python

llama-nuts-and-bolts. A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

continue. open-source coding agent

unstract. LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

ai-toolkit. The ultimate training toolkit for finetuning diffusion models

llm-compressor. Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

llm-functions. Easily create LLM tools and agents using plain Bash/JavaScript/Python functions.

AQLM. Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852

baml. The programming language for agents

AdalFlow. AdalFlow: The library to build & auto-optimize LLM applications.

SciencePlots. Matplotlib styles for scientific plotting

parler-tts. Inference and training library for high-quality TTS models.

crab. 🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/

Deep-Live-Cam. real time face swap and one-click video deepfake with only a single image

ai-router-chat. TypeScript

swarms. The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

lsp-ai. LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

r2r-js. js client for R2R: production-ready RAG engine with a sh*t ton of features.

AutoGGUF. automatically quant GGUF models

R2R. SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

RAG_Techniques. This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

groundx-sdks. Python

torchchat. Run PyTorch LLMs locally on servers, desktop and mobile

PDF-Extract-Kit. A Comprehensive Toolkit for High-Quality PDF Content Extraction

ktransformers. A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

claude-cookbooks. A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

distributed-llama. Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Speech. A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

GraphRAG-Local-UI. GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.

functime. Time-series machine learning at scale. Built with Polars for embarrassingly parallel feature extraction and forecasts on panel data.

lobehub. 🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.

NeMo-Framework-Launcher. Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.

clarity-upscaler. Clarity AI | AI Image Upscaler & Enhancer - free and open-source Magnific Alternative

reward-bench. RewardBench: the first evaluation tool for reward models.

label-studio. Label Studio is a multi-type data labeling and annotation tool with standardized output format

awesome-RLHF. A curated list of reinforcement learning with human feedback resources (continually updated)

workbench-example-mistral-finetune. An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model

garak. the LLM vulnerability scanner

workbench-llamafactory. This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.

chameleon. Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

warp. A Python framework for GPU-accelerated simulation, robotics, and machine learning.

web-llm. High-performance In-browser LLM Inference Engine

langfuse. 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Megatron-LM. Ongoing research training transformer models at scale

pgvector. Open-source vector similarity search for Postgres

jailbreak_llms. [CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

block-transformer. Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)

infinity. Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

kdbai-samples. Developer samples for the KDB.AI vector database

atomic-agents. Building AI agents, atomically

evals. Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

deepeval. The LLM Evaluation Framework

fg-data-synthetic. Synthetic data generators for tabular and time-series data

ragas. Supercharge Your LLM Application Evaluations 🚀

Video-MME. ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

tribe. Low code tool to rapidly build and coordinate multi-agent teams

courses. Anthropic's educational courses

Awesome-LLM. Awesome-LLM: a curated list of Large Language Model

knockknock. 🚪✊Knock Knock: Get notified when your training ends with only two additional lines of code

lmdeploy. LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

flyte. Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

elia. A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

arena-hard-auto. Arena-Hard-Auto: An automatic LLM benchmark.

crewAI-examples. A collection of examples that show how to use CrewAI framework to automate workflows.

crewAI. Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

ChatGPT. 🔮 ChatGPT Desktop Application (Mac, Windows and Linux)

executorch. On-device AI across mobile, embedded and edge for PyTorch

granite-code-models. Granite Code Models: A Family of Open Foundation Models for Code Intelligence

kan-gpt. The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

infinity. The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

mamba.c. Inference of Mamba, Mamba2 and Mamba3 models in pure C

langroid. Harness LLMs with Multi-Agent Programming

awesome-claude-prompts. This repo includes Claude prompt curation to use Claude better.

pykan. Kolmogorov Arnold Networks

vanna. 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄.

mlc-llm. Universal LLM Deployment Engine with ML Compilation

reader. Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

firecrawl. The API to search, scrape, and interact with the web at scale. 🔥

needle-in-a-haystack. Doing simple retrieval from LLM models at various context lengths to measure accuracy

selfcodealign. [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation

fsdp_qlora. Training LLMs with QLoRA + FSDP

corenet. CoreNet: A library for training deep neural networks

mistral.rs. Fast, flexible LLM inference

open-webui. User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

torchtitan. A PyTorch native platform for training generative AI models

attorch. A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

airllm. AirLLM 70B inference with single 4GB GPU

onetwo. Python

configs. LM Studio JSON configuration file format and a collection of example config files.

code2prompt. A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

RWKV-PEFT. Python

Flowise. Build AI Agents, Visually

FILM. Official repo for "Make Your LLM Fully Utilize the Context"

Retrieval_Head. open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality

LLM-Workshop. LLM Workshop by Sourab Mangrulkar

lyzr-automata. low-code multi-agent automation framework

midday. Invoicing, Time tracking, File reconciliation, Storage, Financial Overview & your own Assistant made for Freelancers

cohere-toolkit. Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

cookbook. Open-source AI cookbook

uptrain. UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

surya. OCR, layout analysis, reading order, table recognition in 90+ languages

multiLLM. 🚀 Invoke multiple large language models concurrently and the rank results. Add new models and ranking functions quickly.. ⭐

grok-1. Grok open release

llm-inference-solutions. A collection of all available inference solutions for the LLMs

sparrow. Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM

llama-chat. A boilerplate for creating a Llama 3 chat app

llama3. The official Meta Llama 3 GitHub site

plandex. Open source AI coding agent. Designed for large projects and real world tasks.

torchtune. PyTorch native post-training library

cookbook. Examples and guides for using the Gemini API

infini-transformer. PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

blogcaster. Python tools for easily translating your blog content to podcasts & YouTube

lloco. The official repo for "LLoCo: Learning Long Contexts Offline"

Mixture-of-depths. Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

simple-evals. Python

files-to-prompt. Concatenate a directory full of files into a single prompt for use with LLMs

tortoise-tts. A multi-voice TTS system trained with an emphasis on quality

auto-code-rover. A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 37.3% tasks (pass@1) in SWE-bench lite and 46.2% tasks (pass@1) in SWE-bench verified with each task costs less than $0.7.

VALL-E-X. An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/

FABLES. Python

emvb. Implementation of "Efficient Multi-vector Dense Retrieval with Bit Vectors", ECIR 2024

schedule_free. Schedule-Free Optimization in PyTorch

waveglow. A Flow-based Generative Network for Speech Synthesis

JetMoE. Reaching LLaMA2 Performance with 0.1M Dollars

orpo. Official repository for ORPO

Eurus. Python

torchscale. Foundation Architecture for (M)LLMs

oboe.js. A streaming approach to JSON. Oboe.js speeds up web applications by providing parsed objects before the response completes.

SWE-agent. SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

llamafile. Distribute and run LLMs with a single file.

ragflow. RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

llm_templates. Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

LLM-Blender. [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut the weaknesses through ranking and integrate the strengths through fusing generation to enhance the capability of LLMs.

chug. Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.