This is your work, valued
Co-founder @altaidevorg, Sr. AI Research engineer and Google Developer Expert on Machine Learning - Making LLM customization uncool again.
clip.cpp. CLIP inference in plain C/C++ with no extra dependencies
★ 563lmm.cpp. Inference of Large Multimodal Models in C/C++. LLaVA and others
★ 48german-tts. German Tacotron 2 and Multi-band MelGAN in TensorFlow with TF Lite inference support
★ 26stable-diffusion-tf-docker. Stable Diffusion in Docker with a simple web API and GPU support
★ 23mobilenetv2-tf2. A reusable TensorFlow 2.0 and Keras implementation of MobileNetV2
★ 18efficientnet-tf2. A reusable implementation of EfficientNet in TensorFlow 2.0 and Keras
★ 17gemma-mcp. MCP Client for Gemma-3
★ 15tqp. Dataset and pretrained model for question paraphrasing in Turkish
★ 15trfaq. Question and answer retrieval in Turkish with BERT
★ 14asr-annotation-bot. Simple Telegram bot to annotate and varify automatic speech recognition datasets
★ 12emo-cv. AI Labs tarafından EMO'da düzenlenen Derin Öğrenme ile Bilgisayarlı Görü eğitimine ait döküman ve örnek kodlar
★ 12open-tasks. Let LLMs schedule tasks for you and itself
★ 11turkish-tokenizers. Subword and BPE Tokenizers for Turkish language
★ 11ai-aas. AI as a Service. Production is all you need
★ 9slides. Slides on machine learning, TensorFlow, research, MLOps and everything else I'm interested in
★ 8turkish-clip. Embed texts in Turkish to be used with OpenAI's CLIP
★ 7udemy-api. A simple Udemy API client in node.js
★ 5llm-api. Web API and websocket for Large Language Models in C++
★ 4LLaVA. [NeurIPS 2023 Oral] Visual Instruction Tuning: LLaVA (Large Language-and-Vision Assistant) built towards multimodal GPT-4 level capabilities.
★ 3nanochat.JAX. A legible and hackable port of Nanochat in JAX/Flax
★ 2android-studio-file-templates. Make writing common codes more enjoyable
★ 1aiplatform-workshop. Dead simple training code for AI Platform workshop
★ 1trax-samples. Sample notebooks with Trax
★ 1awesome-chatgpt-plugins. A curated list of awesome ChatGPT plugins, demos and Posts
★ 1TensorFlowASR. :zap: TensorFlowASR: Almost State-of-the-art Automatic Speech Recognition in Tensorflow 2. Supported languages that can use characters or subwords
★ 1OFASys. OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models
★ 1latent-diffusion. High-Resolution Image Synthesis with Latent Diffusion Models
★ 1ggml. Tensor library for machine learning
★ 1label-snd. Easily label sound datasets!
★ 1OCVStarter. Boilerplate for native OpenCV on Android
★ 1monatis. JavaScript
★ 1exercises-dataset. 1,324-exercise fitness dataset — animation GIFs, 180×180 thumbnails, muscle-group & equipment data, and step-by-step instructions in 6 languages. The exercise data layer behind the LogPress app.
★ 11kOScaR-KV-Quant. 🏆 OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond — redefining the accuracy-efficiency Pareto front for X-LLMs KV quantization.
★ 138PLFM_RADAR. Open-source, low-cost 10.5 GHz PLFM phased array RADAR system
★ 23kscience-skills. GDM Science Skills to speed up agentic scientific workflows with better grounding and higher token efficiency. Integrate insights from AlphaGenome, AFDB, UniProt and 30+ other databases and tools.
★ 2.3ksemble. Fast and Accurate Code Search for Agents. Uses ~98% fewer tokens than grep+read
★ 5.6kcq. An open standard for shared agent learning. Agents persist, share, and query collective knowledge so they stop rediscovering the same failures independently.
★ 1.2karxiv2md. Convert arxiv papers to markdown
★ 188Ctx2Skill. Code for "From Context to Skills: Can Language Models Learn from Context Skillfully? "
★ 327CodeWhale. Open-source, community-driven agent harness
★ 40knanochat.JAX. A legible and hackable port of Nanochat in JAX/Flax
★ 2RoundPipe. Large DNNs training framework for consumer GPUs
★ 89Nucleus. A high-performance, minimalistic container engine in Rust.
★ 42isanagent. Like Openclaw, but for ML engineering. Your always-on and autonomous ML engineer that works 24/7 to conduct research, generate datasets, train models, learn and evolve. Works on Colab, local GPU or over SSH. Zero infra needed
★ 13dirac. Coding Agent singularly focused efficiency and context curation. Reduces API costs by 50-80% vs other agent AND improves the code quality at the same time. Uses Hash Anchored edits, massively parallel operations, AST manipulation and many many other optimizations. https://dirac.run/
★ 1.4knpcforge. Branching NPC dialogue generator with Yarn Spinner export, powered by afterimage.
★ 3agent-vault. A HTTP credential proxy and vault for AI agents like Claude Code, OpenClaw, Hermes, custom agents + harnesses, and more.
★ 1.9kTIDE. Dynamic per-token early exit for LLM inference. Skip layers tokens don't need
★ 33smolvm. Portable, lightweight, self-contained virtual machines.
★ 4.3kafterimage. Generate conversational, tool-calling, structured-output, and preference datasets — easily and at scale
★ 41VoxCPM. VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
★ 33kawesome-design-md. A collection of DESIGN.md files analysis by popular brand design systems. Drop one into your project and let coding agents generate a matching UI.
★ 101kclaw-code. An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.
★ 195kturboquant-pytorch. From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% attention fidelity.
★ 1kemail-server. Self-hosted personal email server with IMAP, SMTP, CalDAV/CardDAV. Privacy-focused alternative to Gmail/Outlook. Features: auto-TLS, DKIM/SPF/DMARC, greylisting, Prometheus metrics, audit logging.
★ 41email-explorer. A self-hosted, serverless worker for sending and receiving emails on Cloudflare
★ 147pageindex-rs. Hierarchical document indexing for RAG pipelines, written in Rust with Python bindings
★ 9FireRedVAD. A SOTA Industrial-Grade Voice Activity Detection & Audio Event Detection, supporting 100+ languages, outperforming Silero-VAD, TEN-VAD, FunASR-VAD and WebRTC-VAD
★ 457pdf_oxide. The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.
★ 884ZeroFS. ZeroFS: A log-structured filesystem for S3. ZeroFS serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices over NBD.
★ 2.8kCUDA-Agent. CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation
★ 1.1kturkicnlp. NLP Toolkit for Turkic Languages
★ 21OasisNvr. A high-performance Network Video Recorder written in Rust. Records RTSP streams from multiple IP cameras into pre-allocated binary pool files using a ring buffer strategy. Designed for HDD-based storage with sequential I/O optimization — no SSD required.
★ 4moonshine. Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces
★ 8.7kRuVector. RuVector is a High Performance, Real-Time, Self-Learning Ai, Vector GNN, Memory DB built in Rust.
★ 4.3kzeroclaw. Fast, small, and fully autonomous AI personal assistant infrastructure, any OS, any platform — deploy anywhere, swap anything 🦀
★ 32kagentfs. The filesystem for agents.
★ 3.3kfunctiongemma-afterimage-demo. Jupyter Notebook
★ 1Movie-Streaming-Web-Interface. A static movie browsing web interface built with HTML5 and CSS3, featuring a structured navigation system, sidebar icons, featured content area, categorized movie lists, and interactive visual styling designed to simulate a modern streaming platform layout.
★ 2iris.c. Flux 2 image generation model pure C inference
★ 2ktraining-doctor. Python
★ 6rxiv-maker. Rxiv-Maker is a GitHub-native framework that converts markdown into a publication-ready PDF. It automates scientific preprint generation with a focus on reproducibility and version control
★ 38manuscript-rxiv-maker. Rxiv-Maker preprint source code
★ 2soprano-factory. Soprano-Factory: Train your own 2000x realtime text-to-speech model
★ 243mHC.cu. mHC kernels implemented in CUDA
★ 264SoE. [EACL'26] Repository for the Paper "Continual Pretraining on Encrypted Synthetic Data for Privacy-Preserving LLMs"
★ 5Chronicals. High-Performance LLM Fine-Tuning Framework - 3.51x faster than Unsloth
★ 16trailbase. An open, sub-millisecond, single-executable Firebase alternative with type-safe APIs, built-in WebAssembly runtime, realtime subscriptions, auth, and admin UI built on Rust, SQLite & Wasmtime.
★ 5.4kaichat. All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
★ 10kmistral-vibe. Minimal CLI coding agent by Mistral
★ 4.7ksemantic-soft-bootstrapping. A self-distillation based training method for long context reasoning in a single LLM without reinforcement learning
★ 11cutile-python. cuTile is a programming model for writing parallel kernels for NVIDIA GPUs
★ 2.1kCUDA-L2. CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
★ 461general-agentic-memory. A general memory system for agents, powered by deep-research
★ 857mini-kvstore-v2. Single node key–value store in Rust — segmented log, in-memory index, checksums, and manual compaction.
★ 28AsymmetryLoRA. Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
★ 40dllm. dLLM: Simple Diffusion Language Modeling
★ 2.6kpyversity. Fast Diversification for Search & Retrieval
★ 493helion. A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
★ 900calm. Official implementation of "Continuous Autoregressive Language Models"
★ 809llink. Training and Inference for "Languages are Modalities: Cross-Lingual Alignment via Encoder Injection"
★ 9pynife. Nearly Inference Free Embeddings: make your RAG queries 500x faster
★ 79tokenmonster. Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript
★ 626nano-vllm. Nano vLLM
★ 14kmodded-nanogpt. NanoGPT (124M) in 90 seconds
★ 5.5kDistilledPRAG. Python
★ 3triton_bwd. Automatic differentiation for Triton Kernels
★ 29LightMem. [ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation
★ 960vlm-gym. RL gym for vision language models written in JAX
★ 148Math-VR-CodePlot-CoT. Math-VR Benchmark & CodePlot-CoT: Mathematical Visual Reasoning by Thinking with Code-Driven Images
★ 63mini-vec2vec. Jupyter Notebook
★ 16nanochat. The best ChatGPT that $100 can buy.
★ 56kTinyRecursiveModels. Python
★ 6.6kPaper2Video. Automatic Video Generation from Scientific Papers
★ 2.3kTalk2FastVLM. Flask app to interact with FastVLM using CPU only
★ 8tunix. A Lightweight LLM Post-Training Library
★ 2.4kDocLayout-YOLO. DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
★ 2.2kkuzu. Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.
★ 4kydl-rs. Rust
★ 6nano-gpt-oss. Learn the building blocks of how to build gpt-oss from scratch
★ 120nano-wal. A simple, lightweight Write-Ahead Log (WAL) implementation for append-only operations
★ 15hallbayes. Python
★ 1.7kHRM. Hierarchical Reasoning Model Official Release
★ 13ksmoldb. A smol distributed database implemented from scratch 🐣
★ 100trackio. A lightweight, local-first, and free experiment tracking library from Hugging Face 🤗
★ 1.6kvui. Real-time voice assistant — WebRTC streaming, faster-whisper ASR, local LLM, Vui Nano (300M) TTS. OpenAI Realtime API compatible. Voice cloning, barge-in, ~9× realtime on a 4090. Apache 2.0.
★ 719lemonade. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
★ 4.9kmultimodal-research-agent. Python
★ 3gemma-mcp. MCP Client for Gemma-3
★ 15TTSizer. 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets
★ 142memvid. Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
★ 16kgpt-fast. Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
★ 6.2kcircuit-tracer. Python
★ 2.9krules-for-ai. Tutorials are for humans, rules are for AI!
★ 2sie. Open-source inference server and production cluster for all the models your agent needs.
★ 2.1kopenevolve. Open-source implementation of AlphaEvolve
★ 6.7ktrain-llm-from-scratch. A straightforward method for training your LLM, from downloading data to generating text.
★ 8.2kForkUnion. Lower-latency OpenMP-style minimalistic scoped thread-pool designed for 'Fork-Join' parallelism in Rust and C++, avoiding memory allocations, mutexes, CAS-primitives, and false-sharing on the hot path 🍴
★ 335gen-ai-livestream. Jupyter Notebook
★ 184nanoDeepResearch. A Deep Research agent from scratch
★ 221browserbee. 🐝 AI-powered browser assistant ("Cline for web browsing")
★ 980codeflash. Coding super-intelligence to find the most optimized Python code. Use it to optimize existing codebases or new Pull requests as a GitHub Action or a VS Code Extension.
★ 250llm-food. Serving files for hungry LLMs
★ 26toydb. Distributed SQL database in Rust, written as an educational project
★ 7.3kPaper2Code. Paper2Code: Automating Code Generation from Scientific Papers in Machine Learning
★ 4.8kEvoTune. Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
★ 140opencode. A powerful AI coding agent. Built for the terminal.
★ 13kdia. A TTS model capable of generating ultra-realistic dialogue in one pass.
★ 19kflaxattention. Python
★ 29cocoindex. Incremental engine for long horizon agents 🌟 Star if you like it!
★ 11kDFloat11. DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
★ 640scaling-book. Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
★ 1.3kYoutube_demos. All the demos in my Youtube Channel: Yeyu Lab
★ 384GenAI_Agents. 50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.
★ 23kflashT5. A fast implementation of T5/UL2 in PyTorch using Flash Attention
★ 116diffusion-vs-ar. [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
★ 94pydoll. Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
★ 6.9kferrules. Modern, fast, document parser written in 🦀
★ 611OpenManus. No fortress, purely open ground. OpenManus is Coming.
★ 57kCommonLoopUtils. CLU lets you write beautiful training loops in JAX.
★ 369jaxgarden. A collection of reusable, high-performance, well-documented, thorough-tested layers and models in Jax
★ 23NeuralFlow. Visualize the intermediate output of Mistral 7B
★ 395DiffuLLaMA. [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
★ 399olmocr. Toolkit for linearizing PDFs for LLM datasets/training
★ 19kvibe_coder. Voice assistant for VS Code
★ 71SMDM. Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"
★ 383ggwave. Tiny data-over-sound library
★ 7.7kgibberlink. Two conversational AI agents switching from English to sound-level protocol after confirming they are both AI agents
★ 4.9kaibrix. Cost-efficient and pluggable Infrastructure components for GenAI inference
★ 5kopen-gemini-deep-research. Python
★ 240Moonlight. Muon is Scalable for LLM Training
★ 1.5kimscore. Minimal Differentiable Image Reward Functions
★ 119GOT-OCR2.0. Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model
★ 8.1kLLaDA. Official PyTorch implementation for "Large Language Diffusion Models"
★ 3.9kapprise. Apprise - Push Notifications that work with just about every platform!
★ 17kaudiobox-aesthetics. Unified automatic quality assessment for speech, music, and sound.
★ 738ktransformers. A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
★ 17kmlstm_kernels. Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
★ 89deep-research-py. save 200 a month and use deep research right in your terminal. - port of https://github.com/dzhng/deep-research but in python
★ 423potpie. Context Graph for AI Native SDLC
★ 5.5kproduction-stack. vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
★ 2.4kopen-tasks. Let LLMs schedule tasks for you and itself
★ 11open-thoughts. Fully open data curation for reasoning models
★ 2.3kopen-r1. Fully open reproduction of DeepSeek-R1
★ 26kNumKong. SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types — from 6-bit floats to 64-bit complex — across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go 📐
★ 1.8kless_slow.py. Playing around "Less Slow" coding practices in Python, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines
★ 125liburing. Library providing helpers for the Linux kernel io_uring support
★ 2titans-pytorch. Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch
★ 2kdatafusion. Apache DataFusion SQL Query Engine
★ 9kgline-rs. Inference engine for GLiNER models, in Rust
★ 151waste-oil-collection-management. JavaScript
★ 1taichi. Productive, portable, and performant GPU programming in Python.
★ 28kconcurrentqueue. A fast multi-producer, multi-consumer lock-free concurrent queue for C++11
★ 12kletsearch. A vector DB so easy, even your grandparents can build a RAG system 😁
★ 25letsearch-client. Python client for letsearch — vector DB so easy, even your grandparents can build a RAG system 😁
★ 3reqwest. An easy and powerful Rust HTTP Client
★ 12kFreeze-Omni. ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
★ 387Liger-Kernel. Efficient Triton Kernels for LLM Training
★ 6.5kcodon. A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support
★ 17kpodcastfy. An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI
★ 6.4kextractous. Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
★ 1.8kvector. A high-performance observability data pipeline.
★ 22kTokenFormer. [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
★ 593OuteTTS. Interface for OuteTTS models.
★ 1.4kFreeVC. FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversion
★ 713gpu.cpp. A lightweight library for portable low-level GPU computation using WebGPU.
★ 4kneural-speed. An innovative library for efficient LLM inference via low-bit quantization
★ 352unet.cu. UNet diffusion model in pure CUDA
★ 661llm.c. LLM training in simple, raw C/CUDA
★ 31kBend. A massively parallel, high-level programming language
★ 20kMedical-RAG. Jupyter Notebook
★ 2medical-qa. Jupyter Notebook
★ 1quiet-star. Code for Quiet-STaR
★ 738burn. Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
★ 16kcalm. CUDA/Metal accelerated language model inference
★ 645luminal. Inference at the speed of light.
★ 2.9kflashinfer. FlashInfer: Kernel Library for LLM Serving
★ 5.9kUFO. UFO³: Weaving the Digital Agent Galaxy
★ 9.3kGPTFast. Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
★ 684tensorrtllm_backend. The Triton TensorRT-LLM Backend
★ 937TransformerEngine. A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
★ 3.4kPALO. (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.
★ 85space. Unified storage framework for the entire machine learning lifecycle
★ 155gemma.cpp. lightweight, standalone C++ inference engine for Google's Gemma models.
★ 7kLWM. Large World Model -- Modeling Text and Video with Millions Context
★ 7.4kminbpe. Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
★ 11kmetavoice-src. Foundational model for human-like, expressive TTS
★ 4.2klectures. Material for gpu-mode lectures
★ 6.3kgpt-crawler. Crawl a site to generate knowledge files to create your own custom GPT from a URL
★ 22kmini-lsm. A course of building an LSM-Tree storage engine (database) in a week.
★ 4.1kTaskingAI. The open source platform for AI-native application development.
★ 5.4kc_std. Implementation of C++ standard libraries in C
★ 1.2kGenerativeAIExamples. Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
★ 4.1kgpt-researcher. An autonomous agent that conducts deep research on any data using any LLM providers
★ 28kTensorRT-LLM. TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
★ 14kmoondream. tiny vision language model
★ 9.8kDepth-Anything. [CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation
★ 8.1kmarker. Convert PDF to markdown + JSON quickly with high accuracy
★ 37kMobileVLM. Strong and Open Vision Language Assistant for Mobile Devices
★ 1.4kinfinity. The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
★ 4.6kchai. Modern embedded SQL database
★ 1.7k