London, San Francisco, Yerevan

Ash Vardanian

Elite
@ashvardanian

Converting outrageous amounts of coffee into modest amounts of Assembly for Intel, Arm, and Nvidia chips. @unum-cloud, @unum-bio, @aalvc, @cpp-armenia

StringZilla. Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops ๐Ÿฆ–

3.5k

less_slow.cpp. Playing around "Less Slow" coding practices in C++ 20, C, CUDA, PTX, & Assembly, from numerics & SIMD to coroutines, ranges, exception handling, networking and user-space IO

1.9k

NumKong. SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types โ€” from 6-bit floats to 64-bit complex โ€” across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go ๐Ÿ“

1.8k

ForkUnion. Lower-latency OpenMP-style minimalistic scoped thread-pool designed for 'Fork-Join' parallelism in Rust and C++, avoiding memory allocations, mutexes, CAS-primitives, and false-sharing on the hot path ๐Ÿด

334

SwiftSemanticSearch. Real-time on-device text-to-image and image-to-image Semantic Search with video stream camera capture using USearch & UForm AI Swift SDKs for Apple devices ๐Ÿ

157

StringWars. Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, edit-distances, sketching, and sorting across CPUs and GPUs in Rust ๐Ÿฆ€ and Python ๐Ÿ

148

less_slow.py. Playing around "Less Slow" coding practices in Python, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines

125

less_slow.rs. Playing around "Less Slow" coding practices in Rust, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines

125

ParallelReductionsBenchmark. Thrust, CUB, TBB, AVX2, AVX-512, CUDA, OpenCL, OpenMP, Metal, and Rust - all it takes to sum a lot of numbers fast!

119

usearch-images. Semantic Search demo featuring UForm, USearch, UCall, and StreamLit, to visual and retrieve from image datasets, similar to "CLIP Retrieval"

55

SmashTable. If only std::set was a DBMS: collection of templated ACID in-memory exception-free thread-safe and concurrent containers in a header-only library

45

RetriEval. Benchmark suite that compares vector search engines against each other on billion-scale datasets, from in-memory HNSW libraries like USearch, FAISS, & cuVS to managed databases like Qdrant, Weaviate, LanceDB, & Redis โ€“ built for reproducibility

35

PyBindToGPUs. Parallel Computing starter project to build GPU & CPU kernels in CUDA & C++ and call them from Python without a single line of CMake using PyBind11

31

StringTape. Apache Arrow-compatible space-efficient "tape" class in pure Rust to be used with StringZilla for GPU, NUMA, and disk transfers of variable length strings

31

NetworkXternal. NetworkX-like Python experience for Postgres, SQLite, MongoDB, and Neo4J

31

TinySemVer. Tiny Semantic Versioning (SemVer) library with LLMs and GitHub CI, that doesn't depend on 300K lines of JavaScript code and fits in a single Python file

28

LibSee. Link to this library and it will log all the LibC functions you are calling and how much time you are spending in them!

22

JaccardIndex. Optimizing bit-level Jaccard Index and Population Counts for large-scale quantized Vector Search via Harley-Seal CSA and Lookup Tables

22

ScalingElections. GPU-accelerated Schulze voting method in Python, Numba, CUDA, and Mojo ๐Ÿ”ฅ, using ideas from Algebraic Graph Theory

19

abusing-vector-search. Example of using Vector Search algorithms for non-traditional workloads, like GIS, stock prices, and sets

16

MongooseMiner. Documentation retrieval system to help LLMs navigate less-popular (yet often more powerful) Python libraries

14

SpaceV. Billion-scale Semantic Search dataset derived from Microsoft SpaceV for Vector Search benchmarks with smaller subsets

12

HashTableBenchmark. A simple cross-platform speed & memory-efficiency benchmark for the most common hash-table implementations in the C++ world

12

vector-dossier. Vector Dossier is a CLI tool that statically analyzes vectorization depth of programs and libraries

11

HashEvals. Minimalistic Rust toolkit for hash function quality analysis. Tests avalanche effect, differential patterns, and statistical distribution across variable-length n-grams.

10

extrapolaTED. Bringing TED experiences to every topic with Gen AI

9

TenPack. Fast Tensors Packaging library for text, image, video, and audio data compatible with PyTorch, TensorFlow, & NumPy ๐Ÿ–ผ๏ธ๐ŸŽต๐ŸŽฅ โžก๏ธ ๐Ÿง 

8

minSH. A minimal Python re-implementation of the A* with seed heuristic for exact global alignmnet (edit distance) in near-linear time

6

ucall. Remote Procedure Calls - 50x lower latency and 70x higher bandwidth than FastAPI, implementing REST & JSON-RPC over io_uring and SIMDJSON โ˜Ž๏ธ

6

acid-redis. Tiny Redis-like Persistent ACID Store on RocksDB with JSON-RPC using UCall and UStore

5

HaversineSimSIMD. Staging area for Haversine distance computations in SimSIMD and USearch

5

PolyglotBot. Bot we've build for the Poe.com hackathon at the AGI house to gather results from multiple LLMs and trigger specialized models on-demand

5

CppNeuralSTL. Simple neural network models from scratch using only C++ STL

4

USearchBench.java. Apache Spark and Unum USearch integration example benchmarking distributed Vector Search against Lucene and OpenSearch

4

VectorHub. VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

4

PyScrapeIg. Instagram scraper with proper pagination, that can collect posts, likes, comments and a lot more.

3

WolframSummer19. Quantifying the influence of urban design on quality of life.

3

xl-sum. This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.

3

usearch. Vector Search engine in a single file - supporting C++ 11, C 99, Python 3, JavaScript, Rust, Java, GoLang, Objective-C, Swift, Wolfram, Docker, and WebAssembly ๐Ÿ”

3

sentence-transformers. Multilingual Sentence & Image Embeddings with BERT

2

uform. Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and ๐Ÿ”œ video, up to 5x faster than OpenAI CLIP and LLaVA ๐Ÿ–ผ๏ธ & ๐Ÿ–‹๏ธ

2

liburing. Library providing helpers for the Linux kernel io_uring support

2

lean4. Lean 4 programming language and theorem prover

2

awesome-vector-search. Collections of vector search related libraries, service and research papers

2

kdtree-rs. K-dimensional tree in Rust for fast geospatial indexing and lookup

2

llvm-project. The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

2

open-data-registry. A registry of publicly available datasets on AWS

2

langchain. ๐Ÿฆœ๐Ÿ”— Build context-aware reasoning applications

2

usearch-langchain-js. Using USearch vector-search engine for RAG with LangChain

2

JsParseWiki. Wiki dump importer for MongoDB

1

probabilistic-collections-rs. Rust

1

nltk. NLTK Source

1

sse-popcount. SIMD (SSE) population count --- http://0x80.pl/articles/sse-popcount.html

1

conan-center-index. Recipes for the ConanCenter repository

1

oneTBB. oneAPI Threading Building Blocks (oneTBB)

1
55
Apply