tokenvm. TokenVM is a high-performance runtime that treats LLM KV cache and activations as a virtual memory working set across GPU VRAM → pinned host RAM → NVMe storage, with intelligent paging, prefetching, and compute-copy overlap.

github.com/Siddhant-K-code/tokenvm

Problem

Audience

Updates

No founder updates yet. Check back soon.