ssd-llm. Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac

github.com/quantumnic/ssd-llm

Problem

Audience

Updates

No founder updates yet. Check back soon.