awesome-gpu-engineering. GPU Engineering for AI Systems
542awesome-observability. A curation of some of the best tools, resources, frameworks on LLM observability
7nexus-workshop-code. Code for Packt's Nexus Workshop on Building Agents using CrewAI
4RelayServe. Minimal LLM inference gateway
3llmops-brief-tutorials. Tutorials on LLMOps by Andy McMahon and Abi Aryan
2inferencing_maven. Jupyter Notebook
2architecting-ai. Book Companion for Architecting AI Book by Abi Aryan
1smol_vllm. A minimal vllm to learn how inference engines work
1ray_project. Student exercise on concurrency and profiling
1