Driss Guessous

transformer_nuggets. A place to store reusable transformer components of my own creation or found on the interwebs

driss_torch. Cuda extensions for PyTorch

simple_cuda. Learnings + Exercises from the PMPP book!

lean_ua. Lean 4 formalizations of proofs from Stephen Abbott's Understanding Analysis textbook

attention-gym. Helpful tools and examples for working with flex-attention

pytorch. Tensors and Dynamic neural networks in Python with strong GPU acceleration

drisspg.

hw1.

helm. Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

lit-gpt. Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.