Casper

AutoAWQ. AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

OpenCoconut. OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.

Flask-Stripe-MySQL-Bootstrapped. Flask template with microservices architecture. Fully integrated with Stripe 🚀

Web-Scraping-Reddit. Web scraping Reddit without using Reddit API, and making a dataset, and using the dataset for a machine learning project.

AutoAWQ_kernels. Cuda

Nested-Cross-Validation. Nested cross-validation for unbiased predictions. Can be used with Scikit-Learn, XGBoost, Keras and LightGBM, or any other estimator that implements the scikit-learn interface.

Activation-Functions-Search. Jupyter Notebook

Neural-Network-From-Scratch. NumPy - PyTorch - TensorFlow (+Keras)

model-stacking. Model stacking example on toy dataset using XGBoost, LightGBM and more, combined with mlxtend model stacking.

Tour-of-TensorFlow-2.0. Exploring operations and custom training and testing loops in TensorFlow 2.0

pmc-python. Python

GridSearchCV-with-Keras-sklearn. Jupyter Notebook

MilesPerGallonPrediction. Python

quiet-star-original. Code for Quiet-STaR

COVID-19-Detection. Jupyter Notebook

Logistic-Regression-From-Scratch. Python

CNN-From-Scratch. Building A CNN From Scratch in NumPy

worker-vllm. The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

DGQ. Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM

Statistical_Significance_Testing. Python

torchtune. PyTorch native post-training library

text-generation-webui. A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

vllm. A high-throughput and memory-efficient inference and serving engine for LLMs

smoothquant. [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

gpu_kernels. Python

Linear-Regression-From-Scratch. Python

auto-iterator. Python

inference-maxxer. maximum intelligence per watt