oobabooga

textgen. Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

textgen-extensions.

one-click-installers. Simplified installers for oobabooga/text-generation-webui.

GPTQ-for-LLaMa. 4 bits quantization of LLaMa using GPTQ

oobabooga.github.io. HTML

flash-attention. Fast and memory-efficient exact attention - Windows wheels

llama-cpp-python-cuBLAS-wheels. Wheels for llama-cpp-python compiled with cuBLAS support

stable-diffusion-ui. Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image.

llm-tools. Various scripts for working with local LLMs

llama-cpp-binaries. llama.cpp server in a Python wheel.

AI-Notebooks. Jupyter Notebook

SillyTavern. LLM Frontend for Power Users.

audiocraft-infinity-webui. Python

EasyLM. Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

stable-diffusion-automatic. Stable Diffusion web UI

roop. one-click deepfake (face swap)

transformers. 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

exllamav2. A fast inference library for running LLMs locally on modern consumer-class GPUs

FlexGen. Running large language models on a single GPU for throughput-oriented scenarios.

gradio. Create UIs for your machine learning model in Python in 3 minutes

llama-cpp-python-basic. Python bindings for llama.cpp

torch-grammar. Python

character-editor. Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI

chatbot-ui. An open source ChatGPT UI.

simple_memory. An extension to Oobabooga to add a simple memory function for chat

quip-sharp. Python

alpaca_lora_4bit. Python

ChatRWKV. ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

stanford_alpaca. Code and documentation to train Stanford's Alpaca models, and generate the data.

screenshots.

bitsandbytes-windows-webui. Windows compile of bitsandbytes for use in text-generation-webui.

stable-diffusion-webui. Stable Diffusion web UI

whisper. Robust Speech Recognition via Large-Scale Weak Supervision

alpaca-lora. Instruct-tuning LLaMA on consumer hardware

AutoGPTQ. An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

pytorch-to-safetensor-converter. A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.

minigpt-4-pipeline. Python

llama. Inference code for LLaMA models

peft. 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

oobabooga-one-click-bandaid. A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda

GPTQ-for-LLaMa-CUDA. A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.

gptq. Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

AutoAWQ. AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

llama.cpp. Port of Facebook's LLaMA model in C/C++

g-diffuser-bot. Discord bot for diffusers (Stable Diffusion)

exllamav3. An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

test-repo.

GPTQ-for-LLaMa-Wheels. Precompiled Wheels for GPTQ-for-LLaMa

llamacpp-python. Python bindings for llama.cpp

mtj-softtuner. Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance

BlockMerge_Gradient. Merge Transformers language models by use of gradient parameters.

stable-diffusion-hlhl. Jupyter Notebook

llama-cpp-wrapper.

AutoAWQ_kernels. Cuda

bitsandbytes. 8-bit CUDA functions for PyTorch

oobabooga.