Text Generation Web UI

Text Generation Web UI (commonly called oobabooga) is a popular open-source Gradio-based interface for running large language models locally. It supports a wide range of model loaders including GPTQ, GGUF, AWQ, and ExLlamaV2, and provides features like chat mode, notebook mode, extensions, and LoRA fine-tuning. It is one of the most versatile and widely-used self-hosted LLM interfaces in the open-source community.

Threads