LocalAI

LocalAI is a free, open-source alternative to OpenAI's API that runs entirely on consumer hardware without requiring a GPU. It provides an OpenAI-compatible REST API for running LLMs, image generation, audio transcription, and embeddings locally. LocalAI supports dozens of model families and is designed for privacy-focused users and developers who want to self-host AI capabilities.

Threads