Get up and running with large language models locally on macOS, Linux, and Windows via a lightweight CLI and OpenAI-compatible API.
- β 100% offline data privacyβzero prompts, files, or embeddings ever leave your local machine
- β Built-in OpenAI-compatible API allows drop-in integration with Cursor, LibreChat, and LangChain