Refreshingly fast LLMs on
GPUs and NPUs
Install, run LLMs locally, and integrate with apps in minutes
Download
for Windows 11 Developer Setup
For Ubuntu and Windows
Lemonade is compatible with the top open-source apps!
Open WebUI Continue Gaia AnythingLLM AI Dev Gallery LM-Eval CodeGPT AI Toolkit

Latest Release

Loading latest release...

View Release
Installation Setup
Operating System Windows Linux
Installation Type Server Only Full SDK
Installation Method GUI .exe PyPI From Source
Inference Engine OGA llama.cpp PyTorch
Device Support Hybrid CPU GPU
Installation Instructions
Quick Start