Getting Started with Lemonade Server
🍋 Lemonade Server is a server interface that uses the standard Open AI API, allowing applications to integrate with local LLMs. This means that you can easily replace cloud-based LLMs with private and free LLMs that run locally on your own PC's NPU and GPU.
Lemonade Server is available as a standalone tool with a one-click Windows GUI installer.
Once you've installed, we recommend checking out these resources:
Documentation | Description |
---|---|
Supported Applications | Explore applications that work out-of-the-box with Lemonade Server. |
Lemonade Server Concepts | Background knowledge about local LLM servers and the OpenAI standard. |
lemonade-server CLI Guide |
Learn how to manage the server process and install new models using the command-line interface. |
Models List | Browse a curated set of LLMs available for serving. |
Server Spec | Review all supported OpenAI-compatible and Lemonade-specific API endpoints. |
Integration Guide | Step-by-step instructions for integrating Lemonade Server into your own applications. |
Note: if you want to develop Lemonade Server itself, you can install from source.