lemonade

Lemonade Server Examples

Many applications today utilize OpenAI models like ChatGPT through APIs such as:

POST https://api.openai.com/v1/chat/completions

This API call triggers the ChatGPT model to generate responses for a chat. With Lemonade Server, we are replacing the OpenAI endpoint with a local LLM. The new API call becomes:

POST http://localhost:8000/api/v1/chat/completions

This allows the same application to leverage local LLMs instead of relying on OpenAI’s cloud-based models. The guides in this folder show how to connect Lemonade Server to popular applications to enable local LLM execution. To run these examples, you’ll need a Windows PC.

🎥 Video Tutorials

Links to the video tutorials available are provided in the third column of the following table.
App Guide Video
Open WebUI How to chat with Lemonade LLMs in Open WebUI Watch Demo
Continue How to use Lemonade LLMs as a coding assistant in Continue Watch Demo
Microsoft AI Toolkit Experimenting with Lemonade LLMs in VS Code using Microsoft’s AI Toolkit Watch Demo
GAIA An application for running LLMs locally, includes a ChatBot, YouTube Agent, and more Watch Demo
CodeGPT How to use Lemonade LLMs as a coding assistant in CodeGPT coming soon
MindCraft How to use Lemonade LLMs as a Minecraft agent coming soon
wut Terminal assistant that uses Lemonade LLMs to explain errors coming soon
AnythingLLM Running agents locally with Lemonade and AnythingLLM coming soon
lm-eval A unified framework to test generative language models on a large number of different evaluation tasks. coming soon
PEEL Using Local LLMs in Windows PowerShell coming soon

📦 Looking for Installation Help?

To set up Lemonade Server, check out the Lemonade Server guide for installation instructions and the server spec to learn more about the functionality. For more information about 🍋 Lemonade SDK, see the Lemonade SDK README.

🛠️ Support

If you encounter any issues or have questions, feel free to:

💡 Want to Add an Example?

If you’ve connected Lemonade to a new application, feel free to contribute a guide by following our contribution guide found here or let us know at [email protected].

This site is open source. Improve this page.