Skip to content

🍋 Lemonade Server Models

This document provides the models we recommend for use with Lemonade Server. Click on any model to learn more details about it, such as the Lemonade Recipe used to load the model.

Model Management GUI

Lemonade Server offers a model management GUI to help you see which models are available, install new models, and delete models. You can access this GUI by starting Lemonade Server, opening http://localhost:8000 in your web browser, and clicking the Model Management tab.

Naming Convention

The format of each Lemonade name is a combination of the name in the base checkpoint and the backend where the model will run. So, if the base checkpoint is meta-llama/Llama-3.2-1B-Instruct, and it has been optimized to run on Hybrid, the resulting name is Llama-3.2-3B-Instruct-Hybrid.

Model Storage and Management

Lemonade Server relies on Hugging Face Hub to manage downloading and storing models on your system. By default, Hugging Face Hub downloads models to C:\Users\YOUR_USERNAME\.cache\huggingface\hub.

For example, the Lemonade Server Llama-3.2-3B-Instruct-Hybrid model will end up at C:\Users\YOUR_USERNAME\.cache\huggingface\hub\models--amd--Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid. If you want to uninstall that model, simply delete that folder.

You can change the directory for Hugging Face Hub by setting the HF_HOME or HF_HUB_CACHE environment variables.

Installing Additional Models

Once you've installed Lemonade Server, you can install any model on this list using the pull command in the lemonade-server CLI.

Example:

lemonade-server pull Qwen2.5-0.5B-Instruct-CPU

Note: lemonade-server is a utility that is added to your PATH when you install Lemonade Server with the GUI installer. If you are using Lemonade Server from a Python environment, use the lemonade-server-dev pull command instead.

Supported Models

Hybrid

Llama-3.2-1B-Instruct-Hybrid 
lemonade-server pull Llama-3.2-1B-Instruct-Hybrid
KeyValue
Checkpointamd/Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Recipeoga-hybrid
Llama-3.2-3B-Instruct-Hybrid 
lemonade-server pull Llama-3.2-3B-Instruct-Hybrid
KeyValue
Checkpointamd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Recipeoga-hybrid
Phi-3-Mini-Instruct-Hybrid 
lemonade-server pull Phi-3-Mini-Instruct-Hybrid
KeyValue
Checkpointamd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Recipeoga-hybrid
Qwen-1.5-7B-Chat-Hybrid 
lemonade-server pull Qwen-1.5-7B-Chat-Hybrid
KeyValue
Checkpointamd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp16-onnx-hybrid
Recipeoga-hybrid
DeepSeek-R1-Distill-Llama-8B-Hybrid 
lemonade-server pull DeepSeek-R1-Distill-Llama-8B-Hybrid
KeyValue
Checkpointamd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead-onnx-hybrid
Recipeoga-hybrid
Labelsreasoning
DeepSeek-R1-Distill-Qwen-7B-Hybrid 
lemonade-server pull DeepSeek-R1-Distill-Qwen-7B-Hybrid
KeyValue
Checkpointamd/DeepSeek-R1-Distill-Qwen-7B-awq-asym-uint4-g128-lmhead-onnx-hybrid
Recipeoga-hybrid
Labelsreasoning
Mistral-7B-v0.3-Instruct-Hybrid 
lemonade-server pull Mistral-7B-v0.3-Instruct-Hybrid
KeyValue
Checkpointamd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
Recipeoga-hybrid
Llama-3.1-8B-Instruct-Hybrid 
lemonade-server pull Llama-3.1-8B-Instruct-Hybrid
KeyValue
Checkpointamd/Llama-3.1-8B-Instruct-awq-asym-uint4-g128-lmhead-onnx-hybrid
Recipeoga-hybrid
Llama-xLAM-2-8b-fc-r-Hybrid 
lemonade-server pull Llama-xLAM-2-8b-fc-r-Hybrid
KeyValue
Checkpointamd/Llama-xLAM-2-8b-fc-r-awq-g128-int4-asym-bfp16-onnx-hybrid
Recipeoga-hybrid

CPU

Qwen2.5-0.5B-Instruct-CPU 
lemonade-server pull Qwen2.5-0.5B-Instruct-CPU
KeyValue
Checkpointamd/Qwen2.5-0.5B-Instruct-quantized_int4-float16-cpu-onnx
Recipeoga-cpu
Phi-3-Mini-Instruct-CPU 
lemonade-server pull Phi-3-Mini-Instruct-CPU
KeyValue
Checkpointamd/Phi-3-mini-4k-instruct_int4_float16_onnx_cpu
Recipeoga-cpu
Qwen-1.5-7B-Chat-CPU 
lemonade-server pull Qwen-1.5-7B-Chat-CPU
KeyValue
Checkpointamd/Qwen1.5-7B-Chat_uint4_asym_g128_float16_onnx_cpu
Recipeoga-cpu
DeepSeek-R1-Distill-Llama-8B-CPU 
lemonade-server pull DeepSeek-R1-Distill-Llama-8B-CPU
KeyValue
Checkpointamd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead-onnx-cpu
Recipeoga-cpu
Labelsreasoning
DeepSeek-R1-Distill-Qwen-7B-CPU 
lemonade-server pull DeepSeek-R1-Distill-Qwen-7B-CPU
KeyValue
Checkpointamd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead-onnx-cpu
Recipeoga-cpu
Labelsreasoning

GGUF

Qwen3-0.6B-GGUF 
lemonade-server pull Qwen3-0.6B-GGUF
KeyValue
Checkpointunsloth/Qwen3-0.6B-GGUF
GGUF VariantQ4_0
Recipellamacpp
Labelsreasoning
Qwen3-1.7B-GGUF 
lemonade-server pull Qwen3-1.7B-GGUF
KeyValue
Checkpointunsloth/Qwen3-1.7B-GGUF
GGUF VariantQ4_0
Recipellamacpp
Labelsreasoning
Qwen3-4B-GGUF 
lemonade-server pull Qwen3-4B-GGUF
KeyValue
Checkpointunsloth/Qwen3-4B-GGUF
GGUF VariantQ4_0
Recipellamacpp
Labelsreasoning
Qwen3-8B-GGUF 
lemonade-server pull Qwen3-8B-GGUF
KeyValue
Checkpointunsloth/Qwen3-8B-GGUF
GGUF VariantQ4_1
Recipellamacpp
Labelsreasoning
DeepSeek-Qwen3-8B-GGUF 
lemonade-server pull DeepSeek-Qwen3-8B-GGUF
KeyValue
Checkpointunsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
GGUF VariantQ4_1
Recipellamacpp
Labelsreasoning
Qwen3-14B-GGUF 
lemonade-server pull Qwen3-14B-GGUF
KeyValue
Checkpointunsloth/Qwen3-14B-GGUF
GGUF VariantQ4_0
Recipellamacpp
Labelsreasoning
Qwen3-30B-A3B-GGUF 
lemonade-server pull Qwen3-30B-A3B-GGUF
KeyValue
Checkpointunsloth/Qwen3-30B-A3B-GGUF
GGUF VariantQ4_0
Recipellamacpp
Labelsreasoning
Gemma-3-4b-it-GGUF 
lemonade-server pull Gemma-3-4b-it-GGUF
KeyValue
Checkpointggml-org/gemma-3-4b-it-GGUF
GGUF VariantQ4_K_M
Mmprojmmproj-model-f16.gguf
Recipellamacpp
Labelsvision
Qwen2.5-VL-7B-Instruct-GGUF 
lemonade-server pull Qwen2.5-VL-7B-Instruct-GGUF
KeyValue
Checkpointggml-org/Qwen2.5-VL-7B-Instruct-GGUF
GGUF VariantQ4_K_M
Mmprojmmproj-Qwen2.5-VL-7B-Instruct-f16.gguf
Recipellamacpp
Labelsvision
Llama-4-Scout-17B-16E-Instruct-GGUF 
lemonade-server pull Llama-4-Scout-17B-16E-Instruct-GGUF
KeyValue
Checkpointunsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
GGUF VariantQ4_K_S
Mmprojmmproj-F16.gguf
Recipellamacpp
Labelsvision
nomic-embed-text-v1-GGUF 
lemonade-server pull nomic-embed-text-v1-GGUF
KeyValue
Checkpointnomic-ai/nomic-embed-text-v1-GGUF
GGUF VariantQ4_K_S
Recipellamacpp
Labelsembeddings
nomic-embed-text-v2-moe-GGUF 
lemonade-server pull nomic-embed-text-v2-moe-GGUF
KeyValue
Checkpointnomic-ai/nomic-embed-text-v2-moe-GGUF
GGUF VariantQ8_0
Recipellamacpp
Labelsembeddings
bge-reranker-v2-m3-GGUF 
lemonade-server pull bge-reranker-v2-m3-GGUF
KeyValue
Checkpointpqnet/bge-reranker-v2-m3-Q8_0-GGUF
Recipellamacpp
Labelsreranking
Devstral-Small-2507-GGUF 
lemonade-server pull Devstral-Small-2507-GGUF
KeyValue
Checkpointmistralai/Devstral-Small-2507_gguf
GGUF VariantQ4_K_M
Recipellamacpp
Qwen2.5-Coder-32B-Instruct-GGUF 
lemonade-server pull Qwen2.5-Coder-32B-Instruct-GGUF
KeyValue
CheckpointQwen/Qwen2.5-Coder-32B-Instruct-GGUF
GGUF VariantQ4_K_M
Recipellamacpp
Labelsreasoning