# Liquid Docs

> Documentation for Liquid AI Foundation Models (LFM)

## Docs

- [Liquid Foundation Models](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/models/complete-library.md): Liquid Foundation Models (LFMs) are a new class of multimodal architectures built for fast inference and on-device deployment. Browse all available models and formats here.
- [Text Models](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/models/text-models.md): Liquid's LFM text models range from 350M to 8B parameters, delivering ultra-low-latency generation while matching the performance of much larger models. They come in both dense and MoE variants to deploy flexibly across different devices.
- [Vision Models](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/models/vision-models.md): Liquid's LFM vision models pair our lightweight LFM text backbones with SigLIP2 image encoders, delivering fast multimodal inference on-device while matching larger VLMs in quality.
- [Audio Models](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/models/audio-models.md): Liquid's LFM audio models are among the smallest fully interleaved audio/text-in, audio/text-out models with a complete reasoning backbone — eliminating the need to combine separate TTS/ASR encoders with a standalone language model.
- [Liquid Nanos](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/models/liquid-nanos.md): A library of low-latency, task-specific models fine-tuned on Liquid's multimodal LFM base models. Nanos deliver high accuracy on narrow tasks while remaining small enough to deploy on-device or serve economically at high volume.
- [Chat Template](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/key-concepts/chat-template.md): The chat template defines how conversations are structured using special tokens and roles. LFM2 uses a ChatML-like chat template to structure conversations as follows:
- [Prompting Guide](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/key-concepts/text-generation-and-prompting.md): This guide covers how to effectively use system prompts, user prompts, and assistant prompts with LFM2 models, along with an overview of sampling parameters and special prompting recipes for specific models.
- [Tool Use](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/key-concepts/tool-use.md): LFM2.5 and LFM2 models support tool use (function calling), enabling models to interact with APIs, databases, and external services to provide accurate, up-to-date information.
- [Vision Capabilities](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/key-concepts/vision-capabilities.md): Use LFM2.5-VL models for image understanding, multi-image prompting, OCR, layout annotations, grounding, and vision-guided tool calling.
- [Overview](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/fine-tuning/overview.md): Decide when to fine-tune an LFM and choose the right training workflow.
- [LEAP Finetune](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/fine-tuning/leap-finetune.md): Prepare data, train, evaluate, and export customized Liquid Foundation Models with LEAP Finetune.
- [Datasets](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/fine-tuning/datasets.md): Dataset formats for SFT, DPO, and VLM fine-tuning
- [TRL](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/fine-tuning/trl.md): TRL (Transformer Reinforcement Learning) is a library for fine-tuning and aligning language models using methods like Supervised Fine-Tuning (SFT), Reward Modeling, and Direct Preference Optimization (DPO).
- [Unsloth](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/fine-tuning/unsloth.md): Unsloth makes fine-tuning LLMs 2-5x faster with 70% less memory through optimized kernels and efficient memory management.
- [Overview](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/overview.md)
- [llama.cpp](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/llama-cpp.md): llama.cpp is a C++ library for efficient LLM inference with minimal dependencies. It's designed for CPU-first inference with cross-platform support.
- [LM Studio](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/lm-studio.md): LM Studio is a desktop application for running LLMs locally with a graphical interface.
- [MLX](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/mlx.md): MLX is Apple's machine learning framework optimized for Apple Silicon. It provides efficient inference on Mac devices with M-series chips (M1, M2, M3, M4) using Metal acceleration for GPU computing.
- [ONNX](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/onnx.md): ONNX provides a platform-agnostic inference specification that allows running the model on device-specific runtimes that include CPU, GPU, NPU, and WebGPU.
- [Ollama](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/ollama.md): Ollama is a command-line tool for running LLMs locally with a simple interface. It provides easy model management and serving with an OpenAI-compatible API.
- [Transformers](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/gpu-inference/transformers.md): Transformers is a library for inference and training of pretrained models.
- [SGLang](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/gpu-inference/sglang.md): Serve LFM2.5 with SGLang, a low-latency OpenAI-compatible serving framework. The full recipe, verified on real hardware, lives in the SGLang cookbook.
- [vLLM](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/gpu-inference/vllm.md): Serve LFM2.5 with vLLM, a high-throughput OpenAI-compatible inference engine. The full recipe, verified on real hardware, lives in the vLLM cookbook.
- [Modal](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/gpu-inference/modal.md): Modal is a serverless cloud platform for running AI/ML workloads with instant autoscaling on GPUs and CPUs.
- [Baseten](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/gpu-inference/baseten.md): Baseten is an AI infrastructure platform for deploying and serving ML models with optimized inference, autoscaling, and multi-cloud support.
- [Fal](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/gpu-inference/fal.md): Fal is a serverless generative media platform offering lightning-fast inference for AI models for image, video, and audio generation.
- [Hardware Evaluation](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/guides/hardware-evaluation.md): Profile Liquid Foundation Models for latency, throughput, and memory on your target hardware.
- [Use Case Evaluation](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/guides/use-case-evaluation.md): Evaluate LFMs as drop-in replacements for an existing application or workflow.
- [Migration Guide](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/guides/migration-guide.md): Move from Qwen, Llama, or Gemma to LFMs while avoiding the common migration pitfalls.
- [FAQs](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/help/faqs.md): Frequently asked questions about LFM models and deployment.
- [Troubleshooting](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/help/troubleshooting.md): Common issues and solutions when working with LFM models.
- [Deprecations](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/help/deprecations.md): Deprecated Liquid Foundation Models and their recommended replacements. Deprecated models remain available for download but are no longer actively maintained or recommended for new projects.
- [Contributing to Docs](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/help/contributing.md): Guidelines for contributing to Liquid AI documentation.
- [Connect AI Tools](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/help/connect-ai-tools.md): Connect your AI coding tools to Liquid Docs via MCP for live, queryable access to documentation
- [Model License](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/lfm/help/model-license.md): Understand how you can use, modify, and distribute Liquid Foundation Models under the LFM Open License v1.0.
- [Quick Start](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/quick-start.md): Install the LEAP SDK on iOS, macOS, Android, JVM, Linux, or Windows — same API everywhere.
- [AI Agent Usage Guide](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/ai-agent-usage-guide.md): End-to-end recipes for building AI agents with the LEAP SDK — same patterns across iOS, macOS, Android, JVM, and native.
- [Model Loading](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/model-loading.md): Reference for ModelDownloader, LeapDownloader, loadModel, loadSimpleModel, and KV cache reuse.
- [Conversation & Generation](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/conversation-generation.md): Reference for ModelRunner, Conversation, MessageResponse, and GenerationOptions — same API on every platform.
- [Messages & Content](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/messages-content.md): ChatMessage, ChatMessageContent, audio format requirements — same shape on every platform.
- [Function Calling](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/function-calling.md): Tool use with LeapFunction — same API on every platform, with Hermes and Pythonic parsers.
- [Constrained Generation](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/constrained-generation.md): Generate structured JSON output with compile-time validation — same approach on every platform.
- [Advanced Features](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/advanced-features.md): GenerationOptions, JSONSchemaGenerator, function-calling type references — same surface everywhere.
- [Utilities](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/utilities.md): Error handling, serialization, Android-specific downloader internals, and a putting-it-together example.
- [Voice Assistant Widget](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/voice-assistant.md): Drop-in Compose Multiplatform voice UI — runs on iOS, macOS, Android, and JVM Desktop.
- [OpenAI-Compatible Client](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/openai-client.md): Lightweight client for OpenAI-compatible chat completions APIs — ideal for hybrid on-device + cloud routing.
- [Cloud AI Comparison](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/cloud-ai-comparison.md): Mapping LEAP SDK concepts to cloud chat-completion APIs like OpenAI.
- [Desktop & Native Platforms](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/sdk/desktop-platforms.md): Run the LEAP SDK on JVM desktop, native Linux, native Windows, and macOS — same API as Android and iOS.
- [Changelog](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/on-device/leap-sdk-changelog.md): Release notes for the LEAP SDK, including the 0.9.x → 0.10.x Kotlin Multiplatform transition.
- [Quick Start](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/quick-start.md): The Bundling Service helps users create and manage model bundles for Liquid Edge AI Platform (LEAP). Currently users interact with it through a command-line interface (CLI).
- [Authentication](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/authentication.md): Authentication commands for the LEAP Bundle CLI
- [Configuration](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/configuration.md): Configuration commands and file format for the LEAP Bundle CLI
- [Bundle Creation](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/bundle-creation.md): Commands for creating and validating bundle requests in the LEAP Bundle CLI
- [Bundle Management](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/bundle-management.md): Commands for listing and canceling bundle requests in the LEAP Bundle CLI
- [Download](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/download.md): Download commands for bundle requests and LEAP models in the LEAP Bundle CLI
- [Reference](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/reference.md): Reference information for the LEAP Bundle CLI including limitations, error handling, and exit codes
- [Data Privacy](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/data-privacy.md): This page outlines how the LEAP Model Bundling Service handles your data, what information we collect and delete.
- [Changelog](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/deployment/tools/model-bundling/changelog.md)
- [Examples Library](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/index.md)
- [Connect AI Tools](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/connect-ai-tools.md): Connect your AI coding tools to Liquid Docs via MCP for live, queryable access to documentation
- [Run local agents with LFMs](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/agent-harnesses.md): Run local agents with LFMs by connecting a locally served model to agent harnesses like Hermes Agent, OpenClaw, and Pi.
- [Invoice extractor tool](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/invoice-extractor-tool-with-liquid-nanos.md)
- [Audio transcription in real-time](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/audio-to-text-in-real-time.md)
- [Bidirectional English to Korean translation CLI](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/lfm2-english-to-korean.md)
- [Flight search assistant with tool calling](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/flight-search-assistant.md)
- [Audio car cockpit demo](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/audio-car-cockpit.md)
- [Meeting summarization CLI](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/meeting-summarization.md)
- [Browser control with GRPO reinforcement learning](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/laptop-examples/browser-control.md)
- [Product Slogan Generator with LeapSDK](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/android/slogan-generator.md)
- [Web Content Summarizer for Android](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/android/web-content-summarizer.md)
- [Generate Structured Recipes with Constrained Output](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/android/recipe-generator-constrained-output.md)
- [Image Understanding with Vision Language Models](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/android/vision-language-model-example.md)
- [Build AI Agents with Koog Framework on Android](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/android/leap-koog-agent.md)
- [Real-time video captioning with LFM2.5-VL-1.6B and WebGPU](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/web/vl-webgpu-demo.md)
- [LFM2.5-Audio browser demo with WebGPU](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/web/audio-webgpu-demo.md)
- [Hand & Voice Racer](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/web/hand-voice-racer.md)
- [Fine tuning LFM2-VL to identify car makers from images](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/customize-models/car-maker-identification.md)
- [Fine-tuning LFM for a local Home Assistant](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/customize-models/home-assistant.md)
- [Fine-Tune a Vision-Language Model on Satellite Imagery](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/customize-models/satellite-vlm.md)
- [Build a Wildfire Prevention System with a Compact VLM](https://liquidai-deprecate-lfm2-2-6b.mintlify.site/examples/customize-models/wildfire-prevention.md)