LiteRT-LM CLI

The Command Line Interface (CLI) lets you run .litertlm models on Linux, macOS, Windows, or Raspberry Pi.

Overview of CLI Capabilities

The LiteRT-LM CLI is a powerful tool for interacting with local LLMs. It supports:

• Quick Installation: Run on-demand with uvx or install permanently using uv or pip . See Installation .
• Interactive Chat: Run models in an interactive chat session. See Usage .
• Advanced Capabilities: Optimize and extend your models with Multi-Token Prediction , Multi-modality attachments, and Function Calling .
• OpenAI-Compatible Server: Start a local server that emulates OpenAI endpoints. See OpenAI-Compatible Server .

To get started, proceed to the Installation guide.