Blog 👾

Inference speed up with Speculative Decoding for llama.cpp and MLX

Idle TTL, auto-update for runtimes, support for nested folders in HF repos, and separate reasoning_content in chat completion responses

Run DeepSeek R1 models locally and offline on your computer

Thinking UI for DeepSeek R1, LaTeX rendering improvements, and bug fixes

DeepSeek R1 support and KV Cache quantization for llama.cpp models

Tool Calling API in beta, new installer / updater system, and support for Qwen2VL and QVQ (both GGUF and MLX)

An open source utility for packaging Python applications and all their dependencies into a portable, deterministic format based on Python's sitecustomize.py.

Headless mode, on-demand model loading, server auto-start, CLI command to download models from the terminal, and support for Pixtral with Apple MLX.

Super fast and efficient on-device LLM inferencing using MLX for Apple Silicon Macs.

Config presets are back! So are live token counts for user input and system prompt. Many bug fixes. Also several new app languages thanks to community contributors.

LM Studio 0.3.2 Release Notes

LM Studio 0.3.1 Release Notes

LM Studio 0.3.0 is here! Built-in (naïve) RAG, light theme, internationalization, Structured Outputs API, Serve on the network, and more.

Run Llama 3.1 locally on your computer with LM Studio.

A command line tool for scripting and automating your local LLM workflows.