← All Models

SmolLM 360M v0.2

•

HuggingFace

llama

A HuggingFace original model, SmolLM lives up to its name in size and will fit on just about any device. Slightly larger option at 1.7B parameters is also available.

Model info

Model

SmolLM 360M v0.2

Author

HuggingFace

Repository

🤗 HuggingFaceTB/smollm-360M-instruct-v0.2-Q8_0-GGUF↗

Arch

llama

Parameters

360M

Format

gguf

Size on disk

about 386.41 MB

Download and run SmolLM 360M v0.2

Open in LM Studio to view download options

Download smollm-360m from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get smollm-360m
If you don't have it yet, get it by running npx lmstudio install-cli

Call smollm-360m from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "smollm-360m",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more