← All Models

Llama 3.2 3B

•

Meta

llama

The new and small Llama model from Meta, optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks.

Model info

Model

Llama 3.2 3B

Author

Meta

Repository

🤗 hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF↗

Arch

llama

Parameters

3B

Format

gguf

Size on disk

about 3.42 GB

Download and run Llama 3.2 3B

Open in LM Studio to view download options

Download llama-3.2-3b from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get llama-3.2-3b

Call llama-3.2-3b from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.2-3b",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more