•
internlm2
InternLM 2.5 offers strong reasoning across the board as well as tool use for developers, while sitting at the sweet spot of size for those with 24GB GPUs.
Model info
Model
InternLM 2.5 20B
Author
InternLM
Repository
Arch
internlm2
Parameters
20B
Format
gguf
Size on disk
about 7.55 GB
Download the model using lms
— LM Studio's developer CLI.
lms get internlm2.5-20b
curl http://localhost:1234/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "internlm2.5-20b",
"messages": [
{ "role": "system", "content": "Always answer in rhymes." },
{ "role": "user", "content": "Introduce yourself." }
],
"temperature": 0.7,
"max_tokens": -1,
"stream": true
}'
lms log stream
to see your prompts as they are sent to the LLM.lmstudio.js
- LM Studio SDK documentation (TypeScript)lms log stream
- Stream server logslms
- LM Studio's CLI documentation