AI/Ollama: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 102: | Line 102: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
|} | |} | ||
|} | |||
==Optimization== | |||
{|class='wikitable mw-collapsible' | |||
!scope='col' style='text-align:left' colspan='3'| | |||
Optimization | |||
|- | |||
!scope='col'| Variable | |||
!scope='col'| Value (Range) | |||
!scope='col'| Impact on Yoga Pro 7i | |||
|- | |||
!scope='row' style='text-align:left' | <code>OLLAMA_NUM_CTX</code> | |||
| <code>6384</code> to <code>32768</code> || '''The most important.''' Controls the "brain capacity." 32k is standard for Claude Code but uses ~3GB more RAM than the default 4k. | |||
|} | |} | ||
Revision as of 01:07, 1 March 2026
curl -fsSL https://ollama.com/install.sh | sh
ollama pull model gpt-oss:20b
ollama --version
ollama ls
curl -fsSL https://claude.ai/install.sh | bash
ollama launch claude --model gpt-oss:20b
|
export ANTHROPIC_BASE_URL=http://localhost:11434
export ANTHROPIC_AUTH_TOKEN=ollama
export ANTHROPIC_API_KEY=""
export OLLAMA_NUM_CTX=32768
export OLLAMA_KEEP_ALIVE=5m
claude --model gpt-oss:20b
| ||||
| |||||
Optimization
|
Optimization | ||
|---|---|---|
| Variable | Value (Range) | Impact on Yoga Pro 7i |
OLLAMA_NUM_CTX
|
6384 to 32768 |
The most important. Controls the "brain capacity." 32k is standard for Claude Code but uses ~3GB more RAM than the default 4k. |
References
|
References | ||
|---|---|---|