AI/Ollama: Difference between revisions

From Chorke Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 65: Line 65:


@enduml
@enduml
</syntaxhighlight>
|}
{|class='wikitable mw-collapsible mw-collapsed'
!scope='col' style='text-align:left'|
[https://editor.plantuml.com/uml/TLHTZzem47pFhzYtGdAGgezLLTqLxWE9Naz7KTL7nzc03zkBR0STElhVkuc32aUQI8cItPcTsRLzxODmmGiT4hzHTYkSC508kLavgcqv8KqEWXFMSmZjQLQ9bQXrk2CR7eL1C6I9ioIMoLlozdEKP3dy_ph0Cr60EwKH5diVq2HPbgPvxLskIGgT5yhcQVel__OLPHtK3k6Rii8fz8p8Sj9Q6D5RuKSCBT3jqC5W4OGjXIRRCUo7BO7KeYwnbs0IGnDg7lDPL8X1vhvLN7RlAFFG5bBoJDVOntzdjD5l2STOnKs8t3l1xbNHQHf9BjoI7-1HjDQLvO4nSr1aMvo7mRscGkXXP5YJmVnBpTHVJxhNC2pvtmSF3vm0K-LG1dBxHYgZnb7j6UAqXLCHn3aeozVADnzzRPlFOB8M0HvYIflFLGpRqVwoo4Bii8JlRRJDpVA2FVdBzNE0NwXMw-0XJGUhRHYHzvy_VIo6QTe1ZR2gGX_UWG-H7Wm6KRAPe-_Ow4j9fvFlCo_9LcerVl4yXdFapTCCbi_pAzZWtb_1rj4B0u410Lz3H1iqpDHdxmcTvwRnJeEOr0ar-r77z6wglwbsl1Ltg6bh6bX5kaGNwnpjzTJfPFajIbKfoMin16LNiV_vP7wpdDwEUOs-1zxNgiI2QCE57CZQDQV2qMNoX-zhj6LpeFm5 Sturcture]
|-
|valign='top'|
<syntaxhighlight lang='md'>
@startsalt
skinparam backgroundColor transparent
skinparam defaultFontName monospaced
{
{T-
+/                          | Root File System
++**/usr/local/bin/**        | Executive Binaries
+++/ollama                  | Ollama Server (Standalone Binary)
+++/claude                  | Claude Code CLI
++**/etc/systemd/system/**  | Services
+++/ollama.service          | Systemd service file
++**/var/lib/claude-code/**  | Native installation files (Global)
++**/home/<user>/**          | User's Home Directory
+++**/.ollama/**            | Ollama Data Directory
++++/history                | CLI Chat History
++++**/models/**            | Saved Models
+++++/blobs/                | Weights **(gpt-oss:20b)**
+++++/manifests/            | Model metadata
+++**/.claude/**            | Claude Code Data Directory
++++/config.json            | API URL, keys, project context
++++/memory/                | Persistent memory
+++**/my-project/**          | Your development folder
++++/.claude/                | Project specific settings
++++/CLAUDE.md              | Guidebook for current project
}
}
@endsalt
</syntaxhighlight>
</syntaxhighlight>
|}
|}

Revision as of 00:09, 1 March 2026

curl -fsSL https://ollama.com/install.sh | sh
ollama pull model gpt-oss:20b
ollama --version
ollama ls

curl -fsSL https://claude.ai/install.sh  | bash
ollama launch claude --model gpt-oss:20b
export ANTHROPIC_BASE_URL=http://localhost:11434
export ANTHROPIC_AUTH_TOKEN=ollama
export ANTHROPIC_API_KEY=""



claude --model gpt-oss:20b

Diagram

@startuml
autonumber
skinparam backgroundColor    transparent
skinparam DefaultFontName    Helvetica
skinparam actorStyle         awesome
skinparam ParticipantPadding 20
skinparam BoxPadding         10

title Claude ↔ Local FS ↔ Ollama ↔ GPT-OSS:20b

actor "Developer"                  as dev

box "Local Development PC" #LightBlue
    participant "Claude Code CLI"  as claude
    participant "Local Filesystem" as fs
end box

box "Kubernetes Cluster (K3s)" #Yellow
    participant "Ollama Service"   as ollama
    participant "GPT-OSS:20b"      as model
end box

dev      -> claude : Runs "claude --model gpt-oss:20b"
claude   -> fs     : Scans repository context
fs      --> claude : File contents / Git history

claude   -> ollama : POST /v1/messages (Anthropic API)
note right: Payload includes system prompt \nand local code context

ollama   -> model  : Load weights into GPU VRAM
model   --> ollama : Inference processing...

ollama -->> claude : Streamed Response (Tokens)
claude   -> dev    : Displays suggested code changes

@enduml

Sturcture

@startsalt
skinparam backgroundColor transparent
skinparam defaultFontName monospaced
{
{T-
+/                           | Root File System
++**/usr/local/bin/**        | Executive Binaries
+++/ollama                   | Ollama Server (Standalone Binary)
+++/claude                   | Claude Code CLI
++**/etc/systemd/system/**   | Services
+++/ollama.service           | Systemd service file
++**/var/lib/claude-code/**  | Native installation files (Global)
++**/home/<user>/**          | User's Home Directory
+++**/.ollama/**             | Ollama Data Directory
++++/history                 | CLI Chat History
++++**/models/**             | Saved Models
+++++/blobs/                 | Weights **(gpt-oss:20b)**
+++++/manifests/             | Model metadata
+++**/.claude/**             | Claude Code Data Directory
++++/config.json             | API URL, keys, project context
++++/memory/                 | Persistent memory
+++**/my-project/**          | Your development folder
++++/.claude/                | Project specific settings
++++/CLAUDE.md               | Guidebook for current project
}
}
@endsalt

References

References