AI/Ollama: Difference between revisions

From Chorke Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 69: Line 69:
{|class='wikitable mw-collapsible mw-collapsed'
{|class='wikitable mw-collapsible mw-collapsed'
!scope='col' style='text-align:left'|
!scope='col' style='text-align:left'|
[https://editor.plantuml.com/uml/TLHTZzem47pFhzYtGdAGgezLLTqLxWE9Naz7KTL7nzc03zkBR0STElhVkuc32aUQI8cItPcTsRLzxODmmGiT4hzHTYkSC508kLavgcqv8KqEWXFMSmZjQLQ9bQXrk2CR7eL1C6I9ioIMoLlozdEKP3dy_ph0Cr60EwKH5diVq2HPbgPvxLskIGgT5yhcQVel__OLPHtK3k6Rii8fz8p8Sj9Q6D5RuKSCBT3jqC5W4OGjXIRRCUo7BO7KeYwnbs0IGnDg7lDPL8X1vhvLN7RlAFFG5bBoJDVOntzdjD5l2STOnKs8t3l1xbNHQHf9BjoI7-1HjDQLvO4nSr1aMvo7mRscGkXXP5YJmVnBpTHVJxhNC2pvtmSF3vm0K-LG1dBxHYgZnb7j6UAqXLCHn3aeozVADnzzRPlFOB8M0HvYIflFLGpRqVwoo4Bii8JlRRJDpVA2FVdBzNE0NwXMw-0XJGUhRHYHzvy_VIo6QTe1ZR2gGX_UWG-H7Wm6KRAPe-_Ow4j9fvFlCo_9LcerVl4yXdFapTCCbi_pAzZWtb_1rj4B0u410Lz3H1iqpDHdxmcTvwRnJeEOr0ar-r77z6wglwbsl1Ltg6bh6bX5kaGNwnpjzTJfPFajIbKfoMin16LNiV_vP7wpdDwEUOs-1zxNgiI2QCE57CZQDQV2qMNoX-zhj6LpeFm5 Sturcture]
[https://editor.plantuml.com/uml/TLHTRzf047pthzYtmX5mrSUggf92lYIQHg6ewkFwl8OBzu7kpYWexd_FsWSgfAujsPPtPdPcx-pB4D77W3fcOQFi5ZqQA51kLjxLjfmwxJn4ZpPmYUmfggGAQnrld8qFQ0YCiuvHaihiDNlzESv6EVp_QE39kGWtIXCizY6IoKOZ8V8w-5mxYJelbCs5-8k_VY5PHxKZ-AOiUaM16IEdDHhix_0ZrHRaT-HXi8XeIzJE7XJsmrP0QgnBwXUOfjhKjPVvVN98KUQXSrmUxibcqpLIyjJN9AHNvx8fRmd7OiL3IDexvFIgo9EfiUJ6dNW33zX5LvONZAMZShRZ1HZSQbUW7YQ5jJEKVwbP-kl9z5g59R_x4E2E0J1JdcHqVjzQ5MAIt9uHpaOumuZdfD5QXVQvTsppUvYkCS9TmdHu8GodqQ6doG9tLCBthjnXHmL72ZtRfu5Vf5Rh6428mMeRnow4pvy-5aCX4j6WLHM5-9xS97am5B7aC8VSQSuzbavNlYUyTBPIgybpu5Lunxnwl8Vbq_m2DhGF5x3rxfc9m8n8Bx5Z6p8ir1llaNpWeV6N1WcLZ9hz-21qxhM1twxs_2dkIBkjQMcLqoNvhiynNb-VWwsm9Qag9NalngZiAir_EhzQpgudl4N_8TxMggJ2kGqtyY1ht_uLZYcpFtnUaYtR7yeR Sturcture]
|-
|-
|valign='top'|
|valign='top'|
Line 80: Line 80:
+/                          | Root File System
+/                          | Root File System
++**/usr/local/bin/**        | Executive Binaries
++**/usr/local/bin/**        | Executive Binaries
+++/ollama                   | Ollama Server (Standalone Binary)
+++ollama                   | Ollama Server (Standalone Binary)
+++/claude                   | Claude Code CLI
+++claude                   | Claude Code CLI
++**/etc/systemd/system/**  | Services
++**/etc/systemd/system/**  | Services
+++/ollama.service           | Systemd service file
+++ollama.service           | Systemd service file
++**/var/lib/claude-code/**  | Native installation files (Global)
++**/var/lib/claude-code/**  | Native installation files (Global)
++**/home/<user>/**          | User's Home Directory
++**/home/<user>/**          | User's Home Directory
+++**/.ollama/**             | Ollama Data Directory
+++**.ollama/**             | Ollama Data Directory
++++/history                 | CLI Chat History
++++history                 | CLI Chat History
++++**/models/**             | Saved Models
++++**models/**             | Saved Models
+++++/blobs/                 | Weights **(gpt-oss:20b)**
+++++blobs/                 | Weights **(gpt-oss:20b)**
+++++/manifests/             | Model metadata
+++++manifests/             | Model metadata
+++**/.claude/**             | Claude Code Data Directory
+++**.claude/**             | Claude Code Data Directory
++++/config.json             | API URL, keys, project context
++++config.json             | API URL, keys, project context
++++/memory/                 | Persistent memory
++++memory/                 | Persistent memory
+++**/my-project/**         | Your development folder
+++**my-project/**           | Your development folder
++++/.claude/               | Project specific settings
++++.claude/                 | Project specific settings
++++/CLAUDE.md               | Guidebook for current project
++++CLAUDE.md               | Guidebook for current project
}
}
}
}

Revision as of 00:18, 1 March 2026

curl -fsSL https://ollama.com/install.sh | sh
ollama pull model gpt-oss:20b
ollama --version
ollama ls

curl -fsSL https://claude.ai/install.sh  | bash
ollama launch claude --model gpt-oss:20b
export ANTHROPIC_BASE_URL=http://localhost:11434
export ANTHROPIC_AUTH_TOKEN=ollama
export ANTHROPIC_API_KEY=""



claude --model gpt-oss:20b

Diagram

@startuml
autonumber
skinparam backgroundColor    transparent
skinparam DefaultFontName    Helvetica
skinparam actorStyle         awesome
skinparam ParticipantPadding 20
skinparam BoxPadding         10

title Claude ↔ Local FS ↔ Ollama ↔ GPT-OSS:20b

actor "Developer"                  as dev

box "Local Development PC" #LightBlue
    participant "Claude Code CLI"  as claude
    participant "Local Filesystem" as fs
end box

box "Kubernetes Cluster (K3s)" #Yellow
    participant "Ollama Service"   as ollama
    participant "GPT-OSS:20b"      as model
end box

dev      -> claude : Runs "claude --model gpt-oss:20b"
claude   -> fs     : Scans repository context
fs      --> claude : File contents / Git history

claude   -> ollama : POST /v1/messages (Anthropic API)
note right: Payload includes system prompt \nand local code context

ollama   -> model  : Load weights into GPU VRAM
model   --> ollama : Inference processing...

ollama -->> claude : Streamed Response (Tokens)
claude   -> dev    : Displays suggested code changes

@enduml

Sturcture

@startsalt
skinparam backgroundColor transparent
skinparam defaultFontName monospaced
{
{T-
+/                           | Root File System
++**/usr/local/bin/**        | Executive Binaries
+++ollama                    | Ollama Server (Standalone Binary)
+++claude                    | Claude Code CLI
++**/etc/systemd/system/**   | Services
+++ollama.service            | Systemd service file
++**/var/lib/claude-code/**  | Native installation files (Global)
++**/home/<user>/**          | User's Home Directory
+++**.ollama/**              | Ollama Data Directory
++++history                  | CLI Chat History
++++**models/**              | Saved Models
+++++blobs/                  | Weights **(gpt-oss:20b)**
+++++manifests/              | Model metadata
+++**.claude/**              | Claude Code Data Directory
++++config.json              | API URL, keys, project context
++++memory/                  | Persistent memory
+++**my-project/**           | Your development folder
++++.claude/                 | Project specific settings
++++CLAUDE.md                | Guidebook for current project
}
}
@endsalt

References

References