AI/Ollama

From Chorke Wiki
Revision as of 22:48, 28 February 2026 by Shahed (talk | contribs)
Jump to navigation Jump to search
Name CIDR MEMO Status
Cudy TR3000 192.168.010.01/24 WiFi » Router 🟢
Pi02W 192.168.010.02/24 WiFi » Pi-Hole 🟢
Laptop 192.168.010.03/24 WiFi » Operator 🟢
Herelink Ground Unit 192.168.010.04/24 WiFi » Ground Unit 🟢
Herelink Ground Unit 192.168.144.11/24 Here » Ground Unit 🟡
Herelink Air Unit 192.168.144.10/24 Here » Air Unit 🟡
Raspberry Pi4B 192.168.144.09/24 Here » Bridge 🟡

Diagram

@startuml
skinparam actorStyle awesome
autonumber

skinparam backgroundColor    transparent
skinparam DefaultFontName    Helvetica
skinparam ParticipantPadding 20
skinparam BoxPadding         10

title Claude ↔ Local FS ↔ Ollama ↔ GPT-OSS:20b

actor "Developer"                  as dev

box "Local Development PC" #LightBlue
    participant "Claude Code CLI"  as claude
    participant "Local Filesystem" as fs
end box

box "Kubernetes Cluster (K3s)" #Yellow
    participant "Ollama Service"   as ollama
    participant "GPT-OSS:20b"      as model
end box

dev      -> claude : Runs "claude --model gpt-oss:20b"
claude   -> fs     : Scans repository context
fs      --> claude : File contents / Git history

claude   -> ollama : POST /v1/messages (Anthropic API)
note right: Payload includes system prompt \nand local code context

ollama   -> model  : Load weights into GPU VRAM
model   --> ollama : Inference processing...

ollama -->> claude : Streamed Response (Tokens)
claude   -> dev    : Displays suggested code changes
@enduml

References

References