AI/Ollama: Difference between revisions

From Chorke Wiki
Jump to navigation Jump to search
← Older editNewer edit →
VisualWikitext
No edit summary
No edit summary
Line 25: Line 25:
{|class='wikitable mw-collapsible mw-collapsed'
{|class='wikitable mw-collapsible mw-collapsed'
!scope='col' style='text-align:left'|
!scope='col' style='text-align:left'|
[https://editor.plantuml.com/uml/PLJ1Rjim3BthAmZlqXxIfDqjXw5jWdP5ioM8im43Tb5a9X4gIuP8fyqFx0lsXVkIqRAJkeWEXYK-Fhv7ohubrf7hqYbwiRxIKPUW3OUOyy4Xw5UaKABIDGTVbskCgWTSQ_EoZQ7snIIu444MH-r9ekYv1vpYHjUE7uBdxxh41lWLtHxP6js3BKIADRRIdXUwAApVmise5xyFRyVpuxeUASMMHUh4wRf0-FVdByo2qGuUyhIPEwTBdLuV5wl1FC_7DwErKiabP5FSemiLnWpEbYOeSA_KEhn1rf9sy5BymMAImQUPtUxutjMecepgtG5adQ99Q1wpfomHcdHu3kuqMuTq8COoQy0RKkWBaFgTYETQHk2HaSHlBRW85y-VwLA4_4BdmkivSUS_nxYt1hFMLaY7v-1UXx9J3qenuDw5I4lQqE1BvmR6iAmzGTPj1uEK0jkA1u4eiQakbj8sb0Z6a1kvBX2n2cHb70SmSaNmZLM74AfUaQOxBS8pmH0UBSFEKfEeFl2tzYHZCSzNCDnV3qiaqbjfsyMTvrqCbJLmjtYwL3umGco6A6XzS44NOBrnmaNGZWAg6CgAuRVNqWEN1cMQeHx5ggvUgjrQbzgpXkeL6seIIWvo_tx0p-NTDzLXahkJrYU_GVbk33RrZEYLUtvrTNLY5t2l5pb7b4-fW2LI5JmXNAp22tgw_D29RbXZc5ggd3w8ftehVM39R3tij9UzkfNvoc_WFm00 Diagram]
[https://editor.plantuml.com/uml/PLH1Rjim4Bpp5GlraXmSE-dDXoA9ZQH1tDgmt085Ug6fjKs48WNkoea_q1VqXNr9LvJiA30FXYdEpixCKhebrf7hqYbTS_1rkSQewCNwIaTTmbgRbsqCjIycmOK8iZXgJtAAddl0AMvqxVWXUFwkIso0Nz7jaQtHFPWs76BE1vSGQUbNf51Y3xGGHTROIdjUwAAmVWitezxvVNWxFZ-kwv5IR5be9qxN1SA_FtzX5ensy92dpTmvNUhqzt6n6ippV7mpMYkL544snJswK67Cu6nfWWBtIgt36sGjQGSl9GHOJ3BuDBFR7T-x6bLJKRqxWAnJD0dDp-mfIuGcFJm7TvgjGpeGOvaru0qfz0L8_qx4SorZyiX8uhSMN8IBvyzqAK9-eNFXzPouyvzZt5k3MMihf8Vdu5v2sIc3KWouTo4IINiq-DAvWJ4iQq-GTTl189N0jk9184figZjBPHjA16F8ZTmfY5W5iZAE0nYvH_Z6gaC8LQz9aqwBy4mmX4VBiBFK5AeF_AqzgLZCynKCzzV34edqLcAxkFEyYw6o1kuMJvVA1qQ8pH05hGykw0AiDqwu2DfHG1L3MJ7yzbeoS6bGfXdgKQpg-gNUhNNfFMkeNh6X9g7a8FVl1_nStdrJ7IQvEsbzyXkKbyjWqy-8NhddLrTN9tO1zxB8EQAyRmKiaQhW2U5Y5LxGq-M79BfXZM5ggNBw89xghUJ0Kjbws6alUwLkPS3oEVWF Diagram]
|-
|-
|valign='top'|
|valign='top'|
<syntaxhighlight lang='md'>
<syntaxhighlight lang='md'>
@startuml
@startuml
skinparam actorStyle awesome
autonumber
autonumber
skinparam backgroundColor    transparent
skinparam backgroundColor    transparent
skinparam DefaultFontName    Helvetica
skinparam DefaultFontName    Helvetica
skinparam actorStyle        awesome
skinparam ParticipantPadding 20
skinparam ParticipantPadding 20
skinparam BoxPadding        10
skinparam BoxPadding        10
Line 64: Line 63:
ollama -->> claude : Streamed Response (Tokens)
ollama -->> claude : Streamed Response (Tokens)
claude  -> dev    : Displays suggested code changes
claude  -> dev    : Displays suggested code changes
@enduml
@enduml
</syntaxhighlight>
</syntaxhighlight>

Revision as of 23:06, 28 February 2026

curl -fsSL https://ollama.com/install.sh | sh
ollama pull model gpt-oss:20b
ollama --version
ollama ls

curl -fsSL https://claude.ai/install.sh  | bash
ollama launch claude --model gpt-oss:20b

export ANTHROPIC_BASE_URL=http://localhost:11434
export ANTHROPIC_AUTH_TOKEN=ollama
export ANTHROPIC_API_KEY=""



claude --model gpt-oss:20b

Diagram 

@startuml
autonumber
skinparam backgroundColor    transparent
skinparam DefaultFontName    Helvetica
skinparam actorStyle         awesome
skinparam ParticipantPadding 20
skinparam BoxPadding         10

title Claude ↔ Local FS ↔ Ollama ↔ GPT-OSS:20b

actor "Developer"                  as dev

box "Local Development PC" #LightBlue
    participant "Claude Code CLI"  as claude
    participant "Local Filesystem" as fs
end box

box "Kubernetes Cluster (K3s)" #Yellow
    participant "Ollama Service"   as ollama
    participant "GPT-OSS:20b"      as model
end box

dev      -> claude : Runs "claude --model gpt-oss:20b"
claude   -> fs     : Scans repository context
fs      --> claude : File contents / Git history

claude   -> ollama : POST /v1/messages (Anthropic API)
note right: Payload includes system prompt \nand local code context

ollama   -> model  : Load weights into GPU VRAM
model   --> ollama : Inference processing...

ollama -->> claude : Streamed Response (Tokens)
claude   -> dev    : Displays suggested code changes

@enduml

References

References

Retrieved from "https://wiki.chorke.org/index.php?title=AI/Ollama&oldid=16649"