didericis/bot-bottle
1
0
Fork 0
Code Issues 7 Pull Requests 15 Actions Packages Projects Releases Wiki Activity

Research: local Ollama deployment, harness selection, and model sizing #183

Merged
didericis merged 1 commits from research-local-ollama-harness into main 2026-06-03 21:37:56 -04:00
Conversation 0 Commits 1 Files Changed 1
+278
didericis-claude commented 2026-06-03 21:26:36 -04:00
Collaborator
Copy Link
Copy Source

Summary

  • Covers native vs Docker vs LXC vs KVM/passthrough overhead for Ollama (TL;DR: LXC <1%, Docker ~1–2%, KVM passthrough 2–5% — none significant; CPU fallback without passthrough is the real cost)
  • Evaluates harnesses for agentic coding loops: OpenCode (best bot-bottle fit), Aider (git-native terminal), Continue.dev (IDE plugin + FIM autocomplete), Cline (IDE agent)
  • Model recommendations for RTX 3070 8 GB VRAM / 30 GB RAM: qwen2.5-coder:7b as primary (full VRAM, FIM, 35–55 tok/sec), qwen2.5-coder:14b as secondary via RAM offload, gemma4:e4b as general-purpose alternative
  • Confirms Gemma 4 exists (released 2026-04-02, Apache 2.0) but only the E4B fits in 8 GB

Doc: 8f05226a4a/docs/research/local-ollama-harness-and-model-selection.md

## Summary - Covers native vs Docker vs LXC vs KVM/passthrough overhead for Ollama (TL;DR: LXC <1%, Docker ~1–2%, KVM passthrough 2–5% — none significant; CPU fallback without passthrough is the real cost) - Evaluates harnesses for agentic coding loops: OpenCode (best bot-bottle fit), Aider (git-native terminal), Continue.dev (IDE plugin + FIM autocomplete), Cline (IDE agent) - Model recommendations for RTX 3070 8 GB VRAM / 30 GB RAM: `qwen2.5-coder:7b` as primary (full VRAM, FIM, 35–55 tok/sec), `qwen2.5-coder:14b` as secondary via RAM offload, `gemma4:e4b` as general-purpose alternative - Confirms Gemma 4 exists (released 2026-04-02, Apache 2.0) but only the E4B fits in 8 GB Doc: https://gitea.dideric.is/didericis/bot-bottle/src/commit/8f05226a4aafbd5b30a4df7e87e084d889a9d4e1/docs/research/local-ollama-harness-and-model-selection.md
didericis-claude added 1 commit 2026-06-03 21:26:37 -04:00
docs(research): local ollama deployment, harness selection, and model sizing
test / unit (pull_request) Successful in 38s
Details
test / integration (pull_request) Successful in 51s
Details
8f05226a4a
didericis merged commit d1556f4659 into main 2026-06-03 21:37:56 -04:00
didericis deleted branch research-local-ollama-harness 2026-06-03 21:37:56 -04:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
Compat/Breaking
Breaking change that won't be backward compatible
 Kind/Bug
Something is not working
 Kind/Documentation
Documentation changes
 Kind/Enhancement
Improve existing functionality
 Kind/Feature
New functionality
 Kind/Security
This is security issue
 Kind/Testing
Issue or pull request related to testing
Priority
Critical
1
The priority is critical
Priority
High
2
The priority is high
Priority
Low
4
The priority is low
Priority
Medium
3
The priority is medium
Reviewed
Confirmed
1
Issue has been confirmed
Reviewed
Duplicate
2
This issue or pull request already exists
Reviewed
Invalid
3
Invalid issue
Reviewed
Won't Fix
3
This issue won't be fixed
Status
Abandoned
3
Somebody has started to work on this but abandoned work
Status
Blocked
1
Something is blocking this issue or pull request
Status
Need More Info
2
Feedback is required to reproduce issue or to continue work
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
didericis-claude (didericis (claude)) didericis-codex (didericis (codex)) didericis-gemma (gemma) didericis
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: didericis/bot-bottle#183
Delete Branch "research-local-ollama-harness"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?