FabledScribe

Files

T

bvandeusenandClaude Sonnet 4.6 750a91898a perf(llm): route background tasks to dedicated model to preserve KV cache

Background tasks (title generation, tag suggestions, project summaries,
RSS classification) were using qwen3:8b and wiping its KV cache after
every response, preventing prefix cache hits on subsequent user messages.

Adds OLLAMA_BACKGROUND_MODEL (default: qwen2.5:0.5b) config var and
routes all background LLM calls to it, keeping qwen3:8b's KV cache
warm between user messages for consistent sub-second TTFT.

Also adds infinite scroll to KnowledgeView (replaces load-more button)
and bakes spaCy en_core_web_sm into the Docker image to eliminate the
pip install on every startup.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-03 01:33:54 -04:00

public

Fix push notifications: focus suppression, empty body, error visibility

2026-03-09 22:12:20 -04:00

src

perf(llm): route background tasks to dedicated model to preserve KV cache

2026-04-03 01:33:54 -04:00

.npmrc

Upgrade all major frontend dependencies

2026-03-09 21:30:55 -04:00

index.html

Add Projects, Milestones, RAG auto-inject, push notifications, PWA, tag normalisation