bvandeusen
750a91898a
Background tasks (title generation, tag suggestions, project summaries, RSS classification) were using qwen3:8b and wiping its KV cache after every response, preventing prefix cache hits on subsequent user messages. Adds OLLAMA_BACKGROUND_MODEL (default: qwen2.5:0.5b) config var and routes all background LLM calls to it, keeping qwen3:8b's KV cache warm between user messages for consistent sub-second TTFT. Also adds infinite scroll to KnowledgeView (replaces load-more button) and bakes spaCy en_core_web_sm into the Docker image to eliminate the pip install on every startup. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
47 lines
1.6 KiB
Docker
47 lines
1.6 KiB
Docker
# syntax=docker/dockerfile:1
|
|
# Stage 1: Build Vue frontend
|
|
FROM node:22-alpine AS build-frontend
|
|
WORKDIR /build
|
|
COPY frontend/package.json frontend/package-lock.json* ./
|
|
RUN npm ci --quiet
|
|
COPY frontend/ .
|
|
RUN npm run build
|
|
|
|
# Stage 2: Python runtime
|
|
FROM python:3.12-slim AS runtime
|
|
WORKDIR /app
|
|
|
|
COPY pyproject.toml .
|
|
COPY src/ src/
|
|
RUN --mount=type=cache,target=/root/.cache/pip \
|
|
pip install .
|
|
# Voice dependencies (faster-whisper, Kokoro TTS, soundfile) — activated at runtime via VOICE_ENABLED
|
|
# Install CPU-only torch first so pip doesn't pull full CUDA wheels (~2 GB) for kokoro/transformers.
|
|
RUN --mount=type=cache,target=/root/.cache/pip \
|
|
pip install torch --index-url https://download.pytorch.org/whl/cpu \
|
|
&& pip install faster-whisper kokoro soundfile \
|
|
&& python -m spacy download en_core_web_sm
|
|
|
|
# Build the fable-mcp wheel so it can be served for download
|
|
COPY fable-mcp/ fable-mcp/
|
|
RUN --mount=type=cache,target=/root/.cache/pip \
|
|
pip install build hatchling \
|
|
&& python -m build --wheel ./fable-mcp --outdir /app/dist/ \
|
|
&& pip uninstall -y build \
|
|
&& rm -rf fable-mcp/
|
|
|
|
COPY --from=build-frontend /build/dist/ src/fabledassistant/static/
|
|
COPY alembic.ini .
|
|
COPY alembic/ alembic/
|
|
|
|
# Ensure Python finds the source tree (where static files live) before site-packages
|
|
ENV PYTHONPATH=/app/src
|
|
|
|
# Version is injected at build time via --build-arg BUILD_VERSION=YY.MM.DD.N
|
|
# Falls back to "dev" for local / untagged builds
|
|
ARG BUILD_VERSION=dev
|
|
ENV APP_VERSION=$BUILD_VERSION
|
|
|
|
EXPOSE 5000
|
|
CMD ["sh", "-c", "alembic upgrade head && hypercorn 'fabledassistant.app:create_app()' --bind 0.0.0.0:5000 --keep-alive 600"]
|