3d77a38a25
The v2 pivot replaced per-tag SigLIP centroids with learned heads + CCIP. Centroids were still recomputed (on every tag merge + a daily beat) but NOTHING read them — suggestions come from heads+CCIP and apply_allowlist_tags applies via Camie predictions, not centroids. Pure dead wiring; remove it. Removed: CentroidService, recompute_centroid/recompute_centroids tasks, the daily beat, POST /api/ml/recompute-centroids, the recompute-on-merge trigger, the tag_reference_embedding table + model, the centroid_similarity_threshold + min_reference_images settings (migration 0066), the CentroidRecomputeCard + its store action + MaintenancePanel tile, and the centroid slider in MLThresholdSliders. _keep_as_alias drops its vestigial has-centroid branch (the allowlist branch already covers "could re-emit"); tag merge no longer clears a table that no longer exists. NOT touched (still live, parallel to heads): the Camie tagger, ImagePrediction, and the allowlist bulk-apply — accepting a suggestion still allowlists + applies it across the library. The tag-eval "centroid" baseline metric is unrelated (in-memory) and stays. (image_record.centroid_scores JSON column also remains — separate legacy field, its own micro-cleanup.) Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Ttrj5P7upUTueSfoJcxEqa
112 lines
5.2 KiB
Python
112 lines
5.2 KiB
Python
"""MLSettings — single-row table holding ML pipeline tunables."""
|
||
|
||
from datetime import datetime
|
||
|
||
from sqlalchemy import (
|
||
Boolean,
|
||
CheckConstraint,
|
||
DateTime,
|
||
Float,
|
||
Integer,
|
||
String,
|
||
func,
|
||
)
|
||
from sqlalchemy.orm import Mapped, mapped_column
|
||
|
||
from .base import Base
|
||
|
||
|
||
class MLSettings(Base):
|
||
__tablename__ = "ml_settings"
|
||
# Bare name — Base.metadata's naming convention prepends ck_<table>_,
|
||
# producing the final ck_ml_settings_singleton (matches migration 0003).
|
||
__table_args__ = (CheckConstraint("id = 1", name="singleton"),)
|
||
|
||
id: Mapped[int] = mapped_column(Integer, primary_key=True)
|
||
suggestion_threshold_character: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=0.70
|
||
)
|
||
# Default raised 0.50 → 0.70 on 2026-06-02 — operator-flagged 0.50
|
||
# surfaced too many low-confidence picks; 0.70 keeps the rail
|
||
# signal-rich while still surfacing more than the original 0.95
|
||
# which hid almost everything. Operator-tunable via Settings → ML.
|
||
suggestion_threshold_general: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=0.70
|
||
)
|
||
# Ingest floor: tagger predictions below this confidence are not stored
|
||
# (tagger.Tagger.infer). Default 0.70 — the suggestion path already filters
|
||
# there, so the sub-0.70 tail is redundant weight (it had bloated
|
||
# image_record's TOAST to ~100 GB; plan-task #764). Operator-tunable via
|
||
# Settings → ML; must stay ≤ the suggestion thresholds.
|
||
tagger_store_floor: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=0.70
|
||
)
|
||
# Video tagging (#747). Sample one frame every N seconds (fixed CADENCE, not a
|
||
# fixed count) so a tag's frame-presence reflects real screen time regardless
|
||
# of video length; cap the total so a long video can't explode into hundreds
|
||
# of inferences (the cadence stretches past the cap). A tag is kept only if it
|
||
# appears in >= video_min_tag_frames sampled frames (≈ that many × interval
|
||
# seconds on screen) — duration-independent noise rejection. Operator-tunable.
|
||
video_frame_interval_seconds: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=4.0
|
||
)
|
||
video_max_frames: Mapped[int] = mapped_column(
|
||
Integer, nullable=False, default=64
|
||
)
|
||
video_min_tag_frames: Mapped[int] = mapped_column(
|
||
Integer, nullable=False, default=3
|
||
)
|
||
# Tagging-v2 head training (#114). The head is the suggestion source that
|
||
# LEARNS from the operator's tags (replacing Camie + centroid). A concept
|
||
# needs >= head_min_positives labelled images before a head is trained;
|
||
# head_auto_apply_precision is the precision bar a head must clear (at some
|
||
# operating point) to "graduate" into earned auto-apply. Operator-tunable.
|
||
head_min_positives: Mapped[int] = mapped_column(
|
||
Integer, nullable=False, default=8
|
||
)
|
||
head_auto_apply_precision: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=0.97
|
||
)
|
||
# Earned auto-apply (#114). A graduated head fires (tags images without a
|
||
# human) when this master switch is on AND the head has at least
|
||
# head_auto_apply_min_positives clean labels — so a precise-looking but
|
||
# under-supported low-N head can't spray tags across the library. ON by
|
||
# default (operator-asked 2026-06-29: opt-OUT, not opt-in); the support +
|
||
# measured-precision gates keep it safe, and every auto-tag is reversible.
|
||
head_auto_apply_enabled: Mapped[bool] = mapped_column(
|
||
Boolean, nullable=False, default=True
|
||
)
|
||
head_auto_apply_min_positives: Mapped[int] = mapped_column(
|
||
Integer, nullable=False, default=30
|
||
)
|
||
# CCIP character-match cosine cut (#114). 0.85 default — the v1 flat 0.75
|
||
# over-fired (high-reference characters matched a scatter of images); 0.85
|
||
# keeps the confident single-character matches. Tunable from the agent card.
|
||
ccip_match_threshold: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=0.85
|
||
)
|
||
# CCIP auto-apply (#114). Confident matches (>= ccip_auto_apply_threshold,
|
||
# above the suggest cut) auto-tag on a daily sweep. ON by default (opt-out);
|
||
# single-character references + the high bar keep it safe, every tag reversible.
|
||
ccip_auto_apply_enabled: Mapped[bool] = mapped_column(
|
||
Boolean, nullable=False, default=True
|
||
)
|
||
ccip_auto_apply_threshold: Mapped[float] = mapped_column(
|
||
Float, nullable=False, default=0.92
|
||
)
|
||
tagger_model_version: Mapped[str] = mapped_column(
|
||
String(128), nullable=False, default="camie-tagger-v2"
|
||
)
|
||
embedder_model_version: Mapped[str] = mapped_column(
|
||
String(128), nullable=False, default="siglip-so400m-patch14-384"
|
||
)
|
||
# The HF model NAME the embedder loads (server CPU embed + announced to the
|
||
# GPU agent in the lease). Operator-settable so the embedder is a choice, not
|
||
# a hardcode (#1190): set name + version together, then re-embed + retrain.
|
||
embedder_model_name: Mapped[str] = mapped_column(
|
||
String(128), nullable=False, default="google/siglip-so400m-patch14-384"
|
||
)
|
||
updated_at: Mapped[datetime] = mapped_column(
|
||
DateTime(timezone=True), nullable=False, server_default=func.now()
|
||
)
|