bvandeusen
aea2701c28
The gate at a fixed 0.80 couldn't catch the real pain: Interpreter (fresh == cached, verified by probe) confidently mis-detects short ASCII English like "... WIP Part 1" as German at 0.86 — above the floor — so it was accepted and a re-translate reproduced it. Confidence alone can't separate the 0.86 collision (genuine German lands there too), and single-word mis-flags sit at a confident 1.0 no floor catches. Two operator-approved levers: - Acceptance floor is now a live Settings value (ImportSettings. translation_min_confidence, default 0.90; surfaced in the Translation card), so it's tunable without a redeploy. _accept takes the threshold as a parameter. - Per-post sticky override (Post.translation_override: auto/force/original). 'force' stores a translation even below the floor (rescue a skipped legit-foreign title); 'original' keeps the original and clears any stored translation (kill a confident mis-flag no floor catches). The sweep honors it on every run and _reset_translations skips 'original', so the choice survives a Re-translate-all. POST /api/posts/<id>/translation-override applies it immediately (translate now when the service is up, else queue for the sweep). UI: PostTranslationControl on the posts-feed card. Migration 0084 (both columns + a CHECK on the override). The feed + provenance serializers expose translation_override. With a stricter floor the rollback finally works: raise it -> Re-translate all -> the 0.86 mis-flags are rejected and restored to the original; force / keep-original handle the residual either way. Tests: gate thresholds against the param (0.86 rejected at 0.90, explicit-floor cases); sweep force/original + re-translate-skips-original; override endpoint (validation, original clears, force queues when disabled, feed exposes it); settings min_confidence default/save/validate. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CgZP9v2otxVJymiYsnVuMy
95 lines
4.0 KiB
Python
95 lines
4.0 KiB
Python
"""Post — provenance anchor for one creator post (may contain many images).
|
|
|
|
`source_id` is nullable since alembic 0030 — filesystem-imported posts
|
|
with no live subscription have NULL source_id. `artist_id` is the
|
|
denormalized always-present link to the creator (added in 0030 so
|
|
artist-filter queries don't depend on the Source detour).
|
|
"""
|
|
|
|
from datetime import datetime
|
|
|
|
from sqlalchemy import (
|
|
JSON,
|
|
CheckConstraint,
|
|
DateTime,
|
|
ForeignKey,
|
|
Integer,
|
|
String,
|
|
Text,
|
|
UniqueConstraint,
|
|
func,
|
|
)
|
|
from sqlalchemy.orm import Mapped, mapped_column
|
|
|
|
from .base import Base
|
|
|
|
|
|
class Post(Base):
|
|
__tablename__ = "post"
|
|
__table_args__ = (
|
|
# Source-bound dedup. Postgres treats NULL != NULL so rows
|
|
# with source_id IS NULL aren't deduped by this constraint;
|
|
# the partial unique index `uq_post_artist_external_id_null_source`
|
|
# (created in alembic 0030) covers that case via
|
|
# (artist_id, external_post_id).
|
|
UniqueConstraint("source_id", "external_post_id", name="uq_post_source_external_id"),
|
|
CheckConstraint(
|
|
"translation_override IN ('auto', 'force', 'original')",
|
|
name="ck_post_translation_override",
|
|
),
|
|
)
|
|
|
|
id: Mapped[int] = mapped_column(Integer, primary_key=True)
|
|
source_id: Mapped[int | None] = mapped_column(
|
|
ForeignKey("source.id", ondelete="SET NULL"), nullable=True, index=True
|
|
)
|
|
# Denormalized; always equals source.artist_id when source_id is set
|
|
# (the importer is responsible for keeping them consistent on insert).
|
|
# Filter queries (artist detail, artist-scoped posts feed) use this
|
|
# directly instead of joining through Source.
|
|
artist_id: Mapped[int] = mapped_column(
|
|
ForeignKey("artist.id", ondelete="CASCADE"),
|
|
nullable=False, index=True,
|
|
)
|
|
external_post_id: Mapped[str] = mapped_column(String(128), nullable=False)
|
|
post_url: Mapped[str | None] = mapped_column(Text, nullable=True)
|
|
post_title: Mapped[str | None] = mapped_column(Text, nullable=True)
|
|
post_date: Mapped[datetime | None] = mapped_column(DateTime(timezone=True), nullable=True)
|
|
|
|
raw_metadata: Mapped[dict | None] = mapped_column(JSON, nullable=True)
|
|
|
|
description: Mapped[str | None] = mapped_column(Text, nullable=True)
|
|
attachment_count: Mapped[int | None] = mapped_column(Integer, nullable=True)
|
|
|
|
# -- Post-text translation (milestone 143). Filled by the translate_posts
|
|
# sweep via the Interpreter LAN service so viewing is instant.
|
|
# translated_source_lang is the DETECTED original language; "en" (or a
|
|
# passthrough) means nothing to translate and the *_translated columns stay
|
|
# NULL. engine_version keys the Interpreter cache — re-runs are ~1ms and a
|
|
# model upgrade re-translates instead of serving stale.
|
|
post_title_translated: Mapped[str | None] = mapped_column(Text, nullable=True)
|
|
description_translated: Mapped[str | None] = mapped_column(Text, nullable=True)
|
|
translated_source_lang: Mapped[str | None] = mapped_column(
|
|
String(8), nullable=True
|
|
)
|
|
translation_engine_version: Mapped[str | None] = mapped_column(
|
|
String(128), nullable=True
|
|
)
|
|
translated_at: Mapped[datetime | None] = mapped_column(
|
|
DateTime(timezone=True), nullable=True
|
|
)
|
|
# Sticky per-post override of the translation decision (milestone 155):
|
|
# 'auto' = the acceptance gate decides; 'force' = always store Interpreter's
|
|
# translation even below the confidence floor (rescue a skipped legit-foreign
|
|
# title); 'original' = never translate, keep the original (kill a confidently
|
|
# mis-flagged one the floor can't catch). The sweep reads this on every run,
|
|
# and re-translate leaves 'original' posts alone, so the choice survives a
|
|
# Re-translate-all.
|
|
translation_override: Mapped[str] = mapped_column(
|
|
String(16), nullable=False, default="auto", server_default="auto",
|
|
)
|
|
|
|
downloaded_at: Mapped[datetime] = mapped_column(
|
|
DateTime(timezone=True), nullable=False, server_default=func.now()
|
|
)
|