bvandeusenandClaude Opus 5
95a37318fc
CI & Build / Python lint (push) Failing after 9s
CI & Build / Plugin hooks (push) Successful in 12s
CI & Build / TypeScript typecheck (push) Successful in 44s
CI & Build / integration (push) Successful in 45s
CI & Build / Python tests (push) Successful in 1m26s
CI & Build / Build & push image (push) Skipped
Rules were the only major record type with no vector, so `search` could never return one and a rule could arrive only by being preloaded. That single fact is what made every rule compete for one always-on budget. THE DECISION THE TASK ASKED FOR, made explicitly: a sibling rule_embeddings table, not a polymorphic embedding row. The ROW could have been generalised; the SEARCH could not. semantic_search_notes is Note-specific scoping end to end — the visibility clause, the supersession penalty, note_type/task_kind/system filters — and a rule shares none of it, scoping instead by rulebook ownership or project. Generalising the row while still needing two searches is the worst of both: a key with referential integrity to neither table, on the path every session start runs, to share four columns. What is genuinely common is BEHAVIOUR — get_embedding, chunk_document, embedding_text, CHUNKER_VERSION — and those are reused as-is. Sharing them is the DRY win; sharing the table would have been the DRY costume. The document shape is measured, not chosen (note 2485). That pass found the snippet was the only discriminative record in the corpus — a 0.153 top-to-second gap against 0.010-0.023 — and that the cause was its SHAPE: purpose stated twice in a short single-topic document. rule_document reproduces it: the trigger in the title AND as the body's first line. And it excludes `why`, which matters more than any of it. `why` is dated incident narrative — rule 46's runs to 4,300 characters — and long multi-topic prose is exactly what made sixteen dev-logs mutually indistinguishable. Adding it would not give the vector more to work with; it would give every rule the SAME thing to work with. rule_document takes no `why` parameter at all, so a well-meaning caller cannot pass one. A rule with no trigger degrades to title + statement — findable, less sharp. That is an argument for backfilling triggers (step 6), not for padding the document with whatever text is nearby. search(content_type="rule") returns the rule WITH its why and how_to_apply: they are its operational half, the session payload never carries them, and a caller who went looking should not have to re-fetch. Writes re-index fire-and-forget like notes; startup backfills in its own try block so neither backfill can skip the other. rule_embeddings is derived, so it joins note_embeddings in the backup's explicitly-NOT-included list. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
53 lines
2.6 KiB
Python
53 lines
2.6 KiB
Python
from sqlalchemy.ext.asyncio import AsyncSession, async_sessionmaker, create_async_engine
|
|
from sqlalchemy.orm import DeclarativeBase
|
|
|
|
from scribe.config import Config
|
|
|
|
engine = create_async_engine(
|
|
Config.DATABASE_URL,
|
|
echo=False,
|
|
pool_pre_ping=True,
|
|
pool_recycle=1800,
|
|
)
|
|
async_session = async_sessionmaker(engine, class_=AsyncSession, expire_on_commit=False)
|
|
|
|
|
|
class Base(DeclarativeBase):
|
|
pass
|
|
|
|
|
|
from scribe.models.base import CreatedAtMixin, TimestampMixin # noqa: E402, F401
|
|
|
|
|
|
from scribe.models.note import Note, TaskPriority, TaskStatus # noqa: E402, F401
|
|
from scribe.models.setting import Setting # noqa: E402, F401
|
|
from scribe.models.user import User # noqa: E402, F401
|
|
from scribe.models.app_log import AppLog # noqa: E402, F401
|
|
from scribe.models.password_reset import PasswordResetToken # noqa: E402, F401
|
|
from scribe.models.invitation import InvitationToken # noqa: E402, F401
|
|
from scribe.models.embedding import NoteEmbedding, RuleEmbedding # noqa: E402, F401
|
|
from scribe.models.retrieval_log import RetrievalLog # noqa: E402, F401
|
|
from scribe.models.note_usage import NoteUsageEvent # noqa: E402, F401
|
|
from scribe.models.project import Project # noqa: E402, F401
|
|
from scribe.models.milestone import Milestone # noqa: E402, F401
|
|
from scribe.models.task_log import TaskLog # noqa: E402, F401
|
|
from scribe.models.note_draft import NoteDraft # noqa: E402, F401
|
|
from scribe.models.note_version import NoteVersion # noqa: E402, F401
|
|
from scribe.models.note_supersession import NoteSupersession # noqa: E402, F401
|
|
from scribe.models.group import Group, GroupMembership # noqa: E402, F401
|
|
from scribe.models.share import NoteShare, ProjectShare # noqa: E402, F401
|
|
from scribe.models.notification import Notification # noqa: E402, F401
|
|
from scribe.models.api_key import ApiKey # noqa: E402, F401
|
|
from scribe.models.user_profile import UserProfile # noqa: E402, F401
|
|
# Imported before rulebook: rule_systems foreign-keys canonical_systems.
|
|
from scribe.models.canonical_system import CanonicalSystem # noqa: E402, F401
|
|
from scribe.models.rulebook import ( # noqa: E402, F401
|
|
Rulebook, RulebookTopic, Rule, RuleRelation, project_rulebook_subscriptions,
|
|
rule_systems,
|
|
)
|
|
from scribe.models.repo_binding import RepoBinding # noqa: E402, F401
|
|
from scribe.models.forge_connection import ForgeConnection # noqa: E402, F401
|
|
from scribe.models.code_shape import CodeShape, CodeShapeConsumer, CodeShapeEvent, CodeShapeUse # noqa: E402, F401
|
|
from scribe.models.system import System, RecordSystem # noqa: E402, F401
|
|
from scribe.models.design_system import DesignSystem, DesignToken # noqa: E402, F401
|