bvandeusen
6959e1220c
This reverts 2529b51. Not a retreat — a reordering, on the operator's
call, and the better sequence.
The squash's acceptance test (run 4971) found ~130 places where the ORM
models do not describe the deployed schema (#3275), including a
unique=True the database never had and two UNIQUE indexes that exist
only in migrations. Collapsing now would have baked all of that into the
one file a public installer starts from.
So: fix the drift first as ordinary migrations on the intact chain, let
the operator deploy so their database moves to the corrected head, and
only then collapse. The baseline is then generated from reconciled
models and reproduces a schema worth reproducing.
Nothing is lost by reverting. The baseline was never deployed, and
regenerating it after the fixes is strictly better than patching this
copy — it will come out of autogenerate correct rather than needing the
same hand-finishing twice.
42 lines
1.6 KiB
Python
42 lines
1.6 KiB
Python
"""image_record.siglip_embedding: HNSW cosine index for "more like this"
|
|
|
|
Revision ID: 0036
|
|
Revises: 0035
|
|
Create Date: 2026-06-04
|
|
|
|
Gallery Phase 3 (visual similarity search) ranks images by
|
|
`siglip_embedding.cosine_distance(source_embedding)`. Without an index that's
|
|
a sequential scan computing a 1152-dim distance for every row — fine at small
|
|
scale, but it grows linearly with the library. Add an HNSW index with
|
|
`vector_cosine_ops` so the top-N nearest search is sub-50ms ANN.
|
|
|
|
1152 dims is under pgvector's 2000-dim HNSW limit, so HNSW (no training,
|
|
better recall than IVFFlat) is the right choice. ONE-TIME COST: building the
|
|
index over the existing embeddings (~57k vectors on the operator's library)
|
|
locks image_record for ~30-60s during this migration on deploy — acceptable
|
|
for a single-operator homelab. NULL embeddings (videos / not-yet-embedded
|
|
rows) are simply not indexed.
|
|
"""
|
|
from typing import Sequence, Union
|
|
|
|
from alembic import op
|
|
|
|
revision: str = "0036"
|
|
down_revision: Union[str, None] = "0035"
|
|
branch_labels: Union[str, Sequence[str], None] = None
|
|
depends_on: Union[str, Sequence[str], None] = None
|
|
|
|
|
|
def upgrade() -> None:
|
|
# Raw SQL: alembic's create_index doesn't express the `USING hnsw (...
|
|
# vector_cosine_ops)` access-method + opclass cleanly. Must match the
|
|
# query's cosine_distance operator class to be usable by the planner.
|
|
op.execute(
|
|
"CREATE INDEX ix_image_record_siglip_hnsw "
|
|
"ON image_record USING hnsw (siglip_embedding vector_cosine_ops)"
|
|
)
|
|
|
|
|
|
def downgrade() -> None:
|
|
op.drop_index("ix_image_record_siglip_hnsw", table_name="image_record")
|