perf(migration): 0045 streams json_each (no materialize / no temp blowup) #94

2026-06-10T22:07:10-04:00

bvandeusen commented

2026-06-10 22:07:10 -04:00

Replaces the MATERIALIZED-CTE scalar guard in 0045's backfill with an inline CASE that feeds json_each an empty object for non-object rows. Same scalar guard (no "cannot deconstruct a scalar"), but a single streaming pass — no 100 GB materialization to temp. Prod is at 0044 (the earlier 0045 rolled back), so this is the 0045 that runs on next deploy.

(Today's local-disk fill was unrelated — accumulated container images in /var/lib/containerd, since pruned. Migration temp goes to NFS, which has room.)

CI green on dev e6d5f67 (run 856).

🤖 Generated with Claude Code

Replaces the MATERIALIZED-CTE scalar guard in 0045's backfill with an inline `CASE` that feeds `json_each` an empty object for non-object rows. Same scalar guard (no "cannot deconstruct a scalar"), but a single streaming pass — no 100 GB materialization to temp. Prod is at 0044 (the earlier 0045 rolled back), so this is the 0045 that runs on next deploy. (Today's local-disk fill was unrelated — accumulated container images in /var/lib/containerd, since pruned. Migration temp goes to NFS, which has room.) CI green on dev `e6d5f67` (run 856). 🤖 Generated with [Claude Code](https://claude.com/claude-code)

bvandeusen added 1 commit 2026-06-10 22:07:10 -04:00

perf(migration): 0045 streams json_each via inline CASE guard (no temp spill)

CI / lint (push) Successful in 2s

Details

CI / frontend-build (push) Successful in 23s

Details

CI / backend-lint-and-test (push) Successful in 33s

Details

CI / integration (push) Successful in 3m20s

Details

e6d5f67f11

The MATERIALIZED-CTE scalar guard forced Postgres to materialize all object
rows with their full JSON (~100 GB) to temp before json_each — on NFS that's a
huge spill and pathologically slow (risks disk-full). Replace with an inline
CASE that feeds json_each an empty object for non-object rows: same scalar
guard, but a single streaming pass with no materialization.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

bvandeusen merged commit 444c1fb075 into main

2026-06-10 22:07:16 -04:00

bvandeusen referenced this issue from a commit

2026-06-23 02:02:30 -04:00

feat(explore): cluster-consensus tag-gaps service + route (#94a)

bvandeusen referenced this issue from a commit

2026-06-23 02:08:35 -04:00

feat(explore): Explore view + tag-gap closing + modal meta/download (#94b–d, #4a/b)

bvandeusen referenced this pull request

2026-06-23 08:57:22 -04:00

Tagging & viewing roadmap: tag query surface + hygiene projections + Explore view (Clusters A/B/C) #128

bvandeusen referenced this issue from a commit