bvandeusenandClaude Opus 5.5 bb10d30b2d fix: two copies of one picture imported at once are filed as duplicates, and an archive's row always ends ...

The sha256 lookup before inserting an image row can lose a race to another
worker importing a second copy of the same picture. The unique index then
refused the insert. A media import retried behind the whole import queue, and
the recovery sweep ran it a second time. An archive swallowed the error, failed
on the dead transaction, and its row stayed 'processing' because the failure
mark could not commit either.

- Importer._store_new_record inserts under a savepoint; on a conflict the file
  is filed as a duplicate of the row that won (_file_as_duplicate, now shared
  by every duplicate branch). _import_media removes its stray library copy.
- _import_archive commits its post before extracting; the member loop rolls
  back a failed member and lets SoftTimeLimitExceeded through.
- _mark_failed rolls back before writing the failure.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-06 18:35:51 -05:00

..

audits

fix: the single-color filter no longer takes line art for a blank image (#4483)

2026-09-28 08:12:43 -04:00

ml

feat: retire the sketch/doodle WIP title tier, and the review strip asks "Is this a WIP?" (milestone 430)

2026-09-25 08:20:28 -04:00

platforms

feat: retire pixiv entirely — delete its code, its ledgers, its credential (3977, 3978, 3979)

2026-09-21 20:46:15 -04:00

__init__.py

feat(fc2a): add TagService — find-or-create, autocomplete, image association

2026-05-14 12:04:48 -04:00

archive_extractor.py

fix(archive): magic-byte archive detection so mis-named archives extract — #713 part 1

2026-06-06 14:33:24 -04:00

artist_directory_service.py

feat(artist): "new since last visit" badge + banner

2026-06-03 15:27:11 -04:00

artist_membership_service.py

feat: what you pay for, against what FC actually follows (387 C4)

2026-09-11 21:38:03 -04:00

artist_service.py

feat: the Discord Add panel's artist field autocompletes against FabledCurator's artists (milestone 429)

2026-09-25 07:45:51 -04:00

attachment_store.py

feat(attachments): sha-addressed AttachmentStore

2026-05-19 11:11:07 -04:00

backup_destination.py

feat: Settings can point backups at an off-site S3 bucket, with a Test destination check

2026-11-06 16:04:57 -05:00

backup_s3.py

feat: Settings can point backups at an off-site S3 bucket, with a Test destination check

2026-11-06 16:04:57 -05:00

backup_service.py

fix: the images backup carried the key to the accounts it backs up (4234)

2026-09-21 08:35:35 -04:00

bulk_tag_service.py

chore(tags): remove orphaned cluster tag-gaps route + service method

2026-06-26 11:47:48 -04:00

cleanup_service.py

feat(cleanup): reclaim orphaned attachments — rows and store blobs (#3068)

2026-08-26 22:37:24 -04:00

credential_crypto.py

fix: the race fix's temp name assumed one bootstrap per process (4295)

2026-09-23 13:11:29 -04:00

credential_service.py

refactor(platforms): retire deviantart end-to-end (#3069)

2026-08-27 07:24:08 -04:00

db_helpers.py

fix: a stopped source is not a failing one, and cannot be deep-scanned (4279)

2026-09-21 19:25:42 -04:00

discord_client.py

chore: the poster-picker comments name their task #4491

2026-09-28 10:03:06 -04:00

discord_downloader.py

feat: a Discord source can remove the posts it took from people outside its poster list (#4486)

2026-09-28 08:34:06 -04:00

discord_grouping.py

fix: a Discord message that re-posts a file is grouped, and joins the drop it repeats

2026-09-24 15:21:05 -04:00

discord_ingester.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

discord_poster_cleanup.py

feat: a Discord source can remove the posts it took from people outside its poster list (#4486)

2026-09-28 08:34:06 -04:00

discord_repair.py

feat: Settings can re-download the Discord images the None naming broke (3999)

2026-09-13 20:52:32 -04:00

download_backends.py

feat: Discord on the native core ingester — client, downloader, ledgers, wiring (milestone 428)

2026-09-24 19:42:00 -04:00

download_recovery.py

fix: the download boot hook imports a model-only module, keeping the membership roster off the fetch path (#4433)

2026-09-25 10:32:41 -04:00

download_service.py

fix: downloads stop leaving files on disk that the library doesn't use

2026-11-05 18:00:31 -05:00

extension_service.py

chore: the poster-picker comments name their task #4491

2026-09-28 10:03:06 -04:00

external_fetch.py

fix: a Mega folder link's files in subfolders are imported, and a retry no longer deletes complete files

2026-11-06 10:24:14 -05:00

external_links.py

fix: dead external links are retried sparingly, not three times a day

2026-11-05 19:13:46 -05:00

file_validator.py

refactor(downloads): DRY the ingester/gallery-dl seam — A1–A4 (plan #707)

2026-06-06 11:11:25 -04:00

gallery_dl.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

gallery_service.py

feat: retire pixiv entirely — delete its code, its ledgers, its credential (3977, 3978, 3979)

2026-09-21 20:46:15 -04:00

image_tag_apply.py

perf(ml): batch the auto-apply sweeps' image_tag inserts (#3072)

2026-08-27 07:51:23 -04:00

importer.py

fix: two copies of one picture imported at once are filed as duplicates, and an archive's row always ends

2026-11-06 18:35:51 -05:00

ingest_core.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

interpreter_client.py

feat(translation): 8h sweep + drain button + detection probe (#1376)

2026-07-08 20:13:49 -04:00

library_scan.py

feat: Cleanup can import files that are on disk but not in the library

2026-11-06 10:31:37 -05:00

link_extract.py

feat(posts): extract + record external file-host links (Phase 3)

2026-06-14 13:15:36 -04:00

membership_reconcile.py

feat: a source stops pulling once its membership ends, and resumes on resubscribe (3995)

2026-09-13 22:08:06 -04:00

membership_roster.py

fix: the membership status vocabulary moves beside Membership, so the Patreon client never imports the roster

2026-09-13 16:07:26 -04:00

native_ingest_common.py

fix: the membership status vocabulary moves beside Membership, so the Patreon client never imports the roster

2026-09-13 16:07:26 -04:00

page_number_parser.py

feat(series): post→series flows + browse list — backend (FC-6.2)

2026-06-07 18:34:11 -04:00

pagination.py

refactor(services): shared pagination cursor (DRY sweep)

2026-06-10 00:10:57 -04:00

patreon_client.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

patreon_downloader.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

patreon_ingester.py

feat(pixiv): flip dispatch to the native ingester (#129 step 4)

2026-07-03 09:54:18 -04:00

patreon_resolver.py

refactor(patreon): DRY the campaigns-API request (#161)

2026-07-13 21:41:34 -04:00

platform_lock.py

fix: a restart no longer strands downloads — the download lane closes its predecessor's runs as interrupted and frees the platform locks at boot (#4433)

2026-09-25 10:29:05 -04:00

post_association_service.py

fix: the matcher sees a drop's names, finds merged trickles, and catches up on its own (4390, 4392)

2026-09-24 14:01:07 -04:00

post_body.py

fix: the provenance panel hotlinked the CDN for images already on disk (3965)

2026-09-12 19:57:00 -04:00

post_feed_service.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

post_naming.py

feat: a creator's trickle becomes one drop instead of a card per message (4390)

2026-09-24 13:47:25 -04:00

post_record_repair.py

fix: a post record is marked seen only after it is upserted, and an hourly sweep dates the posts killed walks left undated (#4436)

2026-09-25 11:36:17 -04:00

post_unification.py

feat: a creator's trickle becomes one drop instead of a card per message (4390)

2026-09-24 13:47:25 -04:00

provenance_service.py

fix: the provenance panel hotlinked the CDN for images already on disk (3965)

2026-09-12 19:57:00 -04:00

refetch_service.py

feat(download): tick/backfill modes + partial-success classifier (plan #544)

2026-06-01 18:23:28 -04:00

scheduler_service.py

fix: a never-checked source still reports no next check while its first backfill is armed

2026-09-24 23:19:23 -04:00

series_match_service.py

feat(series): flat series sequence + cosmetic chapter dividers (#789 Phase 1)

2026-06-11 21:30:01 -04:00

series_service.py

fix(images): percent-encode original-image URLs ('#' in paths 404'd)

2026-06-12 00:36:44 -04:00

service_roster.py

feat: the System tab reads a stored sample instead of inspecting per load (4295)

2026-09-23 18:52:08 -04:00

showcase_service.py

fix(showcase): over-sample + random-order to break near-dup clustering — #699

2026-06-06 15:44:04 -04:00

source_service.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

subscribestar_client.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

subscribestar_downloader.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

subscribestar_ingester.py

feat(pixiv): flip dispatch to the native ingester (#129 step 4)

2026-07-03 09:54:18 -04:00

tag_directory_service.py

feat(tags): system-tag UI markers + full protection sweep (step 4 of #128)

2026-07-03 08:34:16 -04:00

tag_query.py

feat(ui): confirm/keep auto-applied tags (milestone 139)

2026-07-06 18:51:39 -04:00

tag_service.py

feat(ui): confirm/keep auto-applied tags (milestone 139)

2026-07-06 18:51:39 -04:00

thumbnailer.py

feat(fc2a): add Thumbnailer service

2026-05-14 12:05:19 -04:00

wip_title.py

feat: retire the sketch/doodle WIP title tier, and the review strip asks "Is this a WIP?" (milestone 430)

2026-09-25 08:20:28 -04:00

worker_control.py

fix: the lane sizer reads the live pool, so it stops growing a lane past its cap (4409)

2026-09-24 18:21:11 -04:00

worker_lanes.py

feat: the System tab reads a stored sample instead of inspecting per load (4295)

2026-09-23 18:52:08 -04:00