bvandeusenandClaude Opus 5.5 3f5224800e fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk ...

A Discord recapture chunk on #banana-land was killed at the 1350s soft limit
twice (events 92354 on 2026-09-28 and 92623 on 2026-09-29). The walk's
budget (CHUNK_TOTAL_SECONDS, #4407) assumed 2.5s per import; measured on
those chunks, a real import of the source's doodles took about 5s, so ~290
imports the walk had planned to fit took about twice the time reserved.

- PHASE3_DEADLINE_SECONDS (1200s from task start): on native platforms
  phase 3 starts no import past it. The files left stay on disk with no
  record and are not marked seen; the next chunk resumes on the page that
  holds the first of them and imports them through the existing "on disk
  but never imported" path. A walk that reached its end becomes PARTIAL so
  the backfill is not marked complete while files wait.
- DownloadResult.written_cursors records each written file's page cursor;
  mark_seen_after_import takes skip_paths.
- PHASE3_IMPORT_SECONDS 2.5 -> 5.0, the slow end of what was measured, so
  the walk rarely leans on the deadline.

Task #4493.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-05 09:53:57 -05:00

..

audits

fix: the single-color filter no longer takes line art for a blank image (#4483)

2026-09-28 08:12:43 -04:00

ml

feat: retire the sketch/doodle WIP title tier, and the review strip asks "Is this a WIP?" (milestone 430)

2026-09-25 08:20:28 -04:00

platforms

feat: retire pixiv entirely — delete its code, its ledgers, its credential (3977, 3978, 3979)

2026-09-21 20:46:15 -04:00

__init__.py

feat(fc2a): add TagService — find-or-create, autocomplete, image association

2026-05-14 12:04:48 -04:00

archive_extractor.py

fix(archive): magic-byte archive detection so mis-named archives extract — #713 part 1

2026-06-06 14:33:24 -04:00

artist_directory_service.py

feat(artist): "new since last visit" badge + banner

2026-06-03 15:27:11 -04:00

artist_membership_service.py

feat: what you pay for, against what FC actually follows (387 C4)

2026-09-11 21:38:03 -04:00

artist_service.py

feat: the Discord Add panel's artist field autocompletes against FabledCurator's artists (milestone 429)

2026-09-25 07:45:51 -04:00

attachment_store.py

feat(attachments): sha-addressed AttachmentStore

2026-05-19 11:11:07 -04:00

backup_service.py

fix: the images backup carried the key to the accounts it backs up (4234)

2026-09-21 08:35:35 -04:00

bulk_tag_service.py

chore(tags): remove orphaned cluster tag-gaps route + service method

2026-06-26 11:47:48 -04:00

cleanup_service.py

feat(cleanup): reclaim orphaned attachments — rows and store blobs (#3068)

2026-08-26 22:37:24 -04:00

credential_crypto.py

fix: the race fix's temp name assumed one bootstrap per process (4295)

2026-09-23 13:11:29 -04:00

credential_service.py

refactor(platforms): retire deviantart end-to-end (#3069)

2026-08-27 07:24:08 -04:00

db_helpers.py

fix: a stopped source is not a failing one, and cannot be deep-scanned (4279)

2026-09-21 19:25:42 -04:00

discord_client.py

chore: the poster-picker comments name their task #4491

2026-09-28 10:03:06 -04:00

discord_downloader.py

feat: a Discord source can remove the posts it took from people outside its poster list (#4486)

2026-09-28 08:34:06 -04:00

discord_grouping.py

fix: a Discord message that re-posts a file is grouped, and joins the drop it repeats

2026-09-24 15:21:05 -04:00

discord_ingester.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

discord_poster_cleanup.py

feat: a Discord source can remove the posts it took from people outside its poster list (#4486)

2026-09-28 08:34:06 -04:00

discord_repair.py

feat: Settings can re-download the Discord images the None naming broke (3999)

2026-09-13 20:52:32 -04:00

download_backends.py

feat: Discord on the native core ingester — client, downloader, ledgers, wiring (milestone 428)

2026-09-24 19:42:00 -04:00

download_recovery.py

fix: the download boot hook imports a model-only module, keeping the membership roster off the fetch path (#4433)

2026-09-25 10:32:41 -04:00

download_service.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

extension_service.py

chore: the poster-picker comments name their task #4491

2026-09-28 10:03:06 -04:00

external_fetch.py

fix(external): split fetch timeout into read (60s) + total (30m) budgets (#883)

2026-06-16 21:15:49 -04:00

external_links.py

feat(recovery): surgical re-fetch for deep posts via ExternalLink reset

2026-07-02 21:07:21 -04:00

file_validator.py

refactor(downloads): DRY the ingester/gallery-dl seam — A1–A4 (plan #707)

2026-06-06 11:11:25 -04:00

gallery_dl.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

gallery_service.py

feat: retire pixiv entirely — delete its code, its ledgers, its credential (3977, 3978, 3979)

2026-09-21 20:46:15 -04:00

image_tag_apply.py

perf(ml): batch the auto-apply sweeps' image_tag inserts (#3072)

2026-08-27 07:51:23 -04:00

importer.py

fix: a non-image file lands on the source it was downloaded for, and the undated shells it left are folded into their real posts (#4435)

2026-09-25 10:56:08 -04:00

ingest_core.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

interpreter_client.py

feat(translation): 8h sweep + drain button + detection probe (#1376)

2026-07-08 20:13:49 -04:00

link_extract.py

feat(posts): extract + record external file-host links (Phase 3)

2026-06-14 13:15:36 -04:00

membership_reconcile.py

feat: a source stops pulling once its membership ends, and resumes on resubscribe (3995)

2026-09-13 22:08:06 -04:00

membership_roster.py

fix: the membership status vocabulary moves beside Membership, so the Patreon client never imports the roster

2026-09-13 16:07:26 -04:00

native_ingest_common.py

fix: the membership status vocabulary moves beside Membership, so the Patreon client never imports the roster

2026-09-13 16:07:26 -04:00

page_number_parser.py

feat(series): post→series flows + browse list — backend (FC-6.2)

2026-06-07 18:34:11 -04:00

pagination.py

refactor(services): shared pagination cursor (DRY sweep)

2026-06-10 00:10:57 -04:00

patreon_client.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

patreon_downloader.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

patreon_ingester.py

feat(pixiv): flip dispatch to the native ingester (#129 step 4)

2026-07-03 09:54:18 -04:00

patreon_resolver.py

refactor(patreon): DRY the campaigns-API request (#161)

2026-07-13 21:41:34 -04:00

platform_lock.py

fix: a restart no longer strands downloads — the download lane closes its predecessor's runs as interrupted and frees the platform locks at boot (#4433)

2026-09-25 10:29:05 -04:00

post_association_service.py

fix: the matcher sees a drop's names, finds merged trickles, and catches up on its own (4390, 4392)

2026-09-24 14:01:07 -04:00

post_body.py

fix: the provenance panel hotlinked the CDN for images already on disk (3965)

2026-09-12 19:57:00 -04:00

post_feed_service.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

post_naming.py

feat: a creator's trickle becomes one drop instead of a card per message (4390)

2026-09-24 13:47:25 -04:00

post_record_repair.py

fix: a post record is marked seen only after it is upserted, and an hourly sweep dates the posts killed walks left undated (#4436)

2026-09-25 11:36:17 -04:00

post_unification.py

feat: a creator's trickle becomes one drop instead of a card per message (4390)

2026-09-24 13:47:25 -04:00

provenance_service.py

fix: the provenance panel hotlinked the CDN for images already on disk (3965)

2026-09-12 19:57:00 -04:00

refetch_service.py

feat(download): tick/backfill modes + partial-success classifier (plan #544)

2026-06-01 18:23:28 -04:00

scheduler_service.py

fix: a never-checked source still reports no next check while its first backfill is armed

2026-09-24 23:19:23 -04:00

series_match_service.py

feat(series): flat series sequence + cosmetic chapter dividers (#789 Phase 1)

2026-06-11 21:30:01 -04:00

series_service.py

fix(images): percent-encode original-image URLs ('#' in paths 404'd)

2026-06-12 00:36:44 -04:00

service_roster.py

feat: the System tab reads a stored sample instead of inspecting per load (4295)

2026-09-23 18:52:08 -04:00

showcase_service.py

fix(showcase): over-sample + random-order to break near-dup clustering — #699

2026-06-06 15:44:04 -04:00

source_service.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

subscribestar_client.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

subscribestar_downloader.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

subscribestar_ingester.py

feat(pixiv): flip dispatch to the native ingester (#129 step 4)

2026-07-03 09:54:18 -04:00

tag_directory_service.py

feat(tags): system-tag UI markers + full protection sweep (step 4 of #128)

2026-07-03 08:34:16 -04:00

tag_query.py

feat(ui): confirm/keep auto-applied tags (milestone 139)

2026-07-06 18:51:39 -04:00

tag_service.py

feat(ui): confirm/keep auto-applied tags (milestone 139)

2026-07-06 18:51:39 -04:00

thumbnailer.py

feat(fc2a): add Thumbnailer service

2026-05-14 12:05:19 -04:00

wip_title.py

feat: retire the sketch/doodle WIP title tier, and the review strip asks "Is this a WIP?" (milestone 430)

2026-09-25 08:20:28 -04:00

worker_control.py

fix: the lane sizer reads the live pool, so it stops growing a lane past its cap (4409)

2026-09-24 18:21:11 -04:00

worker_lanes.py

feat: the System tab reads a stored sample instead of inspecting per load (4295)

2026-09-23 18:52:08 -04:00