bvandeusenandClaude Opus 5.5 2bea4b0d31 fix: a Mega folder link's files in subfolders are imported, and a retry no longer deletes complete files ...

_fetch_mega listed only the top level of the link dir, so a folder link's
files in subfolders never reached the importer: the link either failed with
"wrote no new file" or read downloaded with its subfolders left on disk.
It now walks the tree.

The worker cleared every unrecorded file in a link dir before each fetch
and after a failed one. Combined with the daily recovery of dead links,
that deletes complete downloads whose upstream is gone, which may be the
only copy. Every fetcher stages to .part or .megatmp.* and renames on
completion, so the clear now removes staging files only, and a successful
fetch imports every complete unrecorded file in the link dir, including
ones an earlier attempt finished.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-06 10:24:14 -05:00

..

audits

fix: the single-color filter no longer takes line art for a blank image (#4483)

2026-09-28 08:12:43 -04:00

ml

feat: retire the sketch/doodle WIP title tier, and the review strip asks "Is this a WIP?" (milestone 430)

2026-09-25 08:20:28 -04:00

platforms

feat: retire pixiv entirely — delete its code, its ledgers, its credential (3977, 3978, 3979)

2026-09-21 20:46:15 -04:00

__init__.py

feat(fc2a): add TagService — find-or-create, autocomplete, image association

2026-05-14 12:04:48 -04:00

archive_extractor.py

fix(archive): magic-byte archive detection so mis-named archives extract — #713 part 1

2026-06-06 14:33:24 -04:00

artist_directory_service.py

feat(artist): "new since last visit" badge + banner

2026-06-03 15:27:11 -04:00

artist_membership_service.py

feat: what you pay for, against what FC actually follows (387 C4)

2026-09-11 21:38:03 -04:00

artist_service.py

feat: the Discord Add panel's artist field autocompletes against FabledCurator's artists (milestone 429)

2026-09-25 07:45:51 -04:00

attachment_store.py

feat(attachments): sha-addressed AttachmentStore

2026-05-19 11:11:07 -04:00

backup_service.py

fix: the images backup carried the key to the accounts it backs up (4234)

2026-09-21 08:35:35 -04:00

bulk_tag_service.py

chore(tags): remove orphaned cluster tag-gaps route + service method

2026-06-26 11:47:48 -04:00

cleanup_service.py

feat(cleanup): reclaim orphaned attachments — rows and store blobs (#3068)

2026-08-26 22:37:24 -04:00

credential_crypto.py

fix: the race fix's temp name assumed one bootstrap per process (4295)

2026-09-23 13:11:29 -04:00

credential_service.py

refactor(platforms): retire deviantart end-to-end (#3069)

2026-08-27 07:24:08 -04:00

db_helpers.py

fix: a stopped source is not a failing one, and cannot be deep-scanned (4279)

2026-09-21 19:25:42 -04:00

discord_client.py

chore: the poster-picker comments name their task #4491

2026-09-28 10:03:06 -04:00

discord_downloader.py

feat: a Discord source can remove the posts it took from people outside its poster list (#4486)

2026-09-28 08:34:06 -04:00

discord_grouping.py

fix: a Discord message that re-posts a file is grouped, and joins the drop it repeats

2026-09-24 15:21:05 -04:00

discord_ingester.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

discord_poster_cleanup.py

feat: a Discord source can remove the posts it took from people outside its poster list (#4486)

2026-09-28 08:34:06 -04:00

discord_repair.py

feat: Settings can re-download the Discord images the None naming broke (3999)

2026-09-13 20:52:32 -04:00

download_backends.py

feat: Discord on the native core ingester — client, downloader, ledgers, wiring (milestone 428)

2026-09-24 19:42:00 -04:00

download_recovery.py

fix: the download boot hook imports a model-only module, keeping the membership roster off the fetch path (#4433)

2026-09-25 10:32:41 -04:00

download_service.py

fix: downloads stop leaving files on disk that the library doesn't use

2026-11-05 18:00:31 -05:00

extension_service.py

chore: the poster-picker comments name their task #4491

2026-09-28 10:03:06 -04:00

external_fetch.py

fix: a Mega folder link's files in subfolders are imported, and a retry no longer deletes complete files

2026-11-06 10:24:14 -05:00

external_links.py

fix: dead external links are retried sparingly, not three times a day

2026-11-05 19:13:46 -05:00

file_validator.py

refactor(downloads): DRY the ingester/gallery-dl seam — A1–A4 (plan #707)

2026-06-06 11:11:25 -04:00

gallery_dl.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

gallery_service.py

feat: retire pixiv entirely — delete its code, its ledgers, its credential (3977, 3978, 3979)

2026-09-21 20:46:15 -04:00

image_tag_apply.py

perf(ml): batch the auto-apply sweeps' image_tag inserts (#3072)

2026-08-27 07:51:23 -04:00

importer.py

fix: downloads stop leaving files on disk that the library doesn't use

2026-11-05 18:00:31 -05:00

ingest_core.py

fix: phase 3 stops importing at a deadline and leaves the rest for the next chunk

2026-11-05 09:53:57 -05:00

interpreter_client.py

feat(translation): 8h sweep + drain button + detection probe (#1376)

2026-07-08 20:13:49 -04:00

link_extract.py

feat(posts): extract + record external file-host links (Phase 3)

2026-06-14 13:15:36 -04:00

membership_reconcile.py

feat: a source stops pulling once its membership ends, and resumes on resubscribe (3995)

2026-09-13 22:08:06 -04:00

membership_roster.py

fix: the membership status vocabulary moves beside Membership, so the Patreon client never imports the roster

2026-09-13 16:07:26 -04:00

native_ingest_common.py

fix: the membership status vocabulary moves beside Membership, so the Patreon client never imports the roster

2026-09-13 16:07:26 -04:00

page_number_parser.py

feat(series): post→series flows + browse list — backend (FC-6.2)

2026-06-07 18:34:11 -04:00

pagination.py

refactor(services): shared pagination cursor (DRY sweep)

2026-06-10 00:10:57 -04:00

patreon_client.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

patreon_downloader.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

patreon_ingester.py

feat(pixiv): flip dispatch to the native ingester (#129 step 4)

2026-07-03 09:54:18 -04:00

patreon_resolver.py

refactor(patreon): DRY the campaigns-API request (#161)

2026-07-13 21:41:34 -04:00

platform_lock.py

fix: a restart no longer strands downloads — the download lane closes its predecessor's runs as interrupted and frees the platform locks at boot (#4433)

2026-09-25 10:29:05 -04:00

post_association_service.py

fix: the matcher sees a drop's names, finds merged trickles, and catches up on its own (4390, 4392)

2026-09-24 14:01:07 -04:00

post_body.py

fix: the provenance panel hotlinked the CDN for images already on disk (3965)

2026-09-12 19:57:00 -04:00

post_feed_service.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

post_naming.py

feat: a creator's trickle becomes one drop instead of a card per message (4390)

2026-09-24 13:47:25 -04:00

post_record_repair.py

fix: a post record is marked seen only after it is upserted, and an hourly sweep dates the posts killed walks left undated (#4436)

2026-09-25 11:36:17 -04:00

post_unification.py

feat: a creator's trickle becomes one drop instead of a card per message (4390)

2026-09-24 13:47:25 -04:00

provenance_service.py

fix: the provenance panel hotlinked the CDN for images already on disk (3965)

2026-09-12 19:57:00 -04:00

refetch_service.py

feat(download): tick/backfill modes + partial-success classifier (plan #544)

2026-06-01 18:23:28 -04:00

scheduler_service.py

fix: a never-checked source still reports no next check while its first backfill is armed

2026-09-24 23:19:23 -04:00

series_match_service.py

feat(series): flat series sequence + cosmetic chapter dividers (#789 Phase 1)

2026-06-11 21:30:01 -04:00

series_service.py

fix(images): percent-encode original-image URLs ('#' in paths 404'd)

2026-06-12 00:36:44 -04:00

service_roster.py

feat: the System tab reads a stored sample instead of inspecting per load (4295)

2026-09-23 18:52:08 -04:00

showcase_service.py

fix(showcase): over-sample + random-order to break near-dup clustering — #699

2026-06-06 15:44:04 -04:00

source_service.py

fix: a Discord source takes only messages with an image attached, from the posters it names, and knows its channel's name (#4481)

2026-09-28 07:03:47 -04:00

subscribestar_client.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

subscribestar_downloader.py

feat: a tick keeps looking back 30 days, so an EDITED post is reached (4386)

2026-09-23 19:21:06 -04:00

subscribestar_ingester.py

feat(pixiv): flip dispatch to the native ingester (#129 step 4)

2026-07-03 09:54:18 -04:00

tag_directory_service.py

feat(tags): system-tag UI markers + full protection sweep (step 4 of #128)

2026-07-03 08:34:16 -04:00

tag_query.py

feat(ui): confirm/keep auto-applied tags (milestone 139)

2026-07-06 18:51:39 -04:00

tag_service.py

feat(ui): confirm/keep auto-applied tags (milestone 139)

2026-07-06 18:51:39 -04:00

thumbnailer.py

feat(fc2a): add Thumbnailer service

2026-05-14 12:05:19 -04:00

wip_title.py

feat: retire the sketch/doodle WIP title tier, and the review strip asks "Is this a WIP?" (milestone 430)

2026-09-25 08:20:28 -04:00

worker_control.py

fix: the lane sizer reads the live pool, so it stops growing a lane past its cap (4409)

2026-09-24 18:21:11 -04:00

worker_lanes.py

feat: the System tab reads a stored sample instead of inspecting per load (4295)

2026-09-23 18:52:08 -04:00