bvandeusenandClaude Opus 5.5
84e5448941
CI and images / lint (push) Successful in 3s
CI and images / extension-version (push) Successful in 3s
CI and images / frontend-build (push) Successful in 25s
CI and images / backend-lint-and-test (push) Successful in 32s
CI and images / integration (push) Successful in 2m27s
CI and images / sign-extension (push) Successful in 3s
CI and images / build-agent (push) Successful in 5s
CI and images / build-web (push) Successful in 1m48s
CI and images / smoke-web (push) Successful in 54s
CI and images / promote (push) Successful in 1s
Discord was the last focus platform still on gallery-dl. This adds the native path, mirrored from gallery-dl 1.32.13's discord extractor: - discord_client: API v10 with the user token and gallery-dl's request profile (dated Firefox UA, Referer). Walks a server, category, forum, channel or thread in gallery-dl's order and pages each channel newest-first. Files are attachments, then embeds, then forwards, numbered across the message. The resume cursor is <channel>:<before>. Text-only messages are not posts, since gallery-dl never made them. - discord_downloader: gallery-dl's on-disk layout, cleaned the way it cleans names on Linux (only `/` and control characters change), so existing files are skipped_disk rather than fetched again. Sidecars carry identity only. The message record keeps gallery-dl's keys, so parse_sidecar, derive_post_url and the drop grouping read it unchanged. - The ledger keys on the attachment id (or a hash of an embed's URL path), not the file's position, which an edit can renumber. Migration 0111. - DiscordIngester: token auth, body canary off (files-only drops are normal). Registered as native, verified by token, and serialised per-platform, since every source shares one user token. - ingest_core: optional `skip_feed` client seam (#4413). A tick's early-out on a multi-channel source now ends the quiet channel, not the whole walk. Clients without the seam behave as before. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LVjrnpQjRgHdvq95rASoiR
41 lines
1.3 KiB
Python
41 lines
1.3 KiB
Python
"""Per-platform download concurrency cap (Redis lock)."""
|
|
import pytest
|
|
|
|
from backend.app.services.platform_lock import platform_lock
|
|
|
|
# Needs the broker (Redis) the lock lives in.
|
|
pytestmark = pytest.mark.integration
|
|
|
|
|
|
def test_non_serialized_platform_has_no_lock():
|
|
# gallery-dl platforms aren't capped — they get no lock at all.
|
|
assert platform_lock("hentaifoundry", ttl_seconds=60) is None
|
|
|
|
|
|
def test_discord_is_serialized():
|
|
# Native since milestone 428, and every source shares one user token.
|
|
assert platform_lock("discord", ttl_seconds=60) is not None
|
|
|
|
|
|
def test_subscribestar_is_serialized():
|
|
# subscribestar is a native-ingester platform now — one paced walk at a time.
|
|
lock = platform_lock("subscribestar", ttl_seconds=60)
|
|
assert lock is not None
|
|
|
|
|
|
def test_patreon_serializes_to_one_holder():
|
|
first = platform_lock("patreon", ttl_seconds=60)
|
|
assert first is not None
|
|
assert first.acquire(blocking=False) is True
|
|
try:
|
|
# A second acquirer is refused while the first holds it.
|
|
second = platform_lock("patreon", ttl_seconds=60)
|
|
assert second.acquire(blocking=False) is False
|
|
finally:
|
|
first.release()
|
|
|
|
# Once released, the platform is acquirable again.
|
|
third = platform_lock("patreon", ttl_seconds=60)
|
|
assert third.acquire(blocking=False) is True
|
|
third.release()
|