release / govulncheck (push) Successful in 17s
release / web (push) Failing after 17s
release / go (push) Successful in 1m11s
release / integration (push) Successful in 4m50s
release / android (push) Successful in 4m54s
release / Build signed APK (releases and dev) (push) Successful in 5m9s
release / Attach APK to the Release (tag releases only) (push) Skipped
release / Build + push container image (push) Skipped
release / Verify release artifacts (tag releases only) (push) Skipped
Ported from Fabled Librarian's System 104. A new lifecycle poller, every ten minutes: - a download the client fails is given up at once; - one nobody shares, or still fetching its file list, past the stall setting (6 h) is asked for again three times, then given up; - giving up removes the download with its files, holds the release back for a week (release_blocks.expires_at), ends the grab and searches the album again, with no limit per album; - a running download the client stops listing for half an hour ends and is searched again, not held back; an empty list is not taken as gone; - an imported download seeds to ratio 2.0 or 14 days, then is removed; - a download the client would not remove is asked again every pass. Every condition and act is one open row per (client, download, condition) in download_interventions. Activity shows what is wrong with a download and how often it was retried, why one ended, its seeding, and a banner for a client that does not answer. A running download can be given up by hand (set aside for good). The seed ratio, seed days and stall hours are on the search settings card. The download client lookup moves to acquire.DownloadClientFor, shared by the importer and the lifecycle. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
97 lines
4.4 KiB
SQL
97 lines
4.4 KiB
SQL
-- The download lifecycle (M502 #5523): the intervention ledger, giving a
|
|
-- download up, and seeding after import.
|
|
|
|
-- name: RaiseIntervention :one
|
|
-- A condition seen, or seen again: a second pass lands on the open row, so
|
|
-- a download stuck for a week is one row that says how long. The name only
|
|
-- improves, and the detail is the latest word.
|
|
INSERT INTO download_interventions (client, info_hash, grab_id, name, trigger, detail)
|
|
VALUES (sqlc.arg(client), sqlc.arg(info_hash), sqlc.narg(grab_id), sqlc.arg(name),
|
|
sqlc.arg(trigger), sqlc.arg(detail))
|
|
ON CONFLICT (client, info_hash, trigger) WHERE outcome = 'open' DO UPDATE SET
|
|
observations = download_interventions.observations + 1,
|
|
last_seen = now(),
|
|
detail = EXCLUDED.detail,
|
|
grab_id = COALESCE(EXCLUDED.grab_id, download_interventions.grab_id),
|
|
name = CASE WHEN EXCLUDED.name <> '' THEN EXCLUDED.name ELSE download_interventions.name END
|
|
RETURNING *;
|
|
|
|
-- name: SettleIntervention :execrows
|
|
-- The condition cleared.
|
|
UPDATE download_interventions
|
|
SET outcome = 'resolved', settled_at = now(), last_seen = now()
|
|
WHERE client = sqlc.arg(client) AND info_hash = sqlc.arg(info_hash)
|
|
AND trigger = sqlc.arg(trigger) AND outcome = 'open';
|
|
|
|
-- name: SettleInterventionsFor :execrows
|
|
-- Everything open about one download is over: it is gone from the client.
|
|
UPDATE download_interventions
|
|
SET outcome = 'resolved', settled_at = now(), last_seen = now()
|
|
WHERE client = sqlc.arg(client) AND info_hash = sqlc.arg(info_hash) AND outcome = 'open';
|
|
|
|
-- name: SettleEndedGrabs :execrows
|
|
-- What was wrong with a download whose grab has ended (imported, refused,
|
|
-- given up) is over, except a download left in the client to remove.
|
|
UPDATE download_interventions di
|
|
SET outcome = 'resolved', settled_at = now(), last_seen = now()
|
|
FROM grabs g
|
|
WHERE g.id = di.grab_id AND g.ended_at IS NOT NULL
|
|
AND di.outcome = 'open' AND di.trigger <> 'not_removed';
|
|
|
|
-- name: CountRemediation :one
|
|
-- Minstrel acted on an open condition. A retry climbs the ladder; giving up
|
|
-- or removing ends the condition, since what it was about is gone. Written
|
|
-- before the act, so a retry that happened is never uncounted.
|
|
UPDATE download_interventions
|
|
SET remediations = remediations + 1,
|
|
action = sqlc.arg(action),
|
|
last_seen = now(),
|
|
outcome = CASE WHEN sqlc.arg(action)::text IN ('given_up', 'removed') THEN 'resolved' ELSE outcome END,
|
|
settled_at = CASE WHEN sqlc.arg(action)::text IN ('given_up', 'removed') THEN now() ELSE settled_at END
|
|
WHERE client = sqlc.arg(client) AND info_hash = sqlc.arg(info_hash)
|
|
AND trigger = sqlc.arg(trigger) AND outcome = 'open'
|
|
RETURNING remediations;
|
|
|
|
-- name: ListLeftovers :many
|
|
-- Downloads given up on that the client would not remove; each pass asks
|
|
-- again.
|
|
SELECT * FROM download_interventions
|
|
WHERE trigger = 'not_removed' AND outcome = 'open' AND info_hash <> ''
|
|
ORDER BY first_seen;
|
|
|
|
-- name: ListClientsDown :many
|
|
-- Download clients not answering now, for the Activity tab.
|
|
SELECT client, detail, first_seen FROM download_interventions
|
|
WHERE trigger = 'client_unreachable' AND outcome = 'open'
|
|
ORDER BY client;
|
|
|
|
-- name: LiveGrabOnHash :one
|
|
SELECT EXISTS (SELECT 1 FROM grabs WHERE info_hash = sqlc.arg(info_hash) AND ended_at IS NULL)::bool;
|
|
|
|
-- name: GiveUpGrab :one
|
|
-- Ends a running grab, given up on. Only from the states named: the update
|
|
-- is the lock against an import that claimed the download meanwhile.
|
|
UPDATE grabs
|
|
SET ended_at = now(), end_reason = sqlc.arg(end_reason), end_detail = sqlc.arg(end_detail),
|
|
import_updated_at = now()
|
|
WHERE id = sqlc.arg(id) AND ended_at IS NULL AND import_state = ANY(sqlc.arg(states)::text[])
|
|
RETURNING *;
|
|
|
|
-- name: ListSeedingGrabs :many
|
|
-- Imported downloads still sharing, oldest import first.
|
|
SELECT id, client, info_hash, name, imported_at FROM grabs
|
|
WHERE seeding AND seed_released_at IS NULL
|
|
ORDER BY imported_at, id;
|
|
|
|
-- name: SetGrabRatio :exec
|
|
UPDATE grabs SET ratio = sqlc.arg(ratio) WHERE id = sqlc.arg(id);
|
|
|
|
-- name: ReleaseSeed :exec
|
|
-- The seeding download was removed, or found gone.
|
|
UPDATE grabs SET seed_released_at = now() WHERE id = $1 AND seed_released_at IS NULL;
|
|
|
|
-- name: DeleteExpiredBlocks :execrows
|
|
-- A release given up on is held back for a while; after that the search may
|
|
-- take it again.
|
|
DELETE FROM release_blocks WHERE expires_at IS NOT NULL AND expires_at <= now();
|