release / go (push) Successful in 1m54s
release / web (push) Failing after 5s
release / integration (push) Failing after 3m44s
release / govulncheck (push) Successful in 20s
release / Attach APK to the Release (tag releases only) (push) Canceled after 0s
release / Build + push container image (push) Canceled after 0s
release / Verify release artifacts (tag releases only) (push) Canceled after 0s
release / Build signed APK (push) Canceled after 19s
release / android (push) Canceled after 2m37s
Minstrel is now a viewer of the library it is pointed at. Finding, downloading and filing music moves out of it. Removed from the server: - the request flow (requests, approval, auto-approve) and the wanted list, follows, release profiles and release blocks; - searching indexers, the download clients, the importer, the album lifecycle and missing-file re-acquisition; - the catalogue's discography, search and art (the MusicBrainz release and track-list cache stays, for the duplicate resolver); - Discover: its suggestions of artists not in the library, snoozes, the candidate-artist tag enrichment and its tuning scope; - writes to acquisition tables from moving the library folder and from merging duplicates, the want-list join on Suspect sources, the sealing of acquisition credentials, and the release-group lookup only re-acquisition used. Settling a wrong-slot duplicate no longer sets the release aside: the copies go and their slots show as missing until a good copy is in the library. Removed from the web: Admin > Acquisition and Requests, /requests, /discover, Follow on the artist page, the auto-approve toggle, and the Collection's wanted-list tabs. The Collection is now the library's health: an overview, Reports, Duplicates, Suspect sources and Missing files. The README and docs no longer describe getting music. The tables stay for now; a later migration drops them. The request notification kinds and the Android screens are still to go. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
149 lines
6.3 KiB
SQL
149 lines
6.3 KiB
SQL
-- name: ListPlayedTracksNeedingSimilarity :many
|
|
-- The worker's track queue: played, present tracks with a recording MBID that
|
|
-- ListenBrainz has never answered for, or not in 30 days. Never-fetched first,
|
|
-- then the oldest answer. Freshness is read from track_similarity_fetches, not
|
|
-- from the edges, so a seed whose answer matched nothing in the library still
|
|
-- counts as fetched; reading the edges would let such seeds hold the head of
|
|
-- the queue forever.
|
|
SELECT t.id, t.mbid
|
|
FROM tracks t
|
|
LEFT JOIN track_similarity_fetches f ON f.track_id = t.id
|
|
WHERE t.mbid IS NOT NULL
|
|
AND t.missing_since IS NULL
|
|
AND EXISTS (SELECT 1 FROM play_events pe WHERE pe.track_id = t.id)
|
|
AND (f.track_id IS NULL OR f.fetched_at < now() - interval '30 days')
|
|
ORDER BY f.fetched_at NULLS FIRST, t.id
|
|
LIMIT $1;
|
|
|
|
-- name: ListPlayedArtistsNeedingSimilarity :many
|
|
-- The artist queue, with the same shape and the same reason.
|
|
SELECT ar.id, ar.mbid
|
|
FROM artists ar
|
|
LEFT JOIN artist_similarity_fetches f ON f.artist_id = ar.id
|
|
WHERE ar.mbid IS NOT NULL
|
|
AND EXISTS (
|
|
SELECT 1 FROM tracks t
|
|
JOIN play_events pe ON pe.track_id = t.id
|
|
WHERE t.artist_id = ar.id
|
|
)
|
|
AND (f.artist_id IS NULL OR f.fetched_at < now() - interval '30 days')
|
|
ORDER BY f.fetched_at NULLS FIRST, ar.id
|
|
LIMIT $1;
|
|
|
|
-- name: GetArtistsByMBIDs :many
|
|
SELECT id, mbid FROM artists WHERE mbid = ANY($1::text[]);
|
|
|
|
-- name: DeleteSimilarRecordingsForSeed :exec
|
|
-- A fetch replaces the seed's cached answer whole.
|
|
DELETE FROM listenbrainz_similar_recordings WHERE seed_track_id = $1;
|
|
|
|
-- name: InsertSimilarRecordings :exec
|
|
-- The seed's whole answer, in or out of the library. An MBID LB lists twice
|
|
-- keeps its best score.
|
|
INSERT INTO listenbrainz_similar_recordings (seed_track_id, recording_mbid, score)
|
|
SELECT sqlc.arg(seed_track_id)::uuid, r.mbid, max(r.score)
|
|
FROM (SELECT unnest(sqlc.arg(mbids)::text[]) AS mbid,
|
|
unnest(sqlc.arg(scores)::float8[]) AS score) r
|
|
WHERE r.mbid <> ''
|
|
GROUP BY r.mbid;
|
|
|
|
-- name: RecordTrackSimilarityFetch :exec
|
|
INSERT INTO track_similarity_fetches (track_id, fetched_at, returned)
|
|
VALUES ($1, now(), $2)
|
|
ON CONFLICT (track_id) DO UPDATE SET fetched_at = now(), returned = EXCLUDED.returned;
|
|
|
|
-- name: RecordArtistSimilarityFetch :exec
|
|
INSERT INTO artist_similarity_fetches (artist_id, fetched_at, returned)
|
|
VALUES ($1, now(), $2)
|
|
ON CONFLICT (artist_id) DO UPDATE SET fetched_at = now(), returned = EXCLUDED.returned;
|
|
|
|
-- name: ResolveListenBrainzTrackEdges :exec
|
|
-- Derives the listenbrainz edges in track_similarity from the cached answers:
|
|
-- every cached recording that is a present track in the library becomes an
|
|
-- edge, whenever it got there. Scoped to the given seeds, or every seed when
|
|
-- seed_ids is NULL.
|
|
--
|
|
-- One track per recording MBID: two copies of a song (an mp3 beside its flac,
|
|
-- or one recording on two releases) would otherwise be two candidates, and the
|
|
-- pool would offer the same song twice. No cap per seed: LB's answer is already
|
|
-- at most 50.
|
|
--
|
|
-- The score is RELATIVE: each edge's LB score over the seed's best score in its
|
|
-- whole cached answer, so 1.0 is the seed's closest recording and the rest fall
|
|
-- below it. LB's raw scores are counts, into the thousands, and the scorer
|
|
-- reads similarity as 0 to 1, so a raw edge would outweigh likes, skips and
|
|
-- recency together. The cache keeps the raw
|
|
-- answer; only the edge is scaled.
|
|
--
|
|
-- Only edges of seeds the cache owns are removed, those with a fetch row.
|
|
-- Edges written before the cache existed, or copied onto a survivor by a fold
|
|
-- (merge.sql), stay until their seed is fetched.
|
|
WITH best AS (
|
|
SELECT seed_track_id, max(score) AS score
|
|
FROM listenbrainz_similar_recordings
|
|
WHERE sqlc.narg(seed_ids)::uuid[] IS NULL
|
|
OR seed_track_id = ANY(sqlc.narg(seed_ids)::uuid[])
|
|
GROUP BY seed_track_id
|
|
),
|
|
want AS (
|
|
SELECT DISTINCT ON (c.seed_track_id, c.recording_mbid)
|
|
c.seed_track_id AS track_a_id, t.id AS track_b_id,
|
|
CASE WHEN b.score > 0 THEN c.score / b.score ELSE 0 END AS score
|
|
FROM listenbrainz_similar_recordings c
|
|
JOIN best b ON b.seed_track_id = c.seed_track_id
|
|
JOIN tracks t ON t.mbid = c.recording_mbid
|
|
AND t.missing_since IS NULL
|
|
AND t.id <> c.seed_track_id
|
|
WHERE sqlc.narg(seed_ids)::uuid[] IS NULL
|
|
OR c.seed_track_id = ANY(sqlc.narg(seed_ids)::uuid[])
|
|
ORDER BY c.seed_track_id, c.recording_mbid, t.id
|
|
),
|
|
upserted AS (
|
|
INSERT INTO track_similarity (track_a_id, track_b_id, score, source, fetched_at)
|
|
SELECT track_a_id, track_b_id, score, 'listenbrainz', now() FROM want
|
|
ON CONFLICT (track_a_id, track_b_id, source) DO UPDATE
|
|
SET score = EXCLUDED.score, fetched_at = EXCLUDED.fetched_at
|
|
WHERE track_similarity.score IS DISTINCT FROM EXCLUDED.score
|
|
RETURNING 1
|
|
)
|
|
DELETE FROM track_similarity ts
|
|
WHERE ts.source = 'listenbrainz'
|
|
AND (sqlc.narg(seed_ids)::uuid[] IS NULL OR ts.track_a_id = ANY(sqlc.narg(seed_ids)::uuid[]))
|
|
AND EXISTS (SELECT 1 FROM track_similarity_fetches f WHERE f.track_id = ts.track_a_id)
|
|
AND NOT EXISTS (
|
|
SELECT 1 FROM want w
|
|
WHERE w.track_a_id = ts.track_a_id AND w.track_b_id = ts.track_b_id
|
|
);
|
|
|
|
-- name: UpsertArtistSimilarity :exec
|
|
INSERT INTO artist_similarity (artist_a_id, artist_b_id, score, source, fetched_at)
|
|
VALUES ($1, $2, $3, 'listenbrainz', now())
|
|
ON CONFLICT (artist_a_id, artist_b_id, source)
|
|
DO UPDATE SET score = EXCLUDED.score, fetched_at = EXCLUDED.fetched_at;
|
|
|
|
-- name: ListSimilarArtistsForArtist :many
|
|
-- In-library artists similar to a seed artist, ranked by best similarity
|
|
-- score across sources (deduped per candidate). cover_album_id + album_count
|
|
-- mirror ListArtistsAlphaWithCovers so the strip renders identical cards.
|
|
SELECT sqlc.embed(artists),
|
|
cov.id AS cover_album_id,
|
|
cnt.album_count::bigint AS album_count
|
|
FROM (
|
|
SELECT artist_b_id, max(score) AS sim_score
|
|
FROM artist_similarity
|
|
WHERE artist_a_id = sqlc.arg(seed_artist_id)
|
|
GROUP BY artist_b_id
|
|
) s
|
|
JOIN artists ON artists.id = s.artist_b_id
|
|
LEFT JOIN LATERAL (
|
|
SELECT id FROM albums
|
|
WHERE artist_id = artists.id AND cover_art_path IS NOT NULL
|
|
ORDER BY created_at DESC LIMIT 1
|
|
) cov ON true
|
|
LEFT JOIN LATERAL (
|
|
SELECT count(*) AS album_count
|
|
FROM albums WHERE artist_id = artists.id
|
|
) cnt ON true
|
|
ORDER BY s.sim_score DESC, artists.sort_name
|
|
LIMIT sqlc.arg(result_limit);
|