agent: raise worker cap to 32 + size HTTP pool #149

2026-06-29T19:42:04-04:00

bvandeusen commented

2026-06-29 19:42:04 -04:00

At 8 workers the operator's GPU sat at ~5% util / <5 GB VRAM — the pipeline is I/O-bound (HTTP image download + decode), so the GPU starves until many workers overlap that I/O. Raises MAX_CONCURRENCY 8→32, makes the UI worker control a number input (cap reported via /status), and sizes the shared requests connection pool to 64 so 32 workers don't bottleneck on the default pool of 10. Agent-only; triggers a build-agent republish.

🤖 Generated with Claude Code

At 8 workers the operator's GPU sat at ~5% util / <5 GB VRAM — the pipeline is I/O-bound (HTTP image download + decode), so the GPU starves until many workers overlap that I/O. Raises `MAX_CONCURRENCY` 8→32, makes the UI worker control a number input (cap reported via `/status`), and sizes the shared `requests` connection pool to 64 so 32 workers don't bottleneck on the default pool of 10. Agent-only; triggers a `build-agent` republish. 🤖 Generated with [Claude Code](https://claude.com/claude-code)

bvandeusen added 1 commit 2026-06-29 19:42:04 -04:00

feat(agent): raise worker cap to 32 + size the HTTP pool for it (#114 )

CI / lint (push) Successful in 3s

Details

CI / frontend-build (push) Successful in 19s

Details

CI / backend-lint-and-test (push) Successful in 28s

Details

CI / integration (push) Successful in 3m35s

Details

b7fd69815e

At 8 workers the GPU sat at ~5% util / <5GB VRAM — the pipeline is I/O-bound
(downloading + decoding images over HTTP), so the GPU starves until many workers
overlap that I/O. Raise MAX_CONCURRENCY 8→32 and make the UI worker control a
number input (reaching 32 by ±1 was tedious); the cap is reported via /status so
the UI clamps to it. Also size the shared requests pool (pool_maxsize=64) — the
default 10 would have throttled 32 workers + spammed "connection pool is full".

Verified by running; watch GPU util/VRAM climb as you dial up.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Ttrj5P7upUTueSfoJcxEqa

bvandeusen merged commit 7e3c0f0b74 into main

2026-06-29 19:42:11 -04:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: bvandeusen/FabledCurator#149