feat(ansible): runner robustness — cancel, concurrency, structured results, retention
CI / lint (push) Successful in 2s
CI / unit (push) Successful in 7s
CI / integration (push) Successful in 2m18s
CI / publish (push) Successful in 55s

Closes #550 (all four):

- Cancellation: track live subprocesses; POST /ansible/runs/<id>/cancel
  (operator) SIGTERMs then SIGKILLs after a grace; new 'cancelled' status
  (+ migration 0019, ALTER TYPE in autocommit). Queued runs cancel cleanly
  before launch. Cancel button on run detail.
- Concurrency: global semaphore (ansible.max_concurrent_runs, default 3,
  Settings→Ansible) caps simultaneous runs; excess show 'queued' (new status)
  until a slot frees. Semaphore bound lazily per running loop.
- Structured results: parse PLAY RECAP into per-host ok/changed/unreachable/
  failed/skipped + capture failed-task lines, stored in new results JSON
  column (migration 0020); rendered as a host-summary table on run detail.
  Keeps live streaming (no json-callback swap).
- Retention: full output written to a persistent log artifact
  (/data/ansible/runs/<id>.log, env-overridable) beyond the 1 MB DB cap and
  across restarts; in-memory replay buffer bounded + GC'd after completion;
  Download-log route. Boot reconciliation now also sweeps stale 'queued'.

Unit tests for recap parsing + cancel flagging. Status colors updated across
run list / detail / schedules.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
2026-06-16 14:51:04 -04:00
parent 389002fc6f
commit 88857be24e
13 changed files with 406 additions and 61 deletions
+6 -1
View File
@@ -8,10 +8,12 @@ from .base import Base
class AnsibleRunStatus(str, enum.Enum):
queued = "queued" # waiting for a concurrency slot
running = "running"
success = "success"
failed = "failed"
interrupted = "interrupted"
interrupted = "interrupted" # process/host died mid-run (e.g. app restart)
cancelled = "cancelled" # stopped by an operator
class AnsibleRun(Base):
@@ -39,3 +41,6 @@ class AnsibleRun(Base):
output: Mapped[str | None] = mapped_column(Text, nullable=True)
# Optional run parameters: {extra_vars: [..], limit: str, tags: str, check: bool}.
params: Mapped[dict | None] = mapped_column(JSON, nullable=True)
# Parsed per-host summary + captured failures:
# {hosts: {name: {ok,changed,unreachable,failed,skipped}}, failures: [str]}.
results: Mapped[dict | None] = mapped_column(JSON, nullable=True)