CI & Build / Python lint (push) Successful in 3s
CI & Build / Plugin hooks (push) Successful in 9s
CI & Build / integration (push) Successful in 46s
CI & Build / TypeScript typecheck (push) Successful in 53s
CI & Build / Python tests (push) Successful in 1m44s
CI & Build / Build & push image (push) Successful in 23s
The handshake carried the whole project record, every milestone's plan, full rule text, the notes most recently edited and ~9k of design guidance. For project 2 that was ~222k characters, past what an MCP client accepts as a tool result. Each category was walked through with the operator and sized to what a session needs on arrival; each names the call that has the rest. - project: id, title, status and the full goal (session start's "full goal" pointer still lands here). get_project keeps the whole record. - milestone_summary: the 5 most recently touched milestones, any status, most recent first, without plans. Summaries gain last_touched_at: the later of the milestone's own edit and its newest step update, from the query that already counts steps. milestone_summary_omitted counts the rest and points to list_milestones. get_project and list_milestones list every milestone, also without plans. - open_tasks: the 10 most recently touched open tasks, with or without a milestone, each naming its milestone. list_notes gains sort="touched" (the later of updated_at and the newest work-log), because a log doesn't bump updated_at. - recent_notes: dropped. Retrieval surfaces notes by relevance, and get_recent covers recency. - systems: id and name. - design_system: summary plus guidance_call. get_design_system gains resolved_guidance, the chain-merged prose; its own guidance field is only the departures, so session start's old pointer to it led to a fragment. The session start pointer and using-scribe's "Building UI" section now name resolved_guidance. - rules: rules_payload(brief=True) gives project_rules as id and title plus subscribed_rulebooks, and records only what it shows. Retrieval delivers rules in full and ignores subscriptions (#4052). Other callers unchanged. - pattern_coverage, inception and systems_bootstrap: unchanged. Clients: the plugin's using-scribe skill, the compaction notice and session start are updated here; the REST project summary only gains last_touched_at. Plugin version minted. Tests: a size ceiling on the handshake for a large project; milestone and task selection and naming; brief rules; resolved_guidance; the session start pointer; and a real-Postgres test that a work-log touches its task and a step update touches its milestone. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01821k5B3Ysecp9fNYs92Kuy
139 lines
5.9 KiB
Python
139 lines
5.9 KiB
Python
"""Batched project summaries (#2384).
|
|
|
|
The bug was not wrong output — it was CONNECTION COUNT. A per-project summary
|
|
opened its own session and then one more per milestone, and the route fanned
|
|
that out with asyncio.gather. For 25 projects that asked for roughly 250
|
|
checkouts against a pool of 15, so most waited out the 30-second timeout and
|
|
every other route on the instance queued behind them:
|
|
|
|
QueuePool limit of size 5 overflow 10 reached, connection timed out
|
|
GET /api/settings 500 30584.0ms
|
|
GET /api/projects 200 30882.9ms
|
|
|
|
So these tests assert the number of sessions opened, not only the values
|
|
returned. A version that produced identical output while opening a session per
|
|
project would pass a correctness test and reproduce the outage.
|
|
"""
|
|
from datetime import datetime, timezone
|
|
from unittest.mock import AsyncMock, MagicMock, patch
|
|
|
|
import pytest
|
|
from tests.helpers import make_mock_session
|
|
|
|
|
|
def _session_factory(counter: list[int], results: list):
|
|
"""A session whose .execute() returns queued results, counting opens."""
|
|
def _make():
|
|
s = make_mock_session()
|
|
counter[0] += 1
|
|
|
|
async def _execute(*_a, **_kw):
|
|
rows = results.pop(0) if results else []
|
|
r = MagicMock()
|
|
r.fetchall = MagicMock(return_value=rows)
|
|
r.scalars = MagicMock(return_value=MagicMock(all=lambda: rows))
|
|
return r
|
|
s.execute = _execute
|
|
return s
|
|
return _make
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_summaries_for_many_projects_open_ONE_session():
|
|
"""The whole point. Twenty-five projects must not mean twenty-five
|
|
checkouts — that is the shape that exhausted the pool."""
|
|
from scribe.services import projects as svc
|
|
|
|
opened = [0]
|
|
rows = [
|
|
[(1, "todo", 3), (1, "done", 2), (2, "in_progress", 1)], # task counts
|
|
[(1, 7)], # note counts
|
|
[], # last activity
|
|
]
|
|
with patch.object(svc, "async_session", _session_factory(opened, rows)), \
|
|
patch("scribe.services.milestones.get_project_milestone_summaries",
|
|
AsyncMock(return_value={})):
|
|
out = await svc.get_project_summaries(1, [1, 2])
|
|
|
|
assert opened[0] == 1, f"opened {opened[0]} sessions for 2 projects"
|
|
assert out[1]["task_counts"] == {"todo": 3, "in_progress": 0, "done": 2}
|
|
assert out[1]["note_count"] == 7
|
|
# A project with tasks but no notes still reports 0, not a missing key.
|
|
assert out[2]["task_counts"] == {"todo": 0, "in_progress": 1, "done": 0}
|
|
assert out[2]["note_count"] == 0
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_every_requested_project_gets_an_entry():
|
|
"""A project with no notes at all must still appear. The frontend indexes
|
|
by id and renders `undefined.task_counts` as a crash, not a blank."""
|
|
from scribe.services import projects as svc
|
|
|
|
opened = [0]
|
|
with patch.object(svc, "async_session", _session_factory(opened, [[], [], []])), \
|
|
patch("scribe.services.milestones.get_project_milestone_summaries",
|
|
AsyncMock(return_value={})):
|
|
out = await svc.get_project_summaries(1, [4, 5, 6])
|
|
|
|
assert sorted(out) == [4, 5, 6]
|
|
for entry in out.values():
|
|
assert entry["task_counts"] == {"todo": 0, "in_progress": 0, "done": 0}
|
|
assert entry["note_count"] == 0
|
|
assert entry["last_activity"] is None
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_no_projects_opens_no_session_at_all():
|
|
"""`.in_([])` is a valid but pointless query; the guard keeps an empty
|
|
install from paying for a connection to learn it has nothing."""
|
|
from scribe.services import projects as svc
|
|
|
|
opened = [0]
|
|
with patch.object(svc, "async_session", _session_factory(opened, [])):
|
|
assert await svc.get_project_summaries(1, []) == {}
|
|
assert opened[0] == 0
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_milestone_summaries_for_many_projects_open_ONE_session():
|
|
"""Same property one level down — this was the nested half of the fan-out,
|
|
a session per MILESTONE, which is what turned 25 into ~250."""
|
|
from scribe.services import milestones as svc
|
|
|
|
written = datetime(2026, 9, 1, tzinfo=timezone.utc)
|
|
m1 = MagicMock(id=10, project_id=1, updated_at=written)
|
|
m1.to_dict = MagicMock(return_value={"id": 10, "title": "A"})
|
|
m2 = MagicMock(id=11, project_id=2, updated_at=written)
|
|
m2.to_dict = MagicMock(return_value={"id": 11, "title": "B"})
|
|
|
|
step_closed = datetime(2026, 9, 14, tzinfo=timezone.utc)
|
|
opened = [0]
|
|
rows = [[m1, m2], [
|
|
(10, "done", 2, step_closed),
|
|
(10, "todo", 1, datetime(2026, 9, 2, tzinfo=timezone.utc)),
|
|
(11, "cancelled", 1, datetime(2026, 8, 1, tzinfo=timezone.utc)),
|
|
]]
|
|
with patch.object(svc, "async_session", _session_factory(opened, rows)):
|
|
out = await svc.get_project_milestone_summaries(1, [1, 2])
|
|
|
|
assert opened[0] == 1
|
|
# Touched is the later of the milestone's own edit and its newest step
|
|
# update (#4045): steps closing today count, an old step doesn't pull it back.
|
|
assert out[1][0]["last_touched_at"] == step_closed.isoformat()
|
|
assert out[2][0]["last_touched_at"] == written.isoformat()
|
|
assert out[1][0]["completed"] == 2 and out[1][0]["total"] == 3
|
|
# Cancelled is excluded from the denominator, so a milestone whose only
|
|
# task was cancelled reads as complete rather than stalled at 0%.
|
|
assert out[2][0]["pct"] == 0.0 and out[2][0]["status_counts"]["cancelled"] == 1
|
|
|
|
|
|
def test_both_progress_paths_share_one_rule():
|
|
"""get_milestone_progress and the batch path must not compute pct
|
|
differently — two screens disagreeing about whether a milestone is done is
|
|
exactly the drift this codebase keeps finding."""
|
|
from scribe.services.milestones import _progress_from_counts
|
|
|
|
assert _progress_from_counts({"done": 3, "cancelled": 1})["pct"] == 100.0
|
|
assert _progress_from_counts({"cancelled": 2})["pct"] == 0.0
|
|
assert _progress_from_counts({})["total"] == 0
|