docs(6209): calibration stamp, after-write hook, usage seam, work log, duplicates, skill structure, tuning and rulebook routes, kind surface, prompt filter, moments, strict args, auth, lesson write path
Fourteen more test files: docstrings state the failure each guard defends as a present-tense shape instead of the incident that found it, and issue, milestone and rule numbers leave comments and assertion messages. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
@@ -1,10 +1,9 @@
|
||||
"""A tuned number carries the space it was measured in — and only that (#4104).
|
||||
"""A tuned number carries the space it was measured in — and only that.
|
||||
|
||||
WHY THIS EXISTS
|
||||
|
||||
Milestone 416 step 6 answers *"a path for thresholds to be inherited by the next
|
||||
version or different model so that they don't have to recalibrate a lot."* The
|
||||
mechanism is a stamp: every tuning event records the embedding model and
|
||||
A threshold should be inheritable by the next version or a different model
|
||||
without recalibrating from scratch. The mechanism is a stamp: every tuning event records the embedding model and
|
||||
document shape the number was chosen under, and a mismatch is reported rather
|
||||
than left to be noticed.
|
||||
|
||||
@@ -49,7 +48,7 @@ def test_calibration_stamp_names_the_embedder_and_the_shape():
|
||||
"embedding_model": emb.EMBEDDING_MODEL,
|
||||
"shape_version": emb.CHUNKER_VERSION,
|
||||
}
|
||||
# Two keys, never one fused string (rule 149): a mismatch has to be able to
|
||||
# Two keys, never one fused string: a mismatch has to be able to
|
||||
# say WHICH half moved, because a new embedder and a re-cut document
|
||||
# invalidate the same numbers for different reasons.
|
||||
assert len(stamp) == 2
|
||||
@@ -136,7 +135,7 @@ def test_a_dial_moved_before_stamps_existed_is_unknown_not_fine():
|
||||
|
||||
|
||||
def test_a_model_change_and_a_shape_change_are_reported_apart():
|
||||
"""Rule 149. Two conditions, two answers — they call for different work."""
|
||||
"""Two conditions, two answers — they call for different work."""
|
||||
s = get_surface("prompt_rule")
|
||||
live = {"embedding_model": "new/model", "shape_version": 1}
|
||||
cal = rt._calibration(_row(model="old/model", shape=1), s, live)
|
||||
@@ -182,8 +181,7 @@ def test_the_tool_says_nothing_auto_retunes():
|
||||
"""The contract an agent reads. A stale stamp is a prompt to MEASURE.
|
||||
|
||||
Without this, the obvious next move on seeing `stale: true` is to move the
|
||||
dial — which is tuning from a statistic, the exact failure #4102 measured
|
||||
pointing the wrong way.
|
||||
dial — which is tuning from a statistic, which can point the wrong way.
|
||||
"""
|
||||
doc = tool_doc("scribe.mcp.tools.retrieval_tuning", "retrieval_surfaces")
|
||||
assert "calibration" in doc
|
||||
|
||||
Reference in New Issue
Block a user