Skip to content

Commit 4e616d8

Browse files
FL4TLiN3claude
andcommitted
fix: remove coding-specific vocabulary from Hard Signal Framework descriptions
Replace "exit codes, test results, grep matches" and similar coding-centric examples with domain-neutral language per Design Principle 3 (Domain Agnosticism). create-expert serves all domains, not just software development. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 528a4a0 commit 4e616d8

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

definitions/create-expert/perstack.toml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -14,8 +14,8 @@
1414
#
1515
# 1. Hard Signal Verification
1616
# - Verification loop must be driven by hard signals — checks whose
17-
# results do not depend on LLM judgment. Exit codes, test results,
18-
# grep matches, deterministic command output.
17+
# results do not depend on LLM judgment. Any command that produces
18+
# deterministic, binary output qualifies.
1919
# - Hard signal = Ground truth × Context separation × Determinism.
2020
# All three required; missing any one degrades to soft signal (noise).
2121
# - Ground truth: verify the final artifact itself, not a proxy.
@@ -164,7 +164,7 @@ One comprehensive, realistic query that exercises the expert's full capability.
164164
### Verification Signals
165165
Hard signals for the test query — verification checks whose results do not depend on LLM judgment:
166166
- The exact command to run (deterministic, repeatable)
167-
- The expected result (exit code, output pattern, file existence)
167+
- The expected result (specific output, presence/absence of content, numeric threshold)
168168
- Why this checks ground truth, not a proxy
169169
170170
Include both positive signals (artifact works correctly) and reject signals (domain-specific anti-patterns are absent). Reject signals are not the inverse of positive signals — they detect fundamental failures derived from deeply understanding the domain.
@@ -394,7 +394,7 @@ All three steps below are MANDATORY. Skipping any step is grounds for an invalid
394394
395395
Run every hard signal check defined in plan.md's Verification Signals:
396396
- Execute the exact command specified
397-
- Compare the result against the expected output (exit code, pattern match, file existence)
397+
- Compare the result against the expected output (specific output, presence/absence of content, numeric threshold)
398398
- Record per check: command run, expected result, actual result, PASS/FAIL
399399
400400
If a check has no deterministic expected output, flag it as an invalid signal and CONTINUE — the plan must define a proper hard signal.

0 commit comments

Comments
 (0)