Skip to content

DOC: Restructure documentation around three user pathways#1583

Merged
rlundeen2 merged 10 commits intomicrosoft:mainfrom
rlundeen2:users/rlundeen/2026_04_09_scanner_docs
Apr 10, 2026
Merged

DOC: Restructure documentation around three user pathways#1583
rlundeen2 merged 10 commits intomicrosoft:mainfrom
rlundeen2:users/rlundeen/2026_04_09_scanner_docs

Conversation

@rlundeen2
Copy link
Copy Markdown
Contributor

Reorganizes the doc site from a flat "User Guide" into three clear entry points for different user needs:

  • GUI — Visual interface for non-programmatic usage (moved from code/ to top-level)
  • Scanner — CLI/config-driven scanning with pyrit_scan (new section consolidating front_end/ + family-grouped scenario docs)
  • Framework — Programmatic Python API for building custom attacks (renamed from architecture.md, adds card-grid landing page)

Key changes:

  • Consolidated 8 individual scenario docs (content_harms, psychosocial, cyber, jailbreak, leakage, scam, garak_encoding,
    baseline_only) into 3 family-grouped scanner docs (AIRT, Foundry, Garak) — net -5,000 lines
  • Renamed 1_red_team_agent → 1_scenario_parameters, trimmed to focus on programmatic configuration (datasets, strategies, scorers,
    baseline) rather than duplicating scanner usage
  • Added new scanner/0_scanner.md landing page and scanner/pyrit_conf.yaml example config
  • Created doc/index.md landing page with pathway cards
  • Moved front_end/ → scanner/ (pyrit_scan, pyrit_shell) and gui/ to top-level
  • Removed user_guide.md and front_end/0_front_end.md
  • Fixed broken cross-references and added breadcrumbs between Scanner ↔ Framework sections
  • Added baseline execution section to 0_scenarios overview

rlundeen2 and others added 9 commits April 9, 2026 13:26
- Add transition sentence between Framework card grid and Architecture section
- Fix broken front_end links in 0_scenarios -> point to scanner/
- Rename 1_red_team_agent -> 1_scenario_parameters, trim running/results
  sections (covered by scanner docs), keep datasets/strategies/scorers/baseline
- Add baseline execution section to 0_scenarios overview
- Update scanner breadcrumb in 0_scenarios How to Run section
- Update all cross-references (myst.yml, scanner docs, foundry docs)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
- Psychosocial: conversation-level scoring, MHFA/ALGEE methodology,
  built-in rubrics (crisis_management.yaml, licensed_therapist.yaml),
  SubharmConfig customization, no-baseline rationale
- Leakage: PlagiarismScorer metrics (LCS, Levenshtein, Jaccard),
  FirstLetter memorization detection, copyright testing methodology

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
# Conflicts:
#	doc/code/scenarios/1_scenario_parameters.ipynb
#	doc/code/scenarios/2_content_harms.ipynb
#	doc/code/scenarios/3_psychosocial.ipynb
#	doc/code/scenarios/5_jailbreak.ipynb
#	doc/code/scenarios/6_leakage.ipynb
#	doc/code/scenarios/7_scam.ipynb
#	doc/code/scenarios/9_baseline_only.ipynb
#	doc/scanner/foundry.ipynb
#	doc/scanner/garak.ipynb
- scoring/5_human_in_the_loop_scorer: ../gui/ -> ../../gui/ (.py + .ipynb)
- converters/7_human_converter: ../gui/ -> ../../gui/ (.py + .ipynb)
- setup/1_configuration: 9_baseline_only -> 1_scenario_parameters (.py + .ipynb)
- contributing/README: architecture.md -> framework.md

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
The 'files' field is a regex, not a glob. ^doc/* matches 'doc' + zero
or more 'c' characters, not 'any file under doc/'.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@rlundeen2 rlundeen2 merged commit 599ab00 into microsoft:main Apr 10, 2026
38 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants