Run AI evals on PRs and fix doc links #3

Open

kfinkels wants to merge 13 commits intomainfrom

eval_github_actions

Commits on Jan 20, 2026

1. change github actions to run on every PR
Keren Finkelstein
committed
fix typo
Keren Finkelstein
committed
1. fix prompt to answer only in engllish
Keren Finkelstein
committed
don't fail the github action eval if the error is rate limit
Keren Finkelstein
committed
1. Strip content starting with Thinking: (English) 2. Strip content starting with 思考: (Chinese)
Keren Finkelstein
committed
Lower the threshold in the grader because the GLM
Keren Finkelstein
committed
the prompt now explicitly addresses vague terms at the Overview Section level where they were appearing, rather than only mentioning them in the general constraints section at the bottom.
Keren Finkelstein
committed
the prompt now explicitly addresses vague terms at the Overview Section level where they were appearing, rather than only mentioning them in the general constraints section at the bottom.
Keren Finkelstein
committed
fix script
Keren Finkelstein
committed
the prompt now explicitly addresses vague terms at the Overview Section level where they were appearing, rather than only mentioning them in the general constraints section at the bottom.
Keren Finkelstein
committed
Merge branch 'main' into eval_github_actions
Keren Finkelstein
committed
change the pass rate to 80%
Keren Finkelstein
committed

Commits on Feb 11, 2026

Merge branch 'main' into eval_github_actions
Keren Finkelstein
committed