Add benchmark results for allenai/olmo-3-7b-think

[github-actions]

This PR adds benchmark results for the allenai/olmo-3-7b-think model.

The following files have been updated:

• src/benchmark/results.json - Raw benchmark results
• src/benchmark/validation-results.json - Validation results against human baseline

This PR was automatically generated by the benchmark workflow.

Note: If you don't want to merge this PR, close it and the model will be added to the untested list to prevent re-processing.

@alrocar

---

Note

Adds benchmark and validation results for allenai/olmo-3-7b-think and updates config to include the provider/model.

• Benchmarks:
  • Add raw runs for allenai/olmo-3-7b-think across multiple pipe_XX.pipe tasks in src/benchmark/results.json (SQL, attempts, metrics, errors).
• Validation:
  • Update src/benchmark/validation-results.json with comparisons for allenai/olmo-3-7b-think, mostly non-matching/missing results and aggregate stats added under models.
• Config:
  • Add allenai provider with model olmo-3-7b-think in src/benchmark-config.json.

^{Written by Cursor Bugbot for commit 0846442. This will update automatically on new commits. Configure here.}

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
llm-benchmark	Ready	Preview	Comment	Nov 22, 2025 7:17am