Add benchmark results for openai/gpt-5.1-chat

[github-actions]

This PR adds benchmark results for the openai/gpt-5.1-chat model.

The following files have been updated:

• src/benchmark/results.json - Raw benchmark results
• src/benchmark/validation-results.json - Validation results against human baseline

This PR was automatically generated by the benchmark workflow.

Note: If you don't want to merge this PR, close it and the model will be added to the untested list to prevent re-processing.

@alrocar

---

Note

Adds OpenAI gpt-5.1-chat to the benchmark config and records its raw benchmark runs and validation outcomes.

• Config:
  • Add openai model gpt-5.1-chat in src/benchmark-config.json.
• Benchmarks:
  • Append raw run entries for openai/gpt-5.1-chat across many pipes in src/benchmark/results.json (with timings, tokens, attempts, and SQL/results metadata).
• Validation:
  • Add per-query validation records and aggregated stats for openai/gpt-5.1-chat in src/benchmark/validation-results.json (including SQL used and match metrics).

^{Written by Cursor Bugbot for commit 90aa810. This will update automatically on new commits. Configure here.}

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
llm-benchmark	Ready	Preview	Comment	Nov 21, 2025 6:14am