Skip to content

feat(solve): add --no-coderlm flag (21× benchmark speedup)#104

Merged
jobordu merged 1 commit intomainfrom
fix/no-coderlm-flag
Apr 16, 2026
Merged

feat(solve): add --no-coderlm flag (21× benchmark speedup)#104
jobordu merged 1 commit intomainfrom
fix/no-coderlm-flag

Conversation

@jobordu
Copy link
Copy Markdown

@jobordu jobordu commented Apr 16, 2026

Summary

  • Adds --no-coderlm flag to nf-solve.cjs
  • Disables the coderlm adapter and skips ensureRunning() entirely when set
  • Eliminates ~276s of latency per benchmark challenge (7998 queries at 0% cache hit rate)
  • Result: ~600s → ~14s per challenge, 21× speedup for benchmark runs

Test plan

  • node bin/nf-solve.cjs --report-only --json --fast --no-coderlm completes without starting coderlm server
  • Without flag: coderlm still starts normally

🤖 Generated with Claude Code

Disables coderlm adapter and skips ensureRunning() when --no-coderlm
is passed. Eliminates ~276s of latency (7998 queries at 0% cache hit
rate) during benchmark runs, achieving 21x speedup (600s → 14s/challenge).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@jobordu jobordu merged commit 9aa8dd5 into main Apr 16, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant