(EAI-1237): NL2AtlasSearch prompt optimization + claude code optimization#3

Merged

mongodben merged 51 commits intomainfrom

Oct 10, 2025

Commits on Aug 12, 2025

stub out various commponents
Ben Perlmutter
committed
stub out implementation
Ben Perlmutter
committed

Commits on Aug 13, 2025

Executor refactor
Ben Perlmutter
committed
execute aggregation
Ben Perlmutter
committed
all works except rewrite
Ben Perlmutter
committed

Commits on Aug 14, 2025

pipeline working e2e
Ben Perlmutter
committed
Remove rewrite step
Ben Perlmutter
committed
working pipeline
Ben Perlmutter
committed
add subsequent PR eval
Ben Perlmutter
committed
fix build errs
Ben Perlmutter
committed
fix broken test
Ben Perlmutter
committed

Commits on Aug 15, 2025

Agent improvements on sample data
Ben Perlmutter
committed
checkpoint w/ ai sdk update
Ben Perlmutter
committed
checkpoint w/ ai sdk update
Ben Perlmutter
committed

Commits on Aug 18, 2025

validate model name
Ben Perlmutter
committed
handle google gemini tool calling
Ben Perlmutter
committed
improve scorers
Ben Perlmutter
committed
prompt tweaks
Ben Perlmutter
committed
tool tweaks and tracing
Ben Perlmutter
committed
Fix tests
Ben Perlmutter
committed
add antipattern notes
Ben Perlmutter
committed
start refining pipeline
Ben Perlmutter
committed

Commits on Aug 19, 2025

sloppy checkpoint
Ben Perlmutter
committed
Merge remote-tracking branch 'upstream/main' into EAI-1231
Ben Perlmutter
committed
update lock
Ben Perlmutter
committed
config
Ben Perlmutter
committed

Commits on Aug 20, 2025

Merge remote-tracking branch 'upstream/main' into EAI-1231
Ben Perlmutter
committed
checkpoint
Ben Perlmutter
committed

Commits on Aug 22, 2025

Merge remote-tracking branch 'upstream/main' into EAI-1231
Ben Perlmutter
committed

Commits on Aug 25, 2025

gen full benchmark
Ben Perlmutter
committed
gen atlas search dataset
Ben Perlmutter
committed
small updates
Ben Perlmutter
committed
Delete packages/datasets/referenceAnswers.atlas_search_dataset_atlas_search_claude-opus-4-20250514_temp_0.9_1755190427429.jsonl
mongodben
authored
Apply suggestions from code review
mongodben
authored

Commits on Aug 26, 2025

claude 4 models
Ben Perlmutter
committed
more robust err handling
Ben Perlmutter
committed

Commits on Aug 27, 2025

first draft of prompt
Ben Perlmutter
committed
Merge remote-tracking branch 'upstream/main' into EAI-1231
Ben Perlmutter
committed
Merge branch 'EAI-1231' into EA-1237
Ben Perlmutter
committed

Commits on Aug 29, 2025

Merge remote-tracking branch 'upstream/main' into EAI-1237
Ben Perlmutter
committed
prompt tweaks
Ben Perlmutter
committed
fix atlas search prompt
Ben Perlmutter
committed

Commits on Oct 7, 2025

Merge remote-tracking branch 'upstream/main' into EAI-1237
Ben Perlmutter
committed

Commits on Oct 8, 2025

claude code set up
Ben Perlmutter
committed
Add claude 4.5 + remove dupes
Ben Perlmutter
committed
prompt refinement + bug fixes
Ben Perlmutter
committed
prompt refinements
Ben Perlmutter
committed

Commits on Oct 9, 2025

add optimized prompt example
Ben Perlmutter
committed
refine prompts
Ben Perlmutter
committed
fix runner at root
Ben Perlmutter
committed

Commits on Oct 10, 2025

variable rename
Ben Perlmutter
committed