Skip to content

Add langgraph based orchestrator#130

Merged
dongwang218 merged 4 commits intomainfrom
langgraph
Mar 5, 2026
Merged

Add langgraph based orchestrator#130
dongwang218 merged 4 commits intomainfrom
langgraph

Conversation

@dongwang218
Copy link
Contributor

Why ?

Use langgraph to build state transition graph

How ?

also refactor to break p2p_agent into components.

Test plan

repeat test cases in #115

test the langgraph orchestrator

python -m matrix.agents.p2p_agents --config-name=coral_mmlu_pro.yaml max_concurrent_tasks=10 dataset.cut_off=10 resources.student_llm.matrix_service=gpt120b resources.teacher_llm.matrix_service=gpt120b resources.extractor_llm.matrix_service=8B output.path=$HOME/temp/coral_test_langgraph.jsonl resources.teacher_llm.sampling_params.max_tokens=10240 resources.student_llm.sampling_params.max_tokens=10240 orchestrator=coral_langgraph
[2026-03-04 02:53:09,800][__main__][INFO] - conv_err: 0.0000
[2026-03-04 02:53:09,801][__main__][INFO] - agreement: 1.0000
[2026-03-04 02:53:09,802][__main__][INFO] - agreement_correctness: 0.7000
[2026-03-04 02:53:09,803][__main__][INFO] - total_turns: 2.0000
[2026-03-04 02:53:09,803][__main__][INFO] - t_len: 303.2000
[2026-03-04 02:53:09,804][__main__][INFO] - s_len: 195.9000
[2026-03-04 02:53:09,804][__main__][INFO] - conv_len: 499.1000

python -m matrix.agents.p2p_agents --config-name=tau2_bench.yaml max_concurrent_tasks=10 dataset.cut_off=10 resources.user_simulator_llm.matrix_service=gpt120b resources.llm_agent_llm.matrix_service=gpt120b output.path=$HOME/temp/tau2_test_langgraph.jsonl domain=telecom orchestrator=tau2_langgraph
[2026-03-04 01:15:56,160][__main__][INFO] - rewards: 0.8000
[2026-03-04 01:15:56,160][__main__][INFO] - termination_user_stop: 1.0000
[2026-03-04 01:15:56,161][__main__][INFO] - termination_max_steps: 0.0000
[2026-03-04 01:15:56,161][__main__][INFO] - termination_too_many_errors: 0.0000
[2026-03-04 01:15:56,162][__main__][INFO] - termination_unknown_error: 0.0000

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Mar 4, 2026
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this could be deprecated?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the file still contains the entry point

@dongwang218 dongwang218 merged commit 280c96a into main Mar 5, 2026
11 checks passed
@dongwang218 dongwang218 deleted the langgraph branch March 5, 2026 18:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants