forked from google/minja
-
Notifications
You must be signed in to change notification settings - Fork 5
Feature: Auto-detect template capabilities (supports_disable_thinking, supports_reasoning_only, etc.) #19
Copy link
Copy link
Open
Description
Feature Request
Minja should auto-detect and expose template capabilities that currently need to be manually specified in test harnesses.
New Capabilities to Detect
Thinking Mode Control
supports_disable_thinking- Can the template respectenable_thinking=false?- DeepSeek V3.1: Always emits thinking blocks (doesn't support disabling)
- Command R7B, GLM-4.6, SmolLM3-3B: Respect
enable_thinking
Reasoning Format Variations
supports_reasoning_only- Can the template emit reasoning without any content or tool calls?supports_reasoning_with_content- Can the template mix content text with reasoning in the same message?- Apertus: Cannot mix text content with reasoning blocks
Tool Call Behavior
tool_required_allows_content- Whentool_choice=required, can content appear before tool calls?tools_emit_content_with_calls- Can content appear alongside tool calls in the same message?reasoning_requires_tools- Does reasoning only appear when tools are also present?- Command R7B:
reasoning_requires_tools = true- reasoning only appears with tool calls - DeepSeek R1/V3.1, GLM-4.6:
reasoning_requires_tools = false- reasoning can appear independently
- Command R7B:
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels