docs: correct model management #8562
Open
+92
−62
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This change improves the model management documentation. Explicitily explains that models should be unloaded before being reloaded when using EXPLICIT mode.
yinggeh
reviewed
Dec 9, 2025
| - Changes to the model repository while the server is running will be ignored. | ||
| Model load and unload requests using the [model control protocol](../protocol/extension_model_repository.md) will have no affect and will return an error response. | ||
|
|
||
| - This model control mode is selected by specifying `--model-control-mode=none` when starting Triton. |
Contributor
There was a problem hiding this comment.
Suggested change
| - This model control mode is selected by specifying `--model-control-mode=none` when starting Triton. | |
| - This model control mode is selected by specifying `--model-control-mode` when starting Triton. |
| This model control mode is selected by specifying `--model-control-mode=none` when starting Triton. | ||
| This is the default model control mode. | ||
| Changing the model repository while Triton is running must be done carefully, as explained in [Modifying the Model Repository](#modifying-the-model-repository). | ||
| - This is the default model control mode. |
Contributor
There was a problem hiding this comment.
Suggested change
| - This is the default model control mode. | |
| - The default model control mode is `--model-control-mode=none`. |
| - This is the default model control mode. | ||
|
|
||
| > [!IMPORTANT] | ||
| > Changing the model repository while Triton is running must be done carefully, as explained in [Modifying the Model Repository](#modifying-the-model-repository). |
Contributor
There was a problem hiding this comment.
Should remove duplicated warnings in the following sections.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This change improves the model management documentation.
Explicitly explains that models should be unloaded before being reloaded when using EXPLICIT mode.
TRI-249