-
Notifications
You must be signed in to change notification settings - Fork 25
[Improvement] coax claude to use available skills #51
Description
This will probably be true until the next claude training run starts favoring skills more. For rare skills and tasks, I'd imagine the model would default to reading the skills but it might need more direct instruction for more common tasks
This is not a plugin skill loading error. The plugin and skills loading work fine. It's claude not choosing to read in the rest of the skill file.
I wonder if it might make sense to have the plugin also inject a prompt hint similar to the manual workaround described below? Otherwise, a documentation update?
The manual workaround:
Instruct the model to at least read the SKILL.md for skills that might be appropriate.
Test case:
I only tested this with sonnet 4.5
Pick a task that the model would have been trained on and would have very high confidence. "Create a new python project" is what I picked to test this.
Prompt 1:
"Create a new python project"
If I just prompt the model to do that in an empty directory, it completely disregards the skill I wrote and instead defaults to creating a requirement.txt and use pip / venv.
Prompt 2/3:
I tried both a simple and aggressive nudge. Both seemed to work fine.
Create a new python project, using the most appropriate skills
IMPORTANT first check if we have any relevant skills for the task.
Create a new python project
Both of these performed flawslessly. In both cases, sonnet 4.5 read my simple .../;skills/python-package-management/SKILL.md and then ran uv init instead of manually creating requirements.txt, README.md with instructions to use pip, etc.
Skill
---
name: python-package-management
description: Instructions and commands to use when working with python projects.
---
# Purpose
This skill provides guidance for managing dependencies and running python code. Because python has existed for so long and been so widely adopted, there exist many ways to define and manage python projects and depdendencies. The python package management skill defines the modern conventions and tools choices to use.
# Instructions
- IMPORTANT always use uv to manage python projects and dependencies
- IMPORTANT python projects are defined with a `pyproject.toml` file.
- Projects we author will NEVER have a requirements.txt.
- Projects follow the `src` layout convention.
# Example project structure
```
./my-awesome-project/
src/
my_awesome_project/
__init__.py
...
tests/
...
pyproject.toml
```