Skip to content

Conversation

@JohnTrunix
Copy link
Collaborator

@JohnTrunix JohnTrunix commented May 9, 2025

Related issue #54

@JohnTrunix JohnTrunix self-assigned this May 9, 2025
@celinefelix
Copy link
Collaborator

@JohnTrunix : I reformulated the prompts a bit. However, I received the same scores as you did (that's why I did not push the eval.md & eval.json files). Will try to improve the prompts to get better scores. If you have some more ideas, feel free to change / update them.

@JohnTrunix JohnTrunix force-pushed the refactor/eval-optimization branch from cb468ae to 5bc230f Compare May 11, 2025 15:26
@JohnTrunix
Copy link
Collaborator Author

JohnTrunix commented May 11, 2025

@JohnTrunix : I reformulated the prompts a bit. However, I received the same scores as you did (that's why I did not push the eval.md & eval.json files). Will try to improve the prompts to get better scores. If you have some more ideas, feel free to change / update them.

@celinefelix what if we reformat the prompt in a bullet point list? In addition I will try to improve the questionary

@JohnTrunix JohnTrunix force-pushed the refactor/eval-optimization branch from bce8831 to 0822c7c Compare May 13, 2025 19:16
@JohnTrunix JohnTrunix force-pushed the refactor/eval-optimization branch from 0822c7c to 828a2b6 Compare May 13, 2025 19:24
@JohnTrunix JohnTrunix merged commit 6b1d5b9 into main May 13, 2025
3 checks passed
@JohnTrunix JohnTrunix deleted the refactor/eval-optimization branch May 13, 2025 21:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants