Skip to content
This repository was archived by the owner on Sep 15, 2025. It is now read-only.

Improve transparency of the evaluation framework#2

Open
payoto wants to merge 5 commits intoopenai-api-compatabilityfrom
extract-all-data-from-api-run
Open

Improve transparency of the evaluation framework#2
payoto wants to merge 5 commits intoopenai-api-compatabilityfrom
extract-all-data-from-api-run

Conversation

@payoto
Copy link

@payoto payoto commented Feb 20, 2024

  • Saves all prompt transformation steps to the JSON logs
  • Supports passing arbitrary prompt formats
  • Improves docker build speed by pre-caching requirements
  • Output results for individual samples

...

This PR is not to be merged

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant