PAL-866-collect-metrics

[pratacosmin]

Description

Add a new argument, task_id, to the ModelConfig to enable sending it as a tag to the LiteLLM proxy, allowing us to track the cost of each run/request.

Type of change

• New feature (non-breaking change which adds functionality)

Usage

We can add to the model object a task_id that can be use to track request for a specific run

                harness = Harness(
                    model={
                        "model": self.model_id,
                        "type": self.model_type.lower(),
                        "hub": self.normalize_provider(self.sdk_provider.lower()),
                        "task_id": self.task_id,
                    },
                    **self.update_model_parameters(config),
                )