-
Notifications
You must be signed in to change notification settings - Fork 0
Update Structure #10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Update Structure #10
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.
| }) | ||
| evals = [1, 2] | ||
| result = align_data(df, evals, group_cols=("exp_id",), x_col="evaluations", y_col="raw_y", output="long", maximization=False) | ||
| self.assertTrue(set(result["exp_id"].to_list()) == {1, 2}) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a == b) cannot provide an informative message. Using assertEqual(a, b) instead will give more informative messages.
| }) | ||
| evals = [10, 20, 30] | ||
| result = align_data(df, evals, group_cols=("data_id",), x_col="steps", y_col="score", output="long", maximization=False) | ||
| self.assertTrue(result["steps"].to_list() == [10, 20, 30]) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a == b) cannot provide an informative message. Using assertEqual(a, b) instead will give more informative messages.
| }) | ||
| evals = [10, 20, 30] | ||
| result = align_data(df, evals, group_cols=("data_id",), x_col="steps", y_col="score", output="long", maximization=False) | ||
| self.assertTrue(result["steps"].to_list() == [10, 20, 30]) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a == b) cannot provide an informative message. Using assertEqual(a, b) instead will give more informative messages.
|
|
||
| self.assertIn("AOCC", result.columns) | ||
| aocc_val = result["AOCC"][0] | ||
| self.assertTrue(aocc_val == 6.5) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a == b) cannot provide an informative message. Using assertEqual(a, b) instead will give more informative messages.
| self.assertIn("AOCC", result.columns) | ||
| aocc_f1_val = result[result["function_name"] == "f1"]["AOCC"].iloc[0] | ||
| aocc_f2_val = result[result["function_name"] == "f2"]["AOCC"].iloc[0] | ||
| self.assertTrue(aocc_f1_val == 5.5) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a == b) cannot provide an informative message. Using assertEqual(a, b) instead will give more informative messages.
|
|
||
| def test_with_f_min_f_max(self): | ||
| result = aggregate_running_time(self.df, f_min=0.2, f_max=0.5, return_as_pandas=False) | ||
| self.assertTrue(result["raw_y"].min() >= 0.2) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a >= b) cannot provide an informative message. Using assertGreaterEqual(a, b) instead will give more informative messages.
| def test_with_f_min_f_max(self): | ||
| result = aggregate_running_time(self.df, f_min=0.2, f_max=0.5, return_as_pandas=False) | ||
| self.assertTrue(result["raw_y"].min() >= 0.2) | ||
| self.assertTrue(result["raw_y"].max() <= 0.5) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a <= b) cannot provide an informative message. Using assertLessEqual(a, b) instead will give more informative messages.
| }) | ||
| result = get_tournament_ratings(data, nrounds=25) | ||
| self.assertEqual(len(result), 2) | ||
| self.assertTrue(set(result["algorithm_name"]) == {"A", "B"}) |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
assertTrue(a == b) cannot provide an informative message. Using assertEqual(a, b) instead will give more informative messages.
|
|
||
| def test_basic(self): | ||
| evals = [1, 10, 100] | ||
| comparison, benchmark = get_robustrank_over_time( |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Variable comparison is not used.
|
|
||
| def test_basic(self): | ||
| evals = [1, 10, 100] | ||
| comparison, benchmark = get_robustrank_over_time( |
Copilot
AI
Dec 3, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Variable benchmark is not used.
.vscode/settings.json
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please remove .vscode settings from repo
-> update structure of the project
-> added plot arguments
-> new functionalities