Skip to content

feat: support online eval during score#122

Open
senwu wants to merge 14 commits intomainfrom
sen/online_score
Open

feat: support online eval during score#122
senwu wants to merge 14 commits intomainfrom
sen/online_score

Conversation

@senwu
Copy link
Owner

@senwu senwu commented Feb 4, 2022

Description of the problems or issues

Is your pull request related to a problem? Please describe.
A clear and concise description of what the problem is.

Does your pull request fix any issue.
Cite the issue id.

Description of the proposed changes

A clear and concise description of what you propose.

Test plan

A clear and concise description of how you test the new changes.

Checklist

  • I have updated the documentation accordingly.
  • I have added tests to cover my changes.
  • All new and existing tests passed.
  • I have updated the CHANGELOG.rst accordingly.

@senwu senwu force-pushed the sen/online_score branch 3 times, most recently from 922fc45 to d10963f Compare February 4, 2022 07:30
@codecov
Copy link

codecov bot commented Feb 4, 2022

Codecov Report

Merging #122 (47486c1) into main (a61b333) will decrease coverage by 3.15%.
Report is 1 commits behind head on main.
The diff coverage is 44.13%.

❗ Current head 47486c1 differs from pull request most recent head 3dc854d. Consider uploading reports for the commit 3dc854d to get more accurate results

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #122      +/-   ##
==========================================
- Coverage   92.14%   88.99%   -3.15%     
==========================================
  Files          40       40              
  Lines        2024     2145     +121     
  Branches      456      503      +47     
==========================================
+ Hits         1865     1909      +44     
- Misses         94      169      +75     
- Partials       65       67       +2     
Flag Coverage Δ
unittests 88.99% <44.13%> (-3.15%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
src/emmental/model.py 76.54% <22.85%> (-17.25%) ⬇️
src/emmental/learner.py 78.75% <100.00%> (+0.42%) ⬆️
src/emmental/meta.py 84.46% <100.00%> (ø)
src/emmental/metrics/accuracy.py 100.00% <100.00%> (ø)
src/emmental/metrics/accuracy_f1.py 100.00% <100.00%> (ø)
src/emmental/metrics/fbeta.py 100.00% <100.00%> (ø)
src/emmental/metrics/matthews_correlation.py 100.00% <100.00%> (ø)
src/emmental/metrics/mean_squared_error.py 100.00% <100.00%> (ø)
src/emmental/metrics/pearson_correlation.py 100.00% <100.00%> (ø)
src/emmental/metrics/pearson_spearman.py 100.00% <100.00%> (ø)
... and 6 more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants