Skip to content

Foonote-references flavour #1325

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
lfoppiano wants to merge 17 commits into
base: master
Choose a base branch
from
+698,841 −22
Draft

Foonote-references flavour #1325

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
df89067
add new flavor, first training data, model 0 and update the interface
lfoppiano Jul 21, 2025
314cbda
annotations corrections and new data
lfoppiano Aug 1, 2025
52220c0
update model
lfoppiano Aug 1, 2025
66fb9d6
rename old data, and add new corrected training data
lfoppiano Aug 6, 2025
5235369
update segmentation model
lfoppiano Aug 6, 2025
852a2f9
add more training data
lfoppiano Oct 25, 2025
b045c5e
Ignore <teiHeader>
lfoppiano Oct 25, 2025
6dfa2b4
update model
lfoppiano Oct 25, 2025
ccdb56d
feat:add more training data
lfoppiano Jan 30, 2026
7272991
update model
lfoppiano Jan 30, 2026
4f85701
fix: handling special incorrect sequences #1355
lfoppiano Feb 13, 2026
72c89c7
Merge branch 'master' into feature/literature-law-flavour
lfoppiano Mar 6, 2026
7e88993
fix: TrainerRunner must know about the footnote flavor (#1385)
cboulanger Mar 6, 2026
de98264
feat: add the updated 105 segmentations training documents
lfoppiano Mar 7, 2026
e958e1d
fix: training data corrections and cleanup
lfoppiano Mar 7, 2026
fd543f4
feat: updated segmentation model
lfoppiano Mar 8, 2026
cdf3ce6
Merge branch 'master' into feature/literature-law-flavour
lfoppiano Mar 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 12 additions & 11 deletions build.gradle
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -507,17 +507,18 @@ project(":grobid-trainer") {
]

def complexTrainerTasks = [
"train_header" : ["org.grobid.trainer.HeaderTrainer", ""],
"train_header_article_light" : ["org.grobid.trainer.HeaderTrainer", "article/light"],
"train_header_article_light_ref" : ["org.grobid.trainer.HeaderTrainer", "article/light-ref"],
"train_header_ietf" : ["org.grobid.trainer.HeaderTrainer", "sdo/ietf"],
"train_segmentation" : ["org.grobid.trainer.SegmentationTrainer", ""],
"train_segmentation_article_light" : ["org.grobid.trainer.SegmentationTrainer", "article/light"],
"train_segmentation_article_light_ref": ["org.grobid.trainer.SegmentationTrainer", "article/light-ref"],
"train_segmentation_ietf" : ["org.grobid.trainer.SegmentationTrainer", "sdo/ietf"],
"train_fulltext" : ["org.grobid.trainer.FulltextTrainer", ""],
"train_fulltext_article_light" : ["org.grobid.trainer.FulltextTrainer", "article/light"],
"train_fulltext_article_light_ref" : ["org.grobid.trainer.FulltextTrainer", "article/light-ref"],
"train_header" : ["org.grobid.trainer.HeaderTrainer", ""],
"train_header_article_light" : ["org.grobid.trainer.HeaderTrainer", "article/light"],
"train_header_article_light_ref" : ["org.grobid.trainer.HeaderTrainer", "article/light-ref"],
"train_header_ietf" : ["org.grobid.trainer.HeaderTrainer", "sdo/ietf"],
"train_segmentation" : ["org.grobid.trainer.SegmentationTrainer", ""],
"train_segmentation_article_light" : ["org.grobid.trainer.SegmentationTrainer", "article/light"],
"train_segmentation_article_light_ref" : ["org.grobid.trainer.SegmentationTrainer", "article/light-ref"],
"train_segmentation_article_dh_law_footnotes" : ["org.grobid.trainer.SegmentationTrainer", "article/dh-law-footnotes"],
"train_segmentation_ietf" : ["org.grobid.trainer.SegmentationTrainer", "sdo/ietf"],
"train_fulltext" : ["org.grobid.trainer.FulltextTrainer", ""],
"train_fulltext_article_light" : ["org.grobid.trainer.FulltextTrainer", "article/light"],
"train_fulltext_article_light_ref" : ["org.grobid.trainer.FulltextTrainer", "article/light-ref"],
]

def libraries = ""
Expand Down
66 changes: 66 additions & 0 deletions doc/benchmarks/flavors/article_dh_law/readme.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
# Benchmarks

## Iterations batch 1,2,3
Date: 2025-10-25

### List of files used for training:

10.1093$1$gerhis$1$ghaf028.training.segmentation.tei.xml
10.3249$1$1868-1581-2-2-clark.training.segmentation.tei.xml
10.5354$1$rti.v1i1.21339.training.segmentation.tei.xml
10.5354$1$rti.v1i2.25648.training.segmentation.tei.xml
10.5771$1$2699-1284-2024-3-149.training.segmentation.tei.xml
10.5771__2699-1284-2020-1-83.training.segmentation.tei.xml
10.6092__issn.2531-6133__10402.training.segmentation.tei.xml
10.12759$1$hsr.6.1981.3.3-17.training.segmentation.tei.xml
10.12775$1$clr.2013.004.training.segmentation.tei.xml
10.12775$1$clr.2013.008.training.segmentation.tei.xml
10.14276$1$2384-8901$1$448.training.segmentation.tei.xml
10.16995$1$lefou.9.training.segmentation.tei.xml
10.19164__ijple.v6i1.1295.training.segmentation.tei.xml
10.19195$1$0524-4544.337.9.training.segmentation.tei.xml
10.25364%2F01.10%3A2023.2.1.training.segmentation.tei.xml
10.25364%2F01.11%3A2024.1.5.training.segmentation.tei.xml
10.26321$1$a.facchinetti.01.2025.05.training.segmentation.tei.xml
10.26321$1$s.marino.01.2025.06.training.segmentation.tei.xml
10.32361$1$2025170222092.training.segmentation.tei.xml
10.34767$1$dp.2024.02.02.training.segmentation.tei.xml
1296-Article Text-4476-1-10-20221017.training.segmentation.tei.xml

### List of files used for evaluation:

10.1093$1$gerhis$1$ghae045.training.segmentation.tei.xml
10.3249$1$1868-1581-1-2-gutbrod.training.segmentation.tei.xml
10.5771__2699-1284-2020-1-16.training.segmentation.tei.xml
10.6092__issn.2531-6133__6356.training.segmentation.tei.xml
10.12759$1$hsr.3.1978.1.3-10.training.segmentation.tei.xml
10.12775$1$clr.2013.002.training.segmentation.tei.xml
10.14276$1$2384-8901$1$443.training.segmentation.tei.xml
10.19164__ijple.v6i1.1293.training.segmentation.tei.xml
10.19195$1$0524-4544.337.2.training.segmentation.tei.xml
10.32361$1$201810011903.training.segmentation.tei.xml
1294-Article Text-4464-1-10-20221017.training.segmentation.tei.xml

### Results

===== Field-level results =====

label accuracy precision recall f1 support

<body> 91.57 79.45 82.86 81.12 210
<cover> 99.79 0 0 0 0
<footnote> 98.54 64.29 50 56.25 18
<header> 96.98 36.84 29.17 32.56 24
<headnote> 91.16 59.86 75.22 66.67 113
<page> 96.15 85.71 96.88 90.95 192
<references> 91.05 76.06 82.23 79.02 197
<toc> 99.79 0 0 0 2

all (micro avg.) 95.03 75.61 82.41 78.86 756
all (macro avg.) 95.03 57.46 59.48 58.08 756

===== Instance-level results =====

Total expected instances: 11
Correct instances: 0
Instance-level recall: 0
4 changes: 3 additions & 1 deletion grobid-core/src/main/java/org/grobid/core/GrobidModels.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,7 @@ public enum Flavor {
BLANK("blank"),
ARTICLE_LIGHT("article/light"),
ARTICLE_LIGHT_WITH_REFERENCES("article/light-ref"),
ARTICLE_DH_LAW_FOOTNOTES("article/dh-law-footnotes"),
_3GPP("sdo/3gpp"),
IETF("sdo/ietf");

Expand Down Expand Up @@ -171,7 +172,8 @@ public static GrobidModel getModelFlavor(GrobidModel model, Flavor flavor) {
} else {
GrobidModel grobidModel = modelFor(model.toString() + "/" + flavor.getLabel().toLowerCase());
if (!Files.exists(Paths.get(grobidModel.getModelPath()))) {
LOGGER.info("The requested model flavor " + flavor.getLabel() + " model is not available. Defaulting to the standard model. ");
LOGGER.info("The requested model flavor " + flavor.getLabel() + " model is not available. " +
"Defaulting to the standard model. ");
return model;
} else {
return grobidModel;
Expand Down
3 changes: 3 additions & 0 deletions grobid-core/src/main/java/org/grobid/core/engines/ReferenceSegmenterParser.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -453,6 +453,9 @@ else if (tokenizations.get(tokPtr2).t().equals("\n") ||
else {
output = writeField(label, lastTag, tok, "<other>", "", addSpace, addEOL, 2);
if (output != null) {
if (refOpen) {
sb.append("</bibl>");
}
sb.append(output);
refOpen = false;
}
Expand Down
8 changes: 8 additions & 0 deletions grobid-home/config/grobid.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -107,6 +107,14 @@ grobid:
max_sequence_length: 3000
batch_size: 10

- name: "segmentation-article-dh-law-footnotes"
engine: "wapiti"
wapiti:
# wapiti training parameters, they will be used at training time only
epsilon: 0.0000001
window: 50
nbMaxIterations: 2000

- name: "segmentation-article-light"
engine: "wapiti"
wapiti:
Expand Down
Loading
Loading