grobidOrg / grobid / 29678014808
40%
master: 43%

LAST BUILD BRANCH: feature/use-outline-to-structure-head
DEFAULT BRANCH: master
Ran
Jobs 1
Files 334
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 40.175% (-2.9%) from 43.086%
29678014808

Pull #1509

github

lfoppiano 
Update TEI schemas to accept GROBID output (head/@level + missing elements)

Add the section-head @level attribute (the outline hierarchy level) to <head>.

Also bring the shipped RelaxNG schema in line with what GROBID actually emits: its
output has never validated against grobid-home/schemas/rng/Grobid.rng. Add the elements
and attributes GROBID produces but the schema omitted:
 - @coords (PDF bounding boxes) and @lang (bare variant of xml:lang, e.g. on orgName)
   on att.global, so they are accepted on every element;
 - <rs> (referencing string, e.g. funders/grants in running text) in model.phrase;
 - <funder> and <respStmt>/<resp> in model.respLike (title statement);
 - <listOrg>/<org> in model.listLike, and allowed interleaved with <div>s in <back>;
 - xsi:schemaLocation on the root <TEI>;
 - a bare pointer/reference (model.ptrLike) directly under <div> (annex markers);
 - make @url optional on <graphic> (GROBID emits graphics located only by @coords).

Validated with jing over ~275 documents (PMC, a publisher-diverse set, and the dataseer
corpus): all validate except a couple carrying malformed @target URIs extracted from
corrupt PDFs (a data issue, correctly rejected). The @level addition is mirrored to the
XSD and DTD; the element additions are RelaxNG-only because the shipped XSD has a
pre-existing non-deterministic content-model defect that prevents it from loading at all.
Pull Request #1509: Use PDF outline to correct the header hierarchy

9288 of 25724 branches covered (36.11%)

Branch coverage included in aggregate %.

19770 of 46604 relevant lines covered (42.42%)

1.72 hits per line

Coverage Regressions

Lines Coverage ∆ File
637
46.56
 -22.22% org/grobid/core/engines/FullTextParser.java
200
52.88
 1.1% org/grobid/core/document/TEIFormatter.java
191
42.2
 -22.22% org/grobid/core/engines/Segmentation.java
181
28.42
 -17.27% org/grobid/core/engines/AffiliationAddressParser.java
180
10.16
 -0.5% org/grobid/core/engines/Engine.java
169
39.44
 -27.85% org/grobid/core/engines/CitationParser.java
167
54.12
 -21.59% org/grobid/core/engines/HeaderParser.java
156
0.0
 0.0% org/grobid/core/engines/ProcessEngine.java
146
34.7
 -37.88% org/grobid/core/engines/AuthorParser.java
130
0.0
 0.0% org/grobid/core/engines/MonographParser.java
63
55.12
 -0.97% org/grobid/core/utilities/TextUtilities.java
63
0.0
 0.0% org/grobid/trainer/HeaderTrainer.java
34
46.15
 0.0% org/grobid/core/utilities/IOUtilities.java
26
55.49
 25.49% org/grobid/core/document/DocumentNode.java
25
60.49
 -14.28% org/grobid/core/engines/FigureParser.java
23
80.56
 -0.6% org/grobid/core/sax/PDFALTOOutlineSaxHandler.java
22
63.5
 -4.9% org/grobid/core/engines/ReferenceSegmenterParser.java
17
16.74
 -0.14% org/grobid/service/process/GrobidRestProcessTraining.java
Jobs
ID Job ID Ran Files Coverage
1 29678014808.1 334
40.18
 GitHub Action Run
Source Files on build 29678014808