| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The 22nd Rundfunkänderungsgesetz amends five laws in one gazette issue.
Article 3 (TMZ-Gesetz) was already an acceptance case; this adds the two
big ones — Article 1 (WDR-Gesetz, 101 commands across 31 norms) and
Article 2 (LMG NRW, 18 commands). Both stem versions come from
recht.nrw.de, whose URLs address a version by its date of entry into
force, so the results could be checked norm by norm against the official
1 April 2026 consolidations.
Applying them turned up work at every layer:
Order of application. Renumbering always refers to the original count,
not to the state after the preceding items, so a cascade („Absatz 3 wird
Absatz 4“, „Absatz 4 wird Absatz 5“, …) applied in document order leaves
the law carrying two units of the same name. BefehlAnwender now derives,
for each command, which designations it vacates and which it newly
occupies, and pulls a vacating command ahead of the first one it
collides with. That single rule subsumes the previous §-only special
case, orders a cascade descending, and — inside a Sammelbefehl too —
keeps a range renumbering from colliding with itself. Bayern's Art. 29a
sequence now resolves as well (5 manual residues down to 3).
Renumbering an enumeration item. Unlike an Absatz, a Nummer carries its
designation as a marker in the text; the applier silently reported
success without touching it. It now rewrites the marker and lets a
struck placeholder with the target designation give way.
Sentence splitting. Gazette citations („(BGBl. I S. 1982)“) and
line-initial enumeration markers were splitting sentences, so Satz
locators pointed into the wrong place; a sentence may also open with §.
Command language: „wie folgt neu gefasst“ and the missing „wird“, a
split location („In Absatz 2 wird Satz 1 wie folgt gefasst“), an
insertion behind a location prefix, the standalone „Der Punkt am Ende
wird durch … ersetzt“, „Dem Wortlaut des Absatzes 3 …“, the verb frame
„Es werden ersetzt:“ whose items carry only the location, coordination
at „sowie“ and before a punctuation clause, and a stray closing quote at
the end of a sentence.
Stem format: LandesRechtTextParser reads an „Inhaltsübersicht“ line as
the norm of that name (which is what the Angabe commands address) and
recognises keyword-less Roman section headings.
Everything the two acceptance tests do not apply is named: one command
in the WDR-Gesetz whose „Punkt am Ende des Satzes“ is not unambiguous in
a two-sentence Nummer. The remaining differences from the official
consolidations are places where the official text itself departs from
the command wording; SOURCES lists them.
Change-Id: I261cf89cd5820f7597bc5db734f322d94b84828e
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The documented next step was the word-anchored structural insertion
("Vor den Wörtern „Aus dem Bereich Verkehr:“ wird folgender Absatz 5
eingefügt", Berlin Artikel 1 Nr. 2 b) bb)). StrukturEinfuegung now
carries an optional WortAnker, the recogniser has a pattern for the form
— placed before STRUKTUR_EINFUEGUNG, which bails out of recognition
entirely when the StellenParser cannot read "den Wörtern «0»" — and the
applier positions the new unit at the anchor line instead of a structural
boundary.
Two blockers turned up next to it, both measured on the corpus rather
than assumed:
The command was not cleanly recognisable at all. Its closing quotation
mark is missing in the official text, so the quote swallowed items cc)
and c); an anchor alone would have made the command look applicable with
a huge foreign quote as its payload. The docs called a boundary at
enumeration markers impossible, and that holds for the unguarded form: a
quoted amendment provision carries command language itself. Guarded by
four conditions together — the article's quotation marks demonstrably do
not balance, the next line's marker is at the same or a shallower level
than the one the quote opened on, that line carries command language, and
closing here leaves the rest of the article balanced — it fires exactly
twice in the whole sample corpus, both times where the missing mark
belongs: Berlin before cc), and GV. NRW. Artikel 2 before 12. Without the
guards it also fires inside quoted amendment provisions in the BayJG and
GModG documents; the balance gate rules those out.
The GV.-NRW. gazette encodes part of its umlauts decomposed (u + U+0308,
79 places, dozens of them "eingefügt:"/"angefügt:"). Invisible in the
text, but a different word to every command pattern, so those commands
could never match. TextBereiniger now normalises to NFC first — not
NFKC, which would flatten the official sentence numbers ¹²³ and take
SatzTeiler and Superskript their basis. Every other sample document,
every gii-XML stem and every hand-kept plain-text stem is already NFC, so
the pinned figures stay bit-identical.
Berlin Artikel 1 is thereby fully recognised (6 of 6 commands, none
unknown). One pinned statement changed for a stated reason: the NRW
acceptance test asserted the article-heading warning, which is now
preempted by the item boundary inside Artikel 2 — Nr. 12 survives
instead of being swallowed. 241 tests green.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: Ic579bec6fecc2495a61b3dcf87c9ad71b42f34ae
|
| |
|
|
|
|
|
|
|
| |
Only the Schleswig-Holstein and Berlin portals were probed. Stating the
same for Baden-Württemberg, Hesse, Thuringia and Lower Saxony would have
invited a future session to skip an attempt that might well succeed.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: I0fecfff43b4cb941eb973d2c7805a0eee0029781
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The README still described state law as Bavaria-only, six Länder later.
The sample-data overview grew a section on how to obtain the pre-
amendment stems per portal — which of the three routes works, and that
the juris state portals are a dead end — and a short prioritised "where
to continue", so the next session does not have to re-derive it.
Corrected while writing it: the regression figures are not all pinned
the same way. UWG, AGG and ProdHaftG pin "nothing left manual", BayJG
pins 154 commands and names its five renumbering residues, and the state
cases pin full application. Saying "UWG 19/0, GEG 66/53, …" would have
described observations, not what the tests actually assert.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: Ie247e9626e789e628d537bede735923d5b67d14b
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Investigating "Anlagen as amendment target" corrected the diagnosis from
yesterday: Anlagen are supported. In gii-XML they are norms of their own
("Anlage 8", "Anhang"), Stelle.anlagenEnbez() resolves them, and the GEG
sample applies annex-targeted commands — only two of its fifty manual
entries touch annexes, both for content reasons.
What actually failed in Berlin was narrower, and is fixed:
* A law with a single annex names it after the provision it belongs to
("Die Anlage zu § 2 Absatz 4 Satz 1"). StellenParser demanded a
number after "Anlage" and rejected the phrase, so the article's frame
command went unrecognised and its items lost their context. The
annex now carries the designation "Anlage", like "Anhang". The naming
suffix is skipped deliberately: read along, the "§ 2" inside it would
become the target and the wrong norm would be amended.
* C0 control characters are now stripped. Berlin's enumeration indent
carries a U+0007 that sits invisibly in front of the command and made
its start-of-line anchor miss.
* Command verbs torn apart by a stray space in the official typesetting
("ein gefügt" for "eingefügt") are rejoined, restricted to sequences
that are not valid German word order.
Three of Article 1's four commands are now recognised. The fourth places
the new unit by a word anchor ("Vor den Wörtern … wird folgender Absatz 5
eingefügt"), which StrukturEinfuegung cannot express; that and the
inability of the plain-text stem format to carry an Anlage at all are
recorded in Landesrecht-Beispiele.adoc.
231 tests green; all pinned figures unchanged.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: Ic5804bf343dd5d8ce435c07b8f882ca0372890d2
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The plan assumed the two-column Berlin gazette would need x-coordinate
column detection. It does not: the content stream already emits the left
column fully before the right one, so commands come out in reading order.
The test pins that finding.
What does go wrong there is different, and two parts of it are fixed:
* The article's amendment formula carries its own target ("§ 2 Satz 1
des Gesetzes zur Errichtung … wird wie folgt geändert"), but the
following items never inherited it. The pattern's leading \b could
never match before "§" — a non-word character needs a word character
in front of it — so the paragraph branch was dead code and only the
Bavarian "Art." branch ever fired.
* The running page header is not a line of its own; it sits inside the
body text of the following column, so it has to be cut out rather
than dropped as a column title.
Two blockers remain and are recorded rather than papered over: Article 1
amends an *Anlage* with its own numbering, which the model does not carry
(the same gap that shelved Baden-Württemberg), and full-width frames
(title block, imprint) sit elsewhere in the stream than on the page,
which would need a real XY-cut. Stems are unobtainable either way —
gesetze.berlin.de is an authenticated juris app like the Schleswig-
Holstein portal.
229 tests green; all pinned figures unchanged.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: I4619dbe96a023d61104d7107a9a34533123d1bc5
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The NEFG acceptance case left two commands as "check manually". Both are
now supported, so Lower Saxony applies 7 of 7 with no remainder.
* Lower Saxony cites inserted paragraphs with a space before the sub
number ("§ 2 a"); the rest of German legal usage writes "§ 2a", which
is what the Stelle and level parsers expect. TextBereiniger now pulls
the form together, leaving enumeration markers of the amendment act
alone ("… nach § 8 c) In Absatz 2 …").
* "In Kapitel 4 wird nach § 12 der folgende neue § 13 angefügt" — the
division only names the section the new paragraph lands in; the
anchor governs the position, as in the plain form. The optional
"neue" is now accepted in both.
Applying that insertion needed one more thing: the paragraph it creates
is only vacated by the *following* command ("Der bisherige § 13 wird
§ 14"), so in document order the two collided and the insertion was
rejected. "Bisherig" denotes the state before the amendment, so the
renumbering logically precedes the reoccupation and is now pulled ahead.
The log still lists commands in the order of the amendment act.
226 tests green; all other pinned figures unchanged.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: I0e2ea5b0389f8002157eeb8471800da51febe739
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Article 3 of the 22. Rundfunkänderungsgesetz (GV. NRW. 2026 S. 202) amends
the Telemedienzuständigkeitsgesetz. All four commands apply cleanly, and
the result matches the official consolidated version of 1 April 2026.
recht.nrw.de turned out to be the one remaining state portal that serves
consolidated laws as server-rendered HTML, with the version history
encoded in the URL date prefix — so the pre-amendment stem (27 Apr 2022)
was directly obtainable.
Two fixes were needed:
* LandesRechtTextParser read the parenthesised title suffix wholly as
the abbreviation. State laws routinely carry both short title and
abbreviation there ("(Telemedienzuständigkeitsgesetz – TMZ-Gesetz)"),
and the amendment act cites the short title, so article selection
never matched. The parser now splits at the dash.
* ZitatExtraktor swallowed the rest of the document when a closing
quotation mark is missing in the official text (Article 2 no. 11
here), which hid Articles 3 to 5 entirely. An amendment act never
quotes across an article heading, so an open quotation is now closed
before a bare "Artikel N" line, with a warning. Quoted paragraphs are
unaffected: Bavarian norm heads read "Art. N".
223 tests green; all previously pinned figures unchanged.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: I78470075d9be2433966b821b6fe1e21808996c46
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The GVOBl. Schl.-H. amendment act (Kommunalrecht, 2026/27) brings three
conventions the tool had not seen:
* a running two-line page header that sits between articles and glued
itself onto the following article heading,
* superscript footnote markers on article headings ("Artikel 1 ¹)"),
which defeated the article split, and
* ragged-right typesetting, where the geometric margin detection finds
no alignment cluster and reports full lines as hard line ends, so a
trailing hyphen was never joined.
All three are fixed in TextBereiniger; the hyphen rule now trusts the
extractor's trailing-space signal over the geometric class.
A full acceptance test is not possible: the Schleswig-Holstein law portal
serves document bodies only through an authenticated API, and the last
freely archived consolidated Gemeindeordnung (14 Nov 2022) predates the
amended § 34a. The new test therefore covers everything up to and
including command recognition; the blocker is recorded in
Landesrecht-Beispiele.adoc.
219 tests green; Bund/Bayern/Sachsen/Niedersachsen figures unchanged.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: I9b3ab8a756372504b51c4d410b491fded255da96
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Second §-structured Landesrecht case for wave six: the Lower Saxony ELER Support
Act (NEFG, unchanged since 2022, derived from the two-column Nds. GVBl 2022 No. 33)
plus the amending act of 28 Jan 2026 (Nds. GVBl 2026 No. 10). Five of seven
commands apply — both "erhält folgende Fassung" re-enactments (§ 1(1), § 2), the
citation replacement in § 1(5), the words insertion in § 6(1), and the § 13 → § 14
renumbering.
- LandesRechtTextParser: a norm head no longer accepts a title ending in a full
stop, so a cross-reference sentence at line start ("§ 7 GAPInVeKoSG findet
entsprechend Anwendung.") is not misread as a norm head "§ 7" (which had made the
monotonicity check swallow the norms in between).
- TextBereiniger: strip the Lower Saxony GVBl running footer and publisher line.
The footer sat between two enumerated items and otherwise attached to the
preceding re-enactment quote, defeating its end-of-sentence anchor.
- Add sampledata/Niedersachsen/NEFG-alt.txt and EndToEndTest.nefgAcceptance.
Two insertion forms remain documented residues (manuell prüfen): inserting a
§-block with a space-separated sub-number ("§ 2 a") and a chapter-scoped §-block
insertion ("In Kapitel 4 wird nach § 12 … angefügt").
221 tests green; federal, Bavarian and Saxon pinned numbers unchanged.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Change-Id: Ie23eee1f596ec8eecc6a73f6ce585a22e73ec6c9
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Complete the first §-structured Landesrecht acceptance case for wave six: the
Saxon Civil Servants' Pension Act (SächsBeamtVG) in its 1 Feb 2025 version plus
the amending act of 13 April 2026 (SächsGVBl. S. 134). All five commands are
recognised and applied without residue — the amount replacements in § 47 and the
re-enactment of § 80(1) sentence 2.
- LandesRechtTextParser: recognise arabic, keyword-first structural headings
("Abschnitt 1", "Unterabschnitt 2", "Teil 3") via GLIEDERUNG_ARABISCH, in
addition to Bavaria's roman "I. Abschnitt" form. Bavaria behaviour unchanged.
- TextBereiniger: strip the footer of revosax full-text output (REVOSAX_FUSS,
"https://…revosax… Fassung vom … Seite N von M").
- Add the consolidated pre-amendment stem as canonical plaintext
(sampledata/Sachsen/SaechsBeamtVG-alt.txt, derived from the archived revosax
full text) and EndToEndTest.saechsBeamtVgAcceptance (5 applied, 0 manual).
220 tests green; federal and Bavarian pinned numbers unchanged.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Change-Id: I8e878bc9506f24028cf643a873de000f3d066d64
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Collect real amendment gazettes/ordinances from Berlin, Schleswig-Holstein,
Hessen, Niedersachsen (two hefts), Baden-Württemberg, Nordrhein-Westfalen,
Sachsen and Thüringen as candidates for a further enhancement wave, plus an
.adoc overview. Unlike Bavaria (Art./§ inversion) these Länder use § in their
stem laws; the new test dimensions are PDF layout (Berlin two-column, Hessen
letter-spacing) and command idioms ("erhält folgende Fassung", superscript
Artikel footnote markers, amtliche Satznummern in a § context). Only the
amendment documents are included so far; the consolidated stem versions and
Rheinland-Pfalz remain open.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Change-Id: I0e3e761763038abda144266381cf59f8d8f3bf78
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Extend ÄndGgner from federal-only to Bavarian state law. Bavarian base
laws are structured in Artikel while their amending acts are structured
in Paragraphen (inverted from the Bund); official sentence numbers and
footnote markers are carried as Unicode superscripts (¹²³, ⁶)).
- Generalise Stelle.Paragraph to carry a sigil ("§" or "Art.") and route
it through recogniser, applier and resolver (bit-identical Bund output).
- Superscript pipeline: geometric detection in FontgroessenFilter
(SuperskriptModus BEHALTEN), Superskript util, exact sentence splitting
in SatzTeiler, label-based sentence resolution.
- BayRechtLoader/BayRechtTextParser for gesetze-bayern.de PDF/plaintext.
- §-structured amending acts, GVBl/Landtag column titles, non-breaking
spaces, the GVBl continuation quote; Bavarian command forms (footnote
aufhebung, Satznummerierung streichung, Wortlaut forms, Halbsatz,
gapping chains).
Acceptance (EndToEndTest.bayJgGvblAcceptance): the pre-2026 BayJG
fassung (BayJG-alt.txt, reconstructed from Wayback single-article
snapshots) with GVBl 6/2026 §§ 1-2 applied — 154 commands, 0 unknown,
149 applied automatically, 5 pinned residuals (follow-up edits inside
two multi-step renumbering sequences in Art. 29a and Art. 56).
Application-side fixes surfaced by the acceptance run (all Bund-safe):
sentence-start superscript before §; sentence boundaries = {0} ∪ {each
number ≥ 2}; gapping scope inheritance for bare word operations;
footnote definition lines hidden from word operations; absatz aufhebung
marks "(weggefallen)" keeping its number, and absatz renumbering
overwrites an empty placeholder (weggefallen/gegenstandslos) target.
211 tests green (mvnw verify); federal reference numbers unchanged.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Change-Id: Iebae4c17ca90755c5fd36251362042f3d5796fd0
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Five new datasets with provenance in SOURCES files:
* UWG: 3. UWGAendG (BGBl. 2026 I Nr. 43) in the new digital BGBl
format, plus drafts.
* GEG: the 2023 "Heizungsgesetz" (BGBl. 2023 I Nr. 280, new format)
and the pending GModG 2026 drafts.
* AGG: 2. AGGAendG drafts (RefE/RegE/BT-Drs 21/6178) -- the base XML
predates the bill, so this dataset produces real diffs -- and the
official BMJV synopsis as ground truth.
* ProdHaftG: product-liability modernization drafts (Artikel 1 is a
replacement act, Artikel 2 amends the old law), with official
synopsis.
* BayJG: Bavarian hunting-law amendment (GVBl. 2026 S. 113) -- state
law is not yet supported by the tool; kept for future work.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Change-Id: I8c33b6a19178f73cece9c9da99c713009016e578
|
| |
|
|
|
|
|
|
|
|
|
| |
The Infektionsschutzgesetz as gii-norm XML, EPUB, and PDF (consolidated
as of 2020-11-20, i.e. already including the Art. 1 changes below), the
Drittes Bevoelkerungsschutzgesetz (BGBl. I 2020 S. 2397) as published,
and the Bundestag/Bundesrat drafting documents, with provenance URLs in
SOURCES. Used by the end-to-end smoke test.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Change-Id: I1221734ea3e3dab705151421774151438be1b337
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bump all dependencies and plugins to current versions. Replace the
tika-parsers bundle with a direct PDFBox dependency (we need
PDFTextStripper control), add java-diff-utils for the synopsis diff,
and add JUnit 5 with AssertJ for testing. Drop unused dependencies
(tess4j, Lanterna, term4j, sqlite-jdbc, imageio codecs, annotation
libraries) in favour of jspecify. Regenerate the Maven wrapper with
the official plugin (Takari is dead) and remove the vestigial Ant
wrapper and Tika configuration.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Change-Id: I0e1813b3967027cbb0bb978591d345ce138fa0a0
|
|
|
With the new configuration, Tika can now extract text from PDFs and
XML documents.
Also configures logging for the application.
Change-Id: I7a89c2b232ed4e220665dd335a5f5a0cc3ef2994
|
