| Research Group Website | https://www.responsible-nlp.net |
| Foto | Martin Schäfer |
I’m in Bangkok for #ACL2024 and will talk about Legal NLP:
On Monday I present our corpus and paper AGB-DE (https://arxiv.org/abs/2406.06809) at the third poster session.
On Thursday I will talk about teaching NLP in Law School as part of the Workshop on Teaching NLP.
If you’re at ACL and interested in Legal NLP (or NLP 4 Social Good, Teaching NLP, Disagreement and Perspectivism, other cool applications or just want to have a chat) stop by!
Legal tasks and datasets are often used as benchmarks for the capabilities of language models. However, openly available annotated datasets are rare. In this paper, we introduce AGB-DE, a corpus of 3,764 clauses from German consumer contracts that have been annotated and legally assessed by legal experts. Together with the data, we present a first baseline for the task of detecting potentially void clauses, comparing the performance of an SVM baseline with three fine-tuned open language models and the performance of GPT-3.5. Our results show the challenging nature of the task, with no approach exceeding an F1-score of 0.54. While the fine-tuned models often performed better with regard to precision, GPT-3.5 outperformed the other approaches with regard to recall. An analysis of the errors indicates that one of the main challenges could be the correct interpretation of complex clauses, rather than the decision boundaries of what is permissible and what is not.
In der Politik ist man bekanntlich bis 35 jung. Deshalb durfte ich heute beim Common Grounds Forum der @informatik mit anderen jungen Menschen unsere Ideen zur Digitalpolitik diskutieren.
Besonders gefreut hat mich, dass mich die Teilnehmer:innen als einen ihrer Vertreter gewählt haben um die gemeinsam erarbeiteten Positionen im November beim Digital-Gipfel der Bundesregierung in Jena zu vertreten.
