Frederik ElwertSep 25, 2024
In a methods / #DigitalHumamities class next semester, I want to cover basic corpus creation. Especially, I’ll probably focus on #OCR/#HTR/#ATR and #WebScraping. I find it incredibly hard to find good papers that can serve as a general introduction into these topics. All I find are either practical tutorials, or very specialized papers about specific approaches. Do you have any favorite readings about how to get to a text corpus in DH in the first place? Please share!
Show threadFrederik ElwertSep 26, 2024

There seems to be a lot of interest in the question (thanks for the boosts!), but not so many suggestions yet. So I thought I’d share what I have found so far:

Re WebScraping, I think this paper by Black is a really good high-level overview: Black, Michael L. 2016. “The World Wide Web as Complex Data Set: Expanding the Digital Humanities into the Twentieth Century and Beyond through Internet Research.” IJHAC 10 (1): 95–109. https://doi.org/10.3366/ijhac.2016.0162.

Show threadAlexander WinklerSep 26, 2024
@felwert vielleicht ist da ja etwas dabei:
Barbaresi, Adrien, und Jens Pohlmann. „A Reproducible IT-Blog Corpus“. Journal of Open Humanities Data 7 (22. Juli 2021): 17. https://doi.org/10.5334/johd.35.
Dumitru, Vlad, Denis Iorga, Stefan Ruseti, und Mihai Dascalu. „Garbage in, garbage out: An analysis of HTML text extractors and their impact on NLP performance“. In 2023 24th International Conference on Control Systems and Computer Science (CSCS), 403–10. IEEE, 2023. https://ieeexplore.ieee.
1/4
A Reproducible IT-Blog Corpus | Journal of Open Humanities Data

The Journal of Open Humanities Data (JOHD) aims to be a key part of a thriving community of scholars sharing humanities data. The journal features peer reviewed publications describing humanities research objects or techniques with high potential for reuse. Humanities subjects of interest to JOHD include, but are not limited to Art History, Classics, History, Library Science, Linguistics, Literature, Media Studies, Modern Languages, Music and musicology, Philosophy, Religious Studies, etc. Submissions that cross one or more of these traditional disciplines are particularly encouraged.  

Journal of Open Humanities Data
Show threadAlexander WinklerSep 26, 2024
@felwert org/abstract/document/10214756/.
Hartmann, Stefan. „Open Corpus Linguistics–or How to overcome common problems in dealing with corpus data by adopting open research practices“, 2023. https://osf.io/preprints/psyarxiv/ywg5v/.
Laippala, Veronika, Samuel Rönnqvist, Saara Hellström, Juhani Luotolahti, Liina Repo, Anna Salmela, Valtteri Skantsi, und Sampo Pyysalo. „From web crawl to clean register-annotated corpora“. In Proceedings of the 12th Web as Corpus Workshop, 14–22, 2020.
2/4
OSF

Show threadAlexander Winkler
@felwert https://aclanthology.org/2020.wac-1.3/.
McCarthy, Michael, und Anne O’Keeffe. „Historical perspective: What are corpora and how have they evolved?“ In The Routledge Handbook of Corpus Linguistics. Routledge, 2010.
Reuter, Kevin, und Lucien Baumgartner. „Corpus Analysis: Building and Using Corpora—A Case Study on the Use of “Conspiracy Theory”“. In Experimental Philosophy for Beginners: A Gentle Introduction to Methods and Tools, herausgegeben von Stephan Kornmesser, Alexander
3/4
From Web Crawl to Clean Register-Annotated Corpora

Veronika Laippala, Samuel Rönnqvist, Saara Hellström, Juhani Luotolahti, Liina Repo, Anna Salmela, Valtteri Skantsi, Sampo Pyysalo. Proceedings of the 12th Web as Corpus Workshop. 2020.

ACL Anthology
Sep 26, 2024 at 9:03amWeb
Show threadAlexander WinklerSep 26, 2024
@felwert Max Bauer, Mark Alfano, Aurélien Allard, Lucien Baumgartner, Florian Cova, Paul Engelhardt, u. a., 275–320. Cham: Springer International Publishing, 2024. https://doi.org/10.1007/978-3-031-58049-9_6.
Xu, Zhipeng, Zhenghao Liu, Yukun Yan, Zhiyuan Liu, Ge Yu, und Chenyan Xiong. „Cleaner Pretraining Corpus Curation with Neural Web Scraping“. arXiv, 14. Juni 2024. http://arxiv.org/abs/2402.14652.
4/4