Bryony_Hooper
Help needed. Looking for a nice (mixed and possibly messy) set files to download to test some dp tools against.
#digipress
Sep 27, 2023 at 3:02pmWeb
Show threadBryony_HooperSep 27, 2023
Hasten to add... virus free.
Show threadThorstedSep 27, 2023
@Bryony_Hooper Here is a good list! https://github.com/digipres/awesome-digital-preservation#find-test-files
GitHub - digipres/awesome-digital-preservation: Carefully curated list of awesome digital preservation resources.

Carefully curated list of awesome digital preservation resources. - GitHub - digipres/awesome-digital-preservation: Carefully curated list of awesome digital preservation resources.

GitHub
Show threadBryony_HooperSep 27, 2023
@Thorsted thank you 😊👍
Show threadTim AllisonSep 28, 2023

@Bryony_Hooper

We've got files!

Bug-tracker corpus? (Attachments we crawled from bug trackers for open source parsers)

https://corpora.tika.apache.org/base/docs/bug_trackers/

Index of /base/docs/bug_trackers

Show threadTim AllisonSep 28, 2023

@Bryony_Hooper

8 million PDFs?
https://digitalcorpora.org/corpora/file-corpora/cc-main-2021-31-pdf-untruncated/

SAFEDOCS (CC-MAIN-2021-31-PDF-UNTRUNCATED) – Digital Corpora

Show threadTim AllisonSep 28, 2023

@Bryony_Hooper A deletectable set from the #ipres2023 #bakeoff

https://drive.google.com/drive/folders/1yOaxTcgPl5zNwYQP2_k7SOW59l4DgXGd

iPres2023_Data-Set – Google Drive

Show threadTim AllisonSep 28, 2023

@Bryony_Hooper Cabinet of horrors?

http://opf-labs.org/format-corpus/pdfCabinetOfHorrors/

Index of /format-corpus/pdfCabinetOfHorrors

Show thread#Digital ⚓️ #Vagabond 🦈Sep 28, 2023

@tallison @Bryony_Hooper perhaps you can consider a PR here Tim?

Also, the digital preservation awesome list may be of use Byrony:

https://github.com/digipres/awesome-digital-preservation#find-test-files

GitHub - digipres/awesome-digital-preservation: Carefully curated list of awesome digital preservation resources.

Carefully curated list of awesome digital preservation resources. - GitHub - digipres/awesome-digital-preservation: Carefully curated list of awesome digital preservation resources.

GitHub
Show thread#Digital ⚓️ #Vagabond 🦈Sep 28, 2023

@tallison @Bryony_Hooper and I shall follow up with my own advice and add this later!

https://digipres.club/@beet_keeper/111141299239431892

#Digital ⚓️ #Vagabond 🦈 (@[email protected])

pdf-differences "targeted PDF files exhibiting portability and interoperability issues" https://github.com/pdf-association/pdf-differences #digipres #FileFormats #PDF #FormatCorpus #FormatCorpora

digipres.club
Show thread#Digital ⚓️ #Vagabond 🦈Sep 28, 2023
@tallison @Bryony_Hooper and maybe this one if you really want to break things... https://github.com/ross-spencer/big-list-of-naughty-files
GitHub - ross-spencer/big-list-of-naughty-files: A file-generator tool wrapping the Big List of Naughty Strings

A file-generator tool wrapping the Big List of Naughty Strings - ross-spencer/big-list-of-naughty-files

GitHub
Show threadTim AllisonSep 28, 2023
@beet_keeper @Bryony_Hooper https://github.com/digipres/awesome-digital-preservation/pull/10
Add some corpora by tballison · Pull Request #10 · digipres/awesome-digital-preservation

Carefully curated list of awesome digital preservation resources. - Add some corpora by tballison · Pull Request #10 · digipres/awesome-digital-preservation

GitHub
Show threadJack O'SullivanSep 28, 2023

@Bryony_Hooper The "pantry" that was put together for the bake-off at iPres is at https://drive.google.com/drive/folders/1yOaxTcgPl5zNwYQP2_k7SOW59l4DgXGd

although I don't know how long it will remain there for.

iPres2023_Data-Set – Google Drive