Dark Data Project

22 Followers
13 Following
23 Posts
The Dark Data Project helps organizations surmount data barriers, particularly involving unstructured, obfuscated, inaccessible or otherwise problematic datasets.
Websitehttps://darkdataproject.org
Twitterhttps://twitter.com/darkdataproject
Oceanographers discover "24 new deep-sea creatures and a whole new evolutionary branch" reports Inside Climate News as NOAA moves forward with streamlining the regulatory process for commercial seabed mineral extraction https://insideclimatenews.org/news/26032026/scientists-discover-new-deep-sea-creatures https://www.noaa.gov/news-release/noaa-accelerates-permitting-timeline-for-deep-seabed-mining-applications
"Because the supply chain is opaque... [companies] are unlikely to know the precise origins of the lead they use," writes Peter S Goodman, Will Fitzgibbon and Samuel Granados in @newyorktimes https://www.nytimes.com/interactive/2025/11/18/world/africa/lead-poisoning-car-battery.html #darkdata
The Auto Industry’s Lead Recycling Program is Poisoning People

We documented the toxic fallout of a green technology.

The New York Times
"Many organisms important to human health... haven't even been named, let alone studied," reports Ewen Callaway in @nature.com, citing Nicola Segata at University of Trento https://www.nature.com/articles/d41586-025-00038-x #darkdata
These are the 20 most-studied bacteria — the majority have been ignored

Model microbes such as Escherichia coli hog scientists’ attention, leaving most known bacteria with few publications devoted to them.

Current climate data "don’t reflect recent changes such as newer pollution controls, volcanic eruptions or even the effects of Covid," writes @climateofgavin and @hausfath in @newyorktimes https://www.nytimes.com/2024/11/13/opinion/climate-change-heat-planet.html #darkdata
Opinion | Climate Science Can’t Keep Up With the Warming Planet

We need more timely updates in response to the rapid changes to the climate.

The New York Times
Data on items transiting US ports is ostensibly public, but "it's not free, and it's unusable in the format that it comes in," according to Michael Kanko at ImportGenius, interviewed by Amanda Aronczyk on Planet Money https://www.npr.org/2024/10/11/1210938268 #darkdata
"Hidden debts accumulate when economies are booming, and are more likely to be exposed when growth slows," reports the Economist, citing the World Bank, the University of Duisburg-Essen and the University of Notre Dame https://www.economist.com/finance-and-economics/2024/10/03/a-tonne-of-public-debt-is-never-made-public #darkdata
A tonne of public debt is never made public

New research suggests governments routinely hide their borrowing

The Economist
"We cannot calculate with missing data, just as we can't divide by zero,” says Stef van Buuren and reported by Matt von Hippel in @quantarss https://www.quantamagazine.org/when-data-is-missing-scientists-guess-then-guess-again-20241002 #darkdata
When Data Is Missing, Scientists Guess. Then Guess Again. | Quanta Magazine

Across the social and biological sciences, statisticians use a technique that leverages randomness to deal with the unknown.

Quanta Magazine
As reported in Nature, no bird flu outbreak has been found on Missouri dairy farms, arguably because the state "does not require farmers to test their cows" https://www.unmc.edu/healthsecurity/transmission/2024/09/24/is-bird-flu-spreading-among-people-data-gaps-leave-researchers-in-the-dark #darkdata
Is bird flu spreading among people? Data gaps leave researchers in the dark

Nature Researchers are anxiously awaiting data from the midwestern state about a mysterious bird flu infection in a person who had no known contact with potential animal carriers of the disease. Th…

The Transmission
"A common strategy to neutralize a social problem is to make it difficult to know about," write @coopermarianne & @drmaximvoronov in @sciam. "If we don’t monitor or mention it, then things can feel back to normal." https://www.scientificamerican.com/article/weve-hit-peak-denial-heres-why-we-cant-turn-away-from-reality #darkdata @laurahelmuth
We’ve Hit Peak Denial. Here’s Why We Can’t Turn Away From Reality

We are living through a terrible time in humanity. Here’s why we tend to stick our head in the sand and why we need to pull it out, fast

Scientific American
Most data breaches don't result from zero-days or Ocean's Eleven-style heists