I keep thinking about what we get backwards. Measuring learning loss instead of loss of learning access and loss of learning resources. Fascinated by whether LLMs understand why some answers are wrong and not with whether our tests are designing unclear overlapping categories of answers that confuse test takers. Deciding kids are "addicted" to screens when we reduce the world to roads and kill our trees and parks.
When we do not truly understand ourselves, I think we cast these same misunderstandings onto our machines. These are not separate and opposed endeavors to me. We have been held back by so many rigid misconceptions about the divide between what is technical innovation and what is social innovation. That divide has served certain narratives and profits. But what solutions does it give us that fit our real world, or is it demanding we reshape our real world to fit it?