@mav @emilymbender yes! This scares me too. I work in healthcare informatics, and there is a feeling by some implementers, that “LLM’s are becoming too complicated to create consistent validity checks for.” Totally valid. BUT, before any results from LLM processes are put anywhere near patient care pipelines or used to evaluate observational datasets, we need to validate FIRST, or leave it completely alone.