David WhelanPreparing for a discussion next week on using law supplier RAG-infused AI for legal research. Lexis "Protege" insists on providing results in an indented, ordered list of 1, b, 3. When asked to update those 3 items, it returns a new list (still 1, b, 3 instead of 1, 2, 3) omitting one original case and adding in a new one. One challenge will be getting past this very basic fragility in how results are presented. #LawLibraries #AI
Dmytro Demchenko 🇺🇦@davidpwhelan This case feels like a "teething trouble" that might never truly be cured. But my main concern is the legal systemic impact: as these #RAG infused tools lower the barrier to entry, we will see an exponential surge in such "fragile" legal outputs. How will the legal system handle this #DDos attack of automated incompetence? Are we looking at a future where the courts are paralyzed by the sheer volume of #AI generated procedural errors?