R folks listening to this morning's #NICAR26 session on extracting data from documents and - importantly! - how to check your results: You can set up and run evaluations of LLM results with the {vitals} #rstats 📦
https://www.infoworld.com/article/4130274/how-to-choose-the-best-llm-using-r-and-vitals.html #DDJ
How to choose the best LLM using R and vitals

Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

InfoWorld