Automated Evaluation Method for Assessing Hallucination in RAG Models

Discover a scalable and cost-efficient approach to evaluate RAG models using an automated exam builder and IRT. This innovative method ensures accurate, human-interpretable metrics for assessing AI models in various domains.

Tech Chill

#Introduction

I work as an Assoc. Prof. at Pamukkale University on #EducationalMeasurement #Psychometrics field. I'm also a researcher at Boğaziçi University Adaptive Test Lab (#BATLAB)

My main research area includes #ItemResponseTheory (#IRT) #ComputerizedAdaptiveTesting (#CAT) and I'm happy to use #rstats and #Concerto for my studies.

I also want to add some personal tags: #PlayStation #PS #Xbox #Metal #Homebrew