Show threadMagnus JohanssonApr 23
A recent tutorial paper on Bayesian #ItemResponseTheory with brms called for the creation of an R package make it easier for researchers to run this type of analysis. While my package is focused on #Rasch models, I hope it contributes towards this end https://doi.org/10.1016/j.jsp.2024.101427
Tech ChilliJun 16, 2024

Automated Evaluation Method for Assessing Hallucination in RAG Models.

See here - https://techchilli.com/artificial-intelligence/automated-evaluation-method-for-assessing-hallucination-in-rag-models/

#AI #RAGModels #AutomatedEvaluation #HallucinationDetection #ItemResponseTheory #AIAssessment #TechInnovation #ScalableSolutions #AccurateMetrics #ArtificialIntelligence #MachineLearning #TechResearch #AIInsights #InnovationInAI #CostEfficiency

Automated Evaluation Method for Assessing Hallucination in RAG Models

Discover a scalable and cost-efficient approach to evaluate RAG models using an automated exam builder and IRT. This innovative method ensures accurate, human-interpretable metrics for assessing AI models in various domains.

Tech Chill
Eren Can AybekNov 11, 2022

#Introduction

I work as an Assoc. Prof. at Pamukkale University on #EducationalMeasurement #Psychometrics field. I'm also a researcher at Boğaziçi University Adaptive Test Lab (#BATLAB)

My main research area includes #ItemResponseTheory (#IRT) #ComputerizedAdaptiveTesting (#CAT) and I'm happy to use #rstats and #Concerto for my studies.

I also want to add some personal tags: #PlayStation #PS #Xbox #Metal #Homebrew