Skip to content

β³-IRT: A New Item Response Model and its Applications

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Original languageEnglish
Title of host publicationProceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS 2019)
Subtitle of host publicationApril 16-18, 2019, Naha, Okinawa, Japan
Publisher or commissioning bodyProceedings of Machine Learning Research
DateAccepted/In press - 22 Dec 2018

Publication series

NameProceedings of Machine Learning Research
Volume89
ISSN (Print)2640-3498

Abstract

Item Response Theory (IRT) aims to assess latent abilities of respondents based on the correctness of their answers in aptitude test items with different difficulty levels. In this paper, we propose the 3-IRT model, which models continuous responses and can generate a much enriched family of Item Characteristic Curves. In experiments we applied the proposed model to data from an online exam platform, and show our model outperforms a more standard 2PL-ND model on all datasets. Furthermore, we show how to apply 3-IRT to assess the ability of machine learning classifiers. This novel application results in a new metric for evaluating the quality of the classifier’s probability estimates, based on the inferred difficulty and discrimination of data instances.

Documents

Documents

  • Full-text PDF (accepted author manuscript)

    Accepted author manuscript, 1 MB, PDF-document

    Embargo ends: 1/01/99

    Request copy

View research connections

Related faculties, schools or groups