Guessing-testlet response model

• Published in: ICSSBE 2012 - Proceedings, 2012 International Conference on Statistics in Science, Business and Engineering: "Empowering Decision Making with Statistical Sciences"
• Main Author: Leong S.H.; Ling S.E.; Mahdi R.
• Format: Conference paper
• Language: English
• Published: 2012
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-84872913252&doi=10.1109%2fICSSBE.2012.6396604&partnerID=40&md5=1cda627b575079b2b14d76614ba7297e

The psychometric standard of fairness can be violated if the guessing effect is improperly handled. The two most common ways of handling guessing effect are through item design and guessing effect modeling. Items with lower priori guessing probability helps to reduce guessing effect. This paper proposes a two-parameter logistic guessing-testlet response model to model such items. The proposed model is an extended testlet response model where items of the same guessing priori guessing probability are grouped in the same testlet. To reduce the priori guessing probabilities, the items are designed to have multiple-correct responses and the number of correct responses is varying across items. Simulation result shows that the proposed model outperforms the two-parameter logistic item response model in model fit. The proposed guessing-testlet merits ability with no guessing but penalizes ability with guessing. © 2012 IEEE.