TY - JOUR

T1 - Bayesian Modeling for a Uniform Differential Item Functioning Analysis Procedure in Item Response Theory

T2 - Probability That Item Difficulty Parameters and Correct Answer Probabilities Differ Between Groups

AU - Akiyama, Takashi

AU - Toyoda, Hideki

N1 - Publisher Copyright:
©2020, Japanese Journal Of Educational Psychology. All rights reserved.

PY - 2020

Y1 - 2020

N2 - Item response theory (IRT) is a theory that aims to separate and analyze characteristics of examinees and characteristics related to item difficulty. In item response theory, if 2 examinees have the same characteristic value, all probabilities of correct response to an item that has the same item characteristic are equal, regardless of whether or not the examinees belong to the same subgroup. If the mutual probabilities are different between the subgroups to which the examinees belong, the item has differential item functioning (DIF). Differential item functioning analysis in item response theory traditionally relies on null hypothesis tests. That method may identify a non-differential item functioning item as a differential item functioning item. Also, the magnitude of differential item functioning cannot be interpreted directly from the results of null hypothesis significance tests. The present paper proposes a differential item functioning analysis procedure based on Bayesian modeling for uniform differential item functioning. When the proposed method is used, it is possible to combine the traditional procedure of estimating the item parameters separately for each subgroup and, from that, estimating the equating coefficient.

AB - Item response theory (IRT) is a theory that aims to separate and analyze characteristics of examinees and characteristics related to item difficulty. In item response theory, if 2 examinees have the same characteristic value, all probabilities of correct response to an item that has the same item characteristic are equal, regardless of whether or not the examinees belong to the same subgroup. If the mutual probabilities are different between the subgroups to which the examinees belong, the item has differential item functioning (DIF). Differential item functioning analysis in item response theory traditionally relies on null hypothesis tests. That method may identify a non-differential item functioning item as a differential item functioning item. Also, the magnitude of differential item functioning cannot be interpreted directly from the results of null hypothesis significance tests. The present paper proposes a differential item functioning analysis procedure based on Bayesian modeling for uniform differential item functioning. When the proposed method is used, it is possible to combine the traditional procedure of estimating the item parameters separately for each subgroup and, from that, estimating the equating coefficient.

KW - Bayesian modeling

KW - differential item functioning (DIF)

KW - equating coefficient

KW - indices of differential item functioning

KW - item response theory (IRT)

UR - http://www.scopus.com/inward/record.url?scp=85102150002&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85102150002&partnerID=8YFLogxK

U2 - 10.5926/JJEP.68.250

DO - 10.5926/JJEP.68.250

M3 - Article

AN - SCOPUS:85102150002

SN - 0021-5015

VL - 68

SP - 250

EP - 265

JO - Japanese Journal of Educational Psychology

JF - Japanese Journal of Educational Psychology

IS - 3

ER -