Flexible and Nonparametric Item Response Models

A common finding in the educational and psychological measurement literature is the failure of simple IRT models to have good fit for certain items. In other words, an assumption regarding the functional form of the relationship between the latent construct and the item responses is violated. This observation sometimes occurs for psychopathology data, data with mixed populations, and for multiple choice educational tests where there is some effect of guessing. Some alternatives are difficult to estimate (3- and 4-parameter logistic models), and some nonparametric methods may not neatly fit the demands of operational testing programs in which policy and high-stakes decisions are made (e.g., patient-reported outcomes, academic entrance and licensure exams, large-scale international educational assessments). In such testing programs, it is often required that a candidate model is able to be used with multiple groups of participants (such as demographic groups, in order to investigate item or test bias) and planned missing data designs (in which participants do not complete all test items), can be estimated relatively quickly, and can be used in conjunction with a computer adaptive test. In addition, retaining items that would otherwise not fit is highly desirable as such items can cost thousands of dollars to develop. Thus, the overarching goal of this line of research is to develop more flexible modeling approaches that can more readily meet these operational demands.

Representative Publications

  • Falk, C.F., & Fischer, F. (2022). More flexible response functions for the PROMIS physical functioning item bank by application of a monotonic polynomial approach. Quality of Life Research, 31, 37-47. doi: 10.1007/s11136-021-02873-7

  • Falk, C.F., & Feuerstahler, L.M. (2022). On the performance of semi- and nonparametric item response functions in computer adaptive tests. Educational and Psychological Measurement, 82, 57-75. doi: 10.1177/00131644211014261

  • Falk, C.F. (2020). The monotonic polynomial graded response model: Implementation and a comparative study. Applied Psychological Measurement, 44, 465-481. doi: 10.1177/0146621620909897

  • Falk, C.F. (2019). Model selection for monotonic polynomial item response models. In In M. Wiberg, S. Culpepper, R. Janssen, J. González, and D. Molenaar (Eds.), Quantitative Psychology: The 83rd Annual Meeting of the Psychometric Society, New York, NY, 2018 (pp. 75–85). Cham, Switzerland: Springer Nature.

  • Falk, C.F., & Cai, L. (2016). Maximum marginal likelihood estimation of a monotonic polynomial generalized partial credit model with applications to multiple group analysis. Psychometrika, 81, 434-460. doi: 10.1007/s11336-014-9428-7

  • Falk, C.F., & Cai, L. (2016). Semi-parametric item response functions in the context of guessing. Journal of Educational Measurement, 53, 229-247. doi: 10.1111/jedm.12111