Difference in method of administration did not significantly impact item response: an IRT-based analysis from the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative

TY - JOUR

T1 - Difference in method of administration did not significantly impact item response

T2 - an IRT-based analysis from the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative

AU - Bjorner, Jakob B

AU - Rose, Matthias

AU - Gandek, Barbara

AU - Stone, Arthur A

AU - Junghaenel, Doerte U

AU - Ware, John E

PY - 2014/2

Y1 - 2014/2

N2 - PURPOSE: To test the impact of method of administration (MOA) on the measurement characteristics of items developed in the Patient-Reported Outcomes Measurement Information System (PROMIS).METHODS: Two non-overlapping parallel 8-item forms from each of three PROMIS domains (physical function, fatigue, and depression) were completed by 923 adults (age 18-89) with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized cross-over design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) on the Internet, and a second form by PC, in the same administration. Structural invariance, equivalence of item responses, and measurement precision were evaluated using confirmatory factor analysis and item response theory methods.RESULTS: Multigroup confirmatory factor analysis supported equivalence of factor structure across MOA. Analyses by item response theory found no differences in item location parameters and strongly supported the equivalence of scores across MOA.CONCLUSIONS: We found no statistically or clinically significant differences in score levels in IVR, PQ, or PDA administration as compared to PC. Availability of large item response theory-calibrated PROMIS item banks allowed for innovations in study design and analysis.

AB - PURPOSE: To test the impact of method of administration (MOA) on the measurement characteristics of items developed in the Patient-Reported Outcomes Measurement Information System (PROMIS).METHODS: Two non-overlapping parallel 8-item forms from each of three PROMIS domains (physical function, fatigue, and depression) were completed by 923 adults (age 18-89) with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized cross-over design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) on the Internet, and a second form by PC, in the same administration. Structural invariance, equivalence of item responses, and measurement precision were evaluated using confirmatory factor analysis and item response theory methods.RESULTS: Multigroup confirmatory factor analysis supported equivalence of factor structure across MOA. Analyses by item response theory found no differences in item location parameters and strongly supported the equivalence of scores across MOA.CONCLUSIONS: We found no statistically or clinically significant differences in score levels in IVR, PQ, or PDA administration as compared to PC. Availability of large item response theory-calibrated PROMIS item banks allowed for innovations in study design and analysis.

KW - Adolescent

KW - Adult

KW - Aged

KW - Aged, 80 and over

KW - Arthritis, Rheumatoid

KW - Cross-Over Studies

KW - Data Collection

KW - Depressive Disorder

KW - Discrimination (Psychology)

KW - Female

KW - Humans

KW - Information Systems

KW - Male

KW - Middle Aged

KW - Outcome Assessment (Health Care)

KW - Pulmonary Disease, Chronic Obstructive

KW - Quality of Life

KW - Questionnaires

KW - Self Report

KW - Sickness Impact Profile

KW - Young Adult

U2 - 10.1007/s11136-013-0451-4

DO - 10.1007/s11136-013-0451-4

M3 - Journal article

C2 - 23877585

SN - 0962-9343

VL - 23

SP - 217

EP - 227

JO - Quality of Life Research

JF - Quality of Life Research

IS - 1

ER -