Prediction consistency: A test of the equivalence assumption across different indicators of the same construct

TY - JOUR

T1 - Prediction consistency

T2 - A test of the equivalence assumption across different indicators of the same construct

AU - Hilbig, Benjamin E.

AU - Moshagen, Morten

AU - Zettler, Ingo

PY - 2016/11/1

Y1 - 2016/11/1

N2 - Prominent theoretical constructs such as the Big Five personality factors often inspire the development and use of different inventories. This practice rests on the vital assumption that different indicators equivalently assess the same construct—otherwise, it would often be inappropriate to draw conclusions on the construct level. In comparison to the evidence typically relied on to support this equivalence assumption, we argue that a direct test of prediction consistency will provide further insights: prediction consistency is a necessary condition for the equivalence assumption that indicators from different inventories predict an external criterion to the same extent. Here, we outline guidelines how to design studies to establish prediction consistency and illustrate this approach in an experiment testing the prediction consistency of the Agreeableness indicators from three prominent Big Five inventories. Specifically, we considered prediction consistency with respect to honesty (vs. cheating) as the behavioral criterion for which a specific a priori hypothesis can be derived on theoretical grounds. Results contradicted predictions consistency and thus the equivalence assumption by showing qualitatively different relations to behavioral honesty, thereby also emphasizing that the interchangeability of inventories should generally be subjected to a strict test, rather than assumed.

AB - Prominent theoretical constructs such as the Big Five personality factors often inspire the development and use of different inventories. This practice rests on the vital assumption that different indicators equivalently assess the same construct—otherwise, it would often be inappropriate to draw conclusions on the construct level. In comparison to the evidence typically relied on to support this equivalence assumption, we argue that a direct test of prediction consistency will provide further insights: prediction consistency is a necessary condition for the equivalence assumption that indicators from different inventories predict an external criterion to the same extent. Here, we outline guidelines how to design studies to establish prediction consistency and illustrate this approach in an experiment testing the prediction consistency of the Agreeableness indicators from three prominent Big Five inventories. Specifically, we considered prediction consistency with respect to honesty (vs. cheating) as the behavioral criterion for which a specific a priori hypothesis can be derived on theoretical grounds. Results contradicted predictions consistency and thus the equivalence assumption by showing qualitatively different relations to behavioral honesty, thereby also emphasizing that the interchangeability of inventories should generally be subjected to a strict test, rather than assumed.

U2 - 10.1002/per.2085

DO - 10.1002/per.2085

M3 - Journal article

SN - 0890-2070

VL - 30

SP - 637

EP - 647

JO - European Journal of Personality

JF - European Journal of Personality

IS - 6

ER -