Keywords
Escala Distorsión
deseabilidad social
Cuestionario Big Five
Teoría de Respuesta al Ítem
Partial Credit Model
Lie Scale
Social Desirability
Big Five Questionnaire
Item Response Theory
How to Cite
Abstract
The Partial Credit Model (PCM) of the Item Response Theory was applied to the Spanish Lie Scale adaptation of the Big Five Questionnaire. The scale measures individuals’ tendency to provide a distorted profile. The sample comprised 1592 adults from the general population (55% females). All analyses were performed by means of Winsteps software. The PCM exhibited satisfactory goodness-of-fit for all items. However, a considerable proportion of respondents had incongruent response patterns which were not in agreement with the model’s expectations. Five items presented inversions in the order expected for the estimated values of threshold parameters. These findings show the scale weaknesses and yield useful information to guide possible changes in future research.
References
Abad, F., Olea, J., Ponsoda, V., & García, C. (2011). Medición en ciencias sociales y de la salud. Madrid: Síntesis.
Abal, F., Galibert, M., Aguerri, M., & Attorresi, H. (2014). Comparación de los Modelos Respuesta Graduada y Crédito Parcial aplicados a una escala de Utilidad de la Matemática. Revista Argentina de Ciencias del Comportamiento, 6(3), 6-16.
Abal, F., Lozzia, G. Aguerri, M., Galibert, M., & Attorresi, H. (2010). La escasa aplicación de la Teoría de Respuesta al Ítem en tests de ejecución típica. Revista Colombiana de Psicología, 19(1) 111-122.
Adams, R. J., Wu, M. L., & Wilson, M. (2012). The Rasch rating model and the disordered threshold controversy. Educational and Psychological Measurement, 72(4), 547–573. doi: 10.1177/0013164411432166
Andrich, D. (2010). Understanding the response structure and process in the polytomous Rasch model. In M. Nering & R. Ostini (Eds.), Handbook of polytomous item response theory models: Developments and applications (pp. 123-152). Mahwah, NJ: Erlbaum.
Andrich, D. (2013). An Expanded Derivation of the Threshold Structure of the Polytomous Rasch Model That Dispels Any “Threshold Disorder Controversy”. Educational and Psychological Measurement, 73(1), 78–124. doi: 10.1177/0013164412450877
Asgeirsdottir, R. L., Vésteinsdóttir, V. &, Thorsdottir, F. (2016). Short form development of the Balanced Inventory of Desirable Responding: Applying confirmatory factor analysis, item response theory, and cognitive interviews to scale reduction Personality and Individual Differences, 96, 212–221. doi: 10.1016/j.paid.2016.02.083
Ato, M., López, J. J., & Benavente, A. (2013). Un sistema de clasificación de los diseños de investigación en psicología. Anales de Psicología, 29(3), 1038 - 1059. doi: 10.6018/analesps.29.3.178511
Barbaranelli, C., & Caprara, G. V. (2002). Studies of the big five questionnaire. In B. de Raad & M. Perugini (Eds). Big five assessment (pp. 109-124). Ashland, OH, US: Hogrefe & Huber Publishers.
Bermúdez, J. (1995). Manual del Cuestionario “Big Five” (BFQ). Madrid: TEA.
Brown, T. (2015). Confirmatory factor analysis for applied research (2nd Ed.). New York: Guilford Press.
Burns, G. N., & Christiansen, N. D. (2006). Sensitive or senseless: On the use of social desirability measures in selection and assessment. In R. L. Griffith, & M. H. Peterson (Eds.), A closer examination of applicant faking behavior (pp. 113-148). Greenwich, CT: Information Age Publishing.
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basics, concepts, applications, and programming. New York: Routledge.
Caprara, G. V., Barbaranelli, C., Bermúdez, J., Maslach, C., & Ruch, W. (2000). Multivariate methods for the comparison of factor structures in cross-cultural research. An illustration with the Big Five Questionnaire. Journal of Cross-cultural Psychology, 31(4) 437-464. doi: 10.1177/0022022100031004002
Caprara, G. V., Barbaranelli, C., & Borgogni, L. (1993). Big Five Questionnaire (BFQ). Manuale. Florencia: Organizzazioni Speciali.
Caprara, G. V., Barbaranelli, C., & Borgogni, L. (1996). Big Five Questionnaire (BFQ): Caratteristiche psicometriche e validità transculturale. Archivio di Psicologia, Neurologia e Psichiatria, 57, 486-504.
Carretero-Dios, H., & Pérez, C. (2007). Standards for the development and review of instrumental studies: Considerations about test selection in psychological research. International Journal of Clinical and Health Psychology, 7(3), 863-882.
Crowne, D. P. & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349-354. doi: 10.1037/h0047358
Curtis, D. D. (2004). Person Misfit in Attitude Surveys: Influences, Impacts and Implications. International Education Journal, 5(2), 125-144.
DiStefano, C., Morgan, G. B., & Motl, R. W. (2012). An examination of personality characteristics related to acquiescence. Journal of applied measurement, 13(1), 41-56.
Dodd, B. G., & Koch, W. R. (1987). Effects of Variations in Item Step Values on Item and Test Information in the Partial Credit Model. Applied Psychological Measurement, 11(4), 371-384. doi: 10.1177/014662168701100403
Embretson, S., & Reise, S. (2000). Item Response Theory for Psychologists. Mahwah, NJ: Erlbaum Publishers.
Ferrando, P., & Chico, E. (2000). Adaptación y análisis psicométrico de la escala de deseabilidad social de Marlowe y Crowne. Psicothema, 12(3), 383-389.
García-Pérez, M. A. (2017). An Analysis of (Dis)Ordered Categories, Thresholds, and Crossings in Difference and Divide-by-Total IRT Models for Ordered Responses. The Spanish Journal of Psychology, 20(10), 1–27. doi: 10.1017/sjp.2017.11
Karabatsos, G. (2000). A critique of Rasch residual fit statistics. Journal of Applied Measurement, 1(2), 152-176.
Kline, R. B. (2011). Principles and practice of structural equation modelling (3rd. Ed.). New York: Guilford Press.
Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328.
Linacre, J. M. (2006). Winsteps® (Version 3.63.0) [Computer Software]. Beaverton, Oregon: Winsteps.com.
Linacre, J. M. (2012). Winsteps® Rasch measurement computer program User’s Guide. Beaverton, Oregon: Winsteps.com.
Lord, F. M. (1952). A theory of test scores. Psychometric Monograph Nº7. Iowa City, IA: Psychometric Society.
Martínez Arias, M. R. (1995). Psicometría: Teoría de los Tests Psicológicos y Educativos. Madrid: Síntesis.
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149 - 174. doi: 10.1007/BF02296272
Masters, G. N. (2016). Partial Credit Model. En W. J. van der Linden (Ed.). Handbook of Item Response Theory, Volume 1: Models (pp. 109-126). Boca Raton: Chapman & Hall/CRC.
Masters, G. N., & Wright, B. D. (1997). The Partial Credit Model. En W. J. Van der Linden y R. K. Hambleton (Eds.). Handbook of Modern Item Response Theory, (pp. 101-121). New York: Springer.
Morizot, J., Ainsworth, A. T., & Reise, S. P. (2007). Toward Modern Psychometrics. Application of Item Response Theory Models in Personality Research. In R. W. Robins, R. C. Fraley & R. F. Krueger (Eds.), Handbook of Research Methods in Personality Psychology, (pp. 407 - 423). New York: Guilford Press.
Muthén, L., & Muthén, B. (2010). Mplus User’s Guide, 6th Edn. Los Angeles, CA: Muthén & Muthén.
Panter, A. T., Swygert, K. A., & Dahlstrom, G. W. (1997). Factor analytic approaches to personality item-level data. Journal of Personality Assessment, 68, 561-589. doi: 10.1207/s15327752jpa6803_6
Paulhus, D. L. (1988). Manual for the Balanced Inventory of Desirable Responding (BIDR-6). Manuscrito inédito, Universidad de Columbia Británica.
Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. Copenhague: The Danish Institute for Educational Research.
Reise, S. P., & Revicki, D. (2015). Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment. New York: Routledge.
Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48. doi: 10.1146/annurev.clinpsy.032408.153553
Rojas, A. J., & Pérez, C. (2001) Nuevos Modelos para la Medición de Actitudes. Valencia: Promolibro.
Seol, H. (2007). A psychometric investigation of the Marlowe-Crowne social desirability scale using Rasch measurement. Measurement and Evaluation in Counseling and Development, 40, 155-168.
Thomas, M. L. (2011). The value of item response theory in clinical assessment: a review. Assessment, 18(3), 291-307. doi: 10.1177/1073191110374797
Vendramini, C., Silva, M., & Dias, A. (2009). Avaliação de atitudes de estudantes de psicologia via modelo de crédito parcial da TRI. Psico-USF, 14(3), 287-298. doi: 10.1590/S1413-82712009000300005
Vésteinsdóttir, V., Reips, U., Joinson, A., & Thorsdottir, F. (2017). An item level evaluation of the Marlowe-Crowne Social Desirability Scale using item response theory on Icelandic Internet panel data and cognitive interviews. Personality and Individual Differences, 107, 164–173. doi: 10.1016/j.paid.2016.11.023
Vispoel, W. P., & Kim, H. Y. (2014). Psychometric properties for the Balanced Inventory of Desirable Responding: Dichotomous versus polytomous conventional and IRT scoring. Psychological Assessment, 26(3), 878-891. doi: http://dx.doi.org/10.1037/a0036430
Wetzel, E., & Carstensen, C. H. (2014). Reversed Thresholds in Partial Credit Models. A Reason for Collapsing Categories? Assessment, 21(6), 765-774. doi: 10.1177/1073191114530775
Wrigth, B. D. & Stone, M. H. (1979). Best test design: Rasch measurement. Chicago: Mesa Press.