Discussion: View Thread

  • 1.  Low alpha scores of Big 5 TIPI scale

    Posted 03-23-2010 08:33
    Dear all,

    we used the Gosling et al. (2003) 10-item personality inventory (TIPI) and obtained low Cronbach's alpha scores. Sam Gosling provides an explanation on his website indicating that alphas are misleading when calculated on scales with small numbers of items. I was wondering if someone could provide me with or point me to some more arguments for reviewers apart from the explanation given by Sam, in the ideal case something that has been published. I see once in a while that authors do not report alphas if they use two-item scales. What is the theoretical argument of not reporting alphas, if scales consist of only two items?

    Many thanks in advance,
    Stefan
    --  Dr. Stefan Volk  Tᅵbingen University  Department of International Business Melanchthonstr. 30 72074 Tᅵbingen Germany  Phone +49 707 129 74046  


  • 2.  Low alpha scores of Big 5 TIPI scale

    Posted 03-23-2010 19:58

    Dear Stefan,

    You may find this article helpful for answering your question.

     

    Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350–353.

     

    This chapter is also relevant.

     

    John, O. P., & Benet-Martinez, V. (2000). Measurement: Reliability, construct validation, and scale construction. In H. T. Reis & C. M. Judd (Eds.), Handbook of Research Methods in Social and Personality Psychology (pp. 339-369). Cambridge, UK: Cambridge University Press.

    Best,

    Taya

     

    -------------------------------------------------------------------------------------------------------------------------------------------

    Taya R. Cohen, Ph.D.

    Visiting Assistant Professor & Postdoctoral Fellow 

    Kellogg School of Management | Northwestern University

    Email: t-cohen@kellogg.northwestern.edu

    Web: http://www.kellogg.northwestern.edu/Faculty/Directory/Cohen_Taya.aspx 

    -------------------------------------------------------------------------------------------------------------------------------------------

     

     

     

    From: Organizational Behavior Division Listserv [mailto:OB@AOMLISTS.PACE.EDU] On Behalf Of Stefan Volk
    Sent: Tuesday, March 23, 2010 7:33 AM
    To: OB@AOMLISTS.PACE.EDU
    Subject: [OB-LIST] Low alpha scores of Big 5 TIPI scale

     

    Dear all,

    we used the Gosling et al. (2003) 10-item personality inventory (TIPI) and obtained low Cronbach's alpha scores. Sam Gosling provides an explanation on his website indicating that alphas are misleading when calculated on scales with small numbers of items. I was wondering if someone could provide me with or point me to some more arguments for reviewers apart from the explanation given by Sam, in the ideal case something that has been published. I see once in a while that authors do not report alphas if they use two-item scales. What is the theoretical argument of not reporting alphas, if scales consist of only two items?

    Many thanks in advance,
    Stefan

    -- 
    Dr. Stefan Volk
     
    Tübingen University 
    Department of International Business
    Melanchthonstr. 30
    72074 Tübingen
    Germany
     
    Phone +49 707 129 74046
     


  • 3.  Low alpha scores of Big 5 TIPI scale

    Posted 03-23-2010 20:01
    Hi Stefan,

    An excellent discussion on the topic i recommend reading is:

    Cortina, J. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104.

    All the best,

    Vias


    On Tue, Mar 23, 2010 at 8:33 AM, Stefan Volk <stefan.volk@uni-tuebingen.de> wrote:
    Dear all,

    we used the Gosling et al. (2003) 10-item personality inventory (TIPI) and obtained low Cronbach's alpha scores. Sam Gosling provides an explanation on his website indicating that alphas are misleading when calculated on scales with small numbers of items. I was wondering if someone could provide me with or point me to some more arguments for reviewers apart from the explanation given by Sam, in the ideal case something that has been published. I see once in a while that authors do not report alphas if they use two-item scales. What is the theoretical argument of not reporting alphas, if scales consist of only two items?

    Many thanks in advance,
    Stefan
    --  Dr. Stefan Volk  Tübingen University  Department of International Business Melanchthonstr. 30 72074 Tübingen Germany  Phone +49 707 129 74046  



    --
    Vias C. Nicolaides
    Doctoral Student
    Industrial/Organizational Psychology
    George Mason University


  • 4.  Low alpha scores of Big 5 TIPI scale

    Posted 03-23-2010 20:59
    Stefan,

    My colleagues and I recently published an article in PAID evaluating the TIPI relative to a 50-item measure from the International Personality Item Pool (IPIP).  The results on the whole were actually more positive than we had expected, although the alphas were generally low.  We didn't have the space to explore the issue in much depth, but we did briefly touch on it at the end of the the Discussion section.  Here's the citation:

    Ehrhart, M. G., Ehrhart, K. H., Roesch, S. C., Chung-Herrera, B. G., Nadler, K., & Bradshaw, K. (2009).  Testing the latent factor structure and construct validity of the Ten-Item Personality Inventory.  Personality and Individual Differences, 47, 900-905.

    Regards,

    Mark


    On Tue, Mar 23, 2010 at 5:33 AM, Stefan Volk <stefan.volk@uni-tuebingen.de> wrote:
    Dear all,

    we used the Gosling et al. (2003) 10-item personality inventory (TIPI) and obtained low Cronbach's alpha scores. Sam Gosling provides an explanation on his website indicating that alphas are misleading when calculated on scales with small numbers of items. I was wondering if someone could provide me with or point me to some more arguments for reviewers apart from the explanation given by Sam, in the ideal case something that has been published. I see once in a while that authors do not report alphas if they use two-item scales. What is the theoretical argument of not reporting alphas, if scales consist of only two items?

    Many thanks in advance,
    Stefan
    --  Dr. Stefan Volk  Tübingen University  Department of International Business Melanchthonstr. 30 72074 Tübingen Germany  Phone +49 707 129 74046  



    --
    Mark Ehrhart, Ph.D.
    Associate Professor
    Department of Psychology
    San Diego State University
    5500 Campanile Drive
    San Diego, CA  92182-4611
    619-594-4439 (phone)
    619-594-1332 (fax)
    mehrhart@sunstroke.sdsu.edu


  • 5.  Low alpha scores of Big 5 TIPI scale

    Posted 03-24-2010 00:57
    Dear Stefan,

    You may also consider using your data as representing the Big One. In this
    way, you may avoid the problem of low alpha´s.

    We recently did a meta-analysis (Van der Linden, Te Nijenhuis &
    Bakker)showing that the overall score combining the Big Five factors is
    substantive.

    Best wishes,
    Arnold

    > Dear all,
    >
    > we used the Gosling et al. (2003) 10-item personality inventory (TIPI)
    > and obtained low Cronbach's alpha scores. Sam Gosling provides an
    > explanation on his website indicating that alphas are misleading when
    > calculated on scales with small numbers of items. I was wondering if
    > someone could provide me with or point me to some more arguments for
    > reviewers apart from the explanation given by Sam, in the ideal case
    > something that has been published. I see once in a while that authors do
    > not report alphas if they use two-item scales. What is the theoretical
    > argument of not reporting alphas, if scales consist of only two items?
    >
    > Many thanks in advance,
    > Stefan
    >
    > --
    > Dr. Stefan Volk
    >
    > Tübingen University
    > Department of International Business
    > Melanchthonstr. 30
    > 72074 Tübingen
    > Germany
    >
    > Phone +49 707 129 74046
    >
    >
    >


    --------------------------------Disclaimer--------------------------------
    De informatie verzonden in dit e-mail bericht inclusief de bijlage(n) is
    vertrouwelijk en is uitsluitend bestemd voor de geadresseerde van dit
    bericht. Lees verder: http://www.eur.nl/email-disclaimer

    The information in this e-mail message is confidential and may be legally
    privileged. Read more: http://www.eur.nl/english/email-disclaimer


  • 6.  Low alpha scores of Big 5 TIPI scale

    Posted 03-24-2010 02:46
    Stefan,
     
    Coefficients alpha are overestimates of reliability and is not an ideal type of reliability because it can control for only two sources of measurement error: random error and item-specific error. It cannot control for transient error and scale-specific error. Please refer to the below recent papers on this issue.
     
    Le, H., Schmidt, F. L., & Putka, D. J. (2009). The multifaceted nature of measurement artifacts and its implications for estimating construct-level relationships. Organizational Research Methods, 12, 165-200.
     
    Schmidt, F. L., Le, H., & Ilies, R. (2003). Beyond Alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206-224.
     
    One caveat pertaining to use of short measures is that it may decrease validity given that the reliability of a measure sets the upper limit of its validity. That is, a longer, original test is more reliable than its short versions (Nunnally & Bernstein, 1994); if some short version shows high reliability close to that of its original test, it is may be due to capitalization on chance in the developmental sample. That is, coefficients alpha are also subject to sampling error. 
     
    Best,
    In-Sue
     


     
    On Tue, Mar 23, 2010 at 6:58 PM, Mark Ehrhart <mehrhart@sunstroke.sdsu.edu> wrote:
    Stefan,

    My colleagues and I recently published an article in PAID evaluating the TIPI relative to a 50-item measure from the International Personality Item Pool (IPIP).  The results on the whole were actually more positive than we had expected, although the alphas were generally low.  We didn't have the space to explore the issue in much depth, but we did briefly touch on it at the end of the the Discussion section.  Here's the citation:

    Ehrhart, M. G., Ehrhart, K. H., Roesch, S. C., Chung-Herrera, B. G., Nadler, K., & Bradshaw, K. (2009).  Testing the latent factor structure and construct validity of the Ten-Item Personality Inventory.  Personality and Individual Differences, 47, 900-905.

    Regards,

    Mark


    On Tue, Mar 23, 2010 at 5:33 AM, Stefan Volk <stefan.volk@uni-tuebingen.de> wrote:
    Dear all,

    we used the Gosling et al. (2003) 10-item personality inventory (TIPI) and obtained low Cronbach's alpha scores. Sam Gosling provides an explanation on his website indicating that alphas are misleading when calculated on scales with small numbers of items. I was wondering if someone could provide me with or point me to some more arguments for reviewers apart from the explanation given by Sam, in the ideal case something that has been published. I see once in a while that authors do not report alphas if they use two-item scales. What is the theoretical argument of not reporting alphas, if scales consist of only two items?

    Many thanks in advance,
    Stefan
      --  Dr. Stefan Volk  Tübingen University  Department of International Business Melanchthonstr. 30 72074 Tübingen Germany  Phone +49 707 129 74046  



    --
    Mark Ehrhart, Ph.D.
    Associate Professor
    Department of Psychology
    San Diego State University
    5500 Campanile Drive
    San Diego, CA  92182-4611
    619-594-4439 (phone)
    619-594-1332 (fax)
    mehrhart@sunstroke.sdsu.edu



    --
    In-Sue Oh, PhD
    Assistant Professor
    Strategic Management and Organization
    University of Alberta School of Business
    2-32C Business Building
    Edmonton, AB, Canada T6G 2R6
    TEL: 780-492-8523
    Email: insue@ualberta.ca


  • 7.  Low alpha scores of Big 5 TIPI scale

    Posted 03-24-2010 21:21
    See: Hulin, C., Cudeck, R., Netemeyer, R., Dillon, W., McDonald, R., & Bearden, W. (2001). Measurement. Journal of Consumer Psychology (Lawrence Erlbaum Associates), 10(1/2), 55-69. Retrieved from Psychology and Behavioral Sciences Collection database.

    Hope for the USA? "If something is unsustainable, it will stop."--Herb Stein, an economic adviser to Richard Nixon
    Romie F. Littrell, BA, MBA,PhD, FIAIR, An fánaí fiáin
    AUT Business School N.Z., romie.littrell@aut.ac.nz
    http://www.romielittrellpubs.homestead.com/
    Facilitator, Leadership & Management in Sub-Sahara Africa Conferences
    Contents copyright Romie F. Littrell

    --- On Wed, 24/3/10, Stefan Volk <stefan.volk@UNI-TUEBINGEN.DE> wrote:

    From: Stefan Volk <stefan.volk@UNI-TUEBINGEN.DE>
    Subject: [OB-LIST] Low alpha scores of Big 5 TIPI scale
    To: OB@AOMLISTS.PACE.EDU
    Date: Wednesday, 24 March, 2010, 1:33

    Dear all,

    we used the Gosling et al. (2003) 10-item personality inventory (TIPI) and obtained low Cronbach's alpha scores. Sam Gosling provides an explanation on his website indicating that alphas are misleading when calculated on scales with small numbers of items. I was wondering if someone could provide me with or point me to some more arguments for reviewers apart from the explanation given by Sam, in the ideal case something that has been published. I see once in a while that authors do not report alphas if they use two-item scales. What is the theoretical argument of not reporting alphas, if scales consist of only two items?

    Many thanks in advance,
    Stefan
    --
    Dr. Stefan Volk

    Tübingen University
    Department of International Business
    Melanchthonstr. 30
    72074 Tübingen
    Germany

    Phone +49 707 129 74046