Discussion: View Thread

  • 1.  Invitation for unpublished studies on alliance diversity and firm performance

    Posted 12-15-2011 13:43

    *** Apologies for cross-postings ***

     

    Dear colleagues,

     

    We are collecting unpublished studies for our meta-analysis on alliance diversity and firm performance.  To address the file-drawer problem (Rosenthal, 1979), we would like to request for a notification of any working papers or unpublished studies that take into account the empirical effect of alliance diversity on firm performance.  We are including analyses of multiparty alliance as well as alliance portfolios in this study and are hoping to examine the many facets of alliance diversity.  Some examples of alliance diversity might include partner diversity, governance diversity, industry diversity, national diversity, and organizational diversity (Jiang, Tao, & Santoro, 2010).  Our definition of firm performance incorporates accounting measures including but not limited to ROA, ROI, EPS, debt ratios, and market-based performance measures such as the change of stock prices and Tobin's Q.

     

    We are also interested in variables that would potentially moderate the relationship between alliance diversity and firm performance, such as firm size, firm age, alliance size, financial position, and ownership level. It would be our gain if you could notify us of any study that includes these variables with regard to alliance diversity and firm performance.

    Again, we would greatly appreciate your notice if you believe that your study (or other studies that you know of), whether it be a working paper or an unpublished study, could help us in identifying the empirical effects of alliance diversity and firm performance. 

     

    Thank you in advance and sincerely,

     

    Katie Kirkpatrick

    Graduate Research Assistant

    Industrial/Organizational Psychology

    Seattle Pacific University

    Phone: 614-747-0102

    Email: kirkpatrickm@spu.edu

     

    Donghun "Don" Lee, Ph.D.
    Assistant Professor
    School of Business & Economics
    Seattle Pacific University
    3307 Third Ave. W. Suite 201
    Seattle, WA 98119

    Phone: 206-281-2555

    E-mail: donlee@spu.edu

    Homepage: http://www.spu.edu/depts/sbe/faculty/fac_lee.asp

     



  • 2.  Invitation for unpublished studies on alliance diversity and firm performance

    Posted 12-15-2011 15:56

    Katie,

     

    Fortunately, the file drawer problem is unlikely to threaten the validity of your results. For more information on this, please see the following article in press at Personnel Psychology (available online at http://mypage.iu.edu/~haguinis/pubs.html):

     

    Dalton, D. R., Aguinis, H., Dalton, C. A., Bosco, F. A., & Pierce, C. A. (in press). Revisiting the file drawer problem in meta-analysis: An empirical assessment of published and non-published correlation matrices. Personnel Psychology.

     

    Abstract

     

    The file drawer problem rests on the assumption that statistically non-significant results are less likely to be published in primary-level studies and less likely to be included in meta-analytic reviews, thereby resulting in upwardly biased meta-analytically derived effect sizes. We conducted five studies to assess the extent of the file drawer problem in non-experimental research. In Study 1, we examined 37,970 correlations included in 403 matrices published in Academy of Management Journal (AMJ), Journal of Applied Psychology (JAP), and Personnel Psychology (PPsych) between 1985 and 2009 and found that 46.81% of those correlations are not statistically significant. In Study 2, we examined 6,935 correlations used as input in 51 meta-analyses published in AMJ, JAP, PPsych, and elsewhere between 1982 and 2009 and found that 44.31% of those correlations are not statistically significant. In Study 3, we examined 13,943 correlations reported in 167 matrices in non-published manuscripts and found that 45.45% of those correlations are not statistically significant. In Study 4, we examined 20,860 correlations reported in 217 matrices in doctoral dissertations and found that 50.78% of those correlations are not statistically significant. In Study 5, we compared the average magnitude of a sample of 1,002 correlations from Study 1 (published articles) versus 1,224 from Study 4 (dissertations) and found that they were virtually identical (i.e., .2270 and .2279, respectively). In sum, our five studies provide consistent empirical evidence that the file drawer problem does not produce an inflation bias and does not pose a serious threat to the validity of meta-analytically derived conclusions as is currently believed.

     

    All the best,

     

    --Herman.

    *****************************************************

    Herman Aguinis, Ph.D.

    Dean's Research Professor and

    Professor of Organizational Behavior and Human Resources

    Director, Institute for Global Organizational Effectiveness

    Department of Management and Entrepreneurship

    Kelley School of Business, Indiana University

    http://mypage.iu.edu/~haguinis/

    ****************************************************

     

    From: Organizational Behavior Division Listserv [mailto:OB@AOMLISTS.PACE.EDU] On Behalf Of Kirkpatrick, Katie
    Sent: Thursday, December 15, 2011 1:43 PM
    To: OB@AOMLISTS.PACE.EDU
    Subject: [OB-LIST] Invitation for unpublished studies on alliance diversity and firm performance

     

    *** Apologies for cross-postings ***

     

    Dear colleagues,

     

    We are collecting unpublished studies for our meta-analysis on alliance diversity and firm performance.  To address the file-drawer problem (Rosenthal, 1979), we would like to request for a notification of any working papers or unpublished studies that take into account the empirical effect of alliance diversity on firm performance.  We are including analyses of multiparty alliance as well as alliance portfolios in this study and are hoping to examine the many facets of alliance diversity.  Some examples of alliance diversity might include partner diversity, governance diversity, industry diversity, national diversity, and organizational diversity (Jiang, Tao, & Santoro, 2010).  Our definition of firm performance incorporates accounting measures including but not limited to ROA, ROI, EPS, debt ratios, and market-based performance measures such as the change of stock prices and Tobin's Q.

     

    We are also interested in variables that would potentially moderate the relationship between alliance diversity and firm performance, such as firm size, firm age, alliance size, financial position, and ownership level. It would be our gain if you could notify us of any study that includes these variables with regard to alliance diversity and firm performance.

     

    Again, we would greatly appreciate your notice if you believe that your study (or other studies that you know of), whether it be a working paper or an unpublished study, could help us in identifying the empirical effects of alliance diversity and firm performance. 

     

    Thank you in advance and sincerely,

     

    Katie Kirkpatrick

    Graduate Research Assistant

    Industrial/Organizational Psychology

    Seattle Pacific University

    Phone: 614-747-0102

    Email: kirkpatrickm@spu.edu

     

    Donghun "Don" Lee, Ph.D.
    Assistant Professor
    School of Business & Economics
    Seattle Pacific University
    3307 Third Ave. W. Suite 201
    Seattle, WA 98119

    Phone: 206-281-2555

    E-mail: donlee@spu.edu

    Homepage: http://www.spu.edu/depts/sbe/faculty/fac_lee.asp

     



  • 3.  Invitation for unpublished studies on alliance diversity and firm performance

    Posted 12-16-2011 13:32
    Kate,

    Herman's note implies that there is a broad acceptance of the conclusions of Dalton, D. R., Aguinis, H., Dalton, C. A., Bosco, F. A., & Pierce, C. A. (in press) asserting  that publication bias is not much of a concern in the area of management.  This inference might be judged a bit pushy and a bit too hasty. Some find the Dalton et al effort somewhat overstated. As with any emerging research area, I suggest that debates concerning the reasonableness of conclusions from any journal article are best addressed in journal rebuttals, commentaries, and additional methodological work rather than in assertions in list serv correspondence.  

    The primary point of my note for this  list serv discussion is to highlight that some researchers who work in the area of publication bias with respect to meta-analyses have issues with the conclusions of the Dalton, et al. work and they often serve as reviewers of meta-analyses in management.  When such skeptics serve as reviewers of Kate's and other meta-analyses, a reliance on the Dalton et al paper for not conducting publication bias analyses will not likely satisfy them.  Until such time that there is a more substantial literature base on publication bias in the management literature, it seems unwise to place all of one's egg's in the Dalton et al. basket. I also note that publication bias analyses in meta-analysis research are encouraged (under the topic data censoring) by the current APA style manual. Thus separate from concerns with the Dalton et al article, a meta-analysis without a publication bias analysis may be judged as incompliant with the APA style manual.

    Best wishes in the holidays,

    Mike
    Michael A. McDaniel, Ph.D.
    Professor - Human Resources and
    Organizational Behavior
    Department of Management, Research Professor, Department of Psychology
    Virginia Commonwealth University
    301 West Main Street, , PO Box 844000
    Richmond, VA 23284-4000

    http://www.people.vcu.edu/~mamcdani/
    voice: 804.827.0209
    e-mail:     MAMcDani@vcu.edu
    skype: MichaelAMcDaniel

    		Doctoral Program in Management

    The Management Department of the VCU School of Business offers a Ph.D. in Business. Participating faculty with research interests in OB and HR include: Ron Humphrey, Sven Kepes, Michael McDaniel, In-Sue Oh, Doug Pugh, & Anson Seers.

    Students with interest in the doctoral program, should contact Anson Seers.






    From:        "Aguinis, Herman" <haguinis@INDIANA.EDU>
    To:        <OB@AOMLISTS.PACE.EDU>
    Date:        12/15/2011 04:53 PM
    Subject:        Re: [OB-LIST] Invitation for unpublished studies on alliance diversity and firm performance
    Sent by:        Organizational Behavior Division Listserv <OB@AOMLISTS.PACE.EDU>



    Katie,
     
    Fortunately, the file drawer problem is unlikely to threaten the validity of your results. For more information on this, please see the following article in press at Personnel Psychology (available online at http://mypage.iu.edu/~haguinis/pubs.html):
     
    Dalton, D. R., Aguinis, H., Dalton, C. A., Bosco, F. A., & Pierce, C. A. (in press). Revisiting the file drawer problem in meta-analysis: An empirical assessment of published and non-published correlation matrices. Personnel Psychology.
     
    Abstract
     
    The file drawer problem rests on the assumption that statistically non-significant results are less likely to be published in primary-level studies and less likely to be included in meta-analytic reviews, thereby resulting in upwardly biased meta-analytically derived effect sizes. We conducted five studies to assess the extent of the file drawer problem in non-experimental research. In Study 1, we examined 37,970 correlations included in 403 matrices published in Academy of Management Journal (AMJ), Journal of Applied Psychology (JAP), and Personnel Psychology (PPsych) between 1985 and 2009 and found that 46.81% of those correlations are not statistically significant. In Study 2, we examined 6,935 correlations used as input in 51 meta-analyses published in AMJ, JAP, PPsych, and elsewhere between 1982 and 2009 and found that 44.31% of those correlations are not statistically significant. In Study 3, we examined 13,943 correlations reported in 167 matrices in non-published manuscripts and found that 45.45% of those correlations are not statistically significant. In Study 4, we examined 20,860 correlations reported in 217 matrices in doctoral dissertations and found that 50.78% of those correlations are not statistically significant. In Study 5, we compared the average magnitude of a sample of 1,002 correlations from Study 1 (published articles) versus 1,224 from Study 4 (dissertations) and found that they were virtually identical (i.e., .2270 and .2279, respectively). In sum, our five studies provide consistent empirical evidence that the file drawer problem does not produce an inflation bias and does not pose a serious threat to the validity of meta-analytically derived conclusions as is currently believed.
     
    All the best,
     
    --Herman.
    *****************************************************
    Herman Aguinis, Ph.D.
    Dean's Research Professor and
    Professor of Organizational Behavior and Human Resources
    Director, Institute for Global Organizational Effectiveness
    Department of Management and Entrepreneurship
    Kelley School of Business, Indiana University
    http://mypage.iu.edu/~haguinis/
    ****************************************************
     
    From: Organizational Behavior Division Listserv [mailto:OB@AOMLISTS.PACE.EDU] On Behalf Of Kirkpatrick, Katie
    Sent:     Thursday, December 15, 2011 1:43 PM
    To:     OB@AOMLISTS.PACE.EDU
    Subject:     [OB-LIST] Invitation for unpublished studies on alliance diversity and firm performance
     
    *** Apologies for cross-postings ***
     
    Dear colleagues,
     
    We are collecting unpublished studies for our meta-analysis on alliance diversity and firm performance.  To address the file-drawer problem (Rosenthal, 1979), we would like to request for a notification of any working papers or unpublished studies that take into account the empirical effect of alliance diversity on firm performance.  We are including analyses of multiparty alliance as well as alliance portfolios in this study and are hoping to examine the many facets of alliance diversity.  Some examples of alliance diversity might include partner diversity, governance diversity, industry diversity, national diversity, and organizational diversity (Jiang, Tao, & Santoro, 2010).  Our definition of firm performance incorporates accounting measures including but not limited to ROA, ROI, EPS, debt ratios, and market-based performance measures such as the change of stock prices and Tobin's Q.
     
    We are also interested in variables that would potentially moderate the relationship between alliance diversity and firm performance, such as firm size, firm age, alliance size, financial position, and ownership level. It would be our gain if you could notify us of any study that includes these variables with regard to alliance diversity and firm performance.
     
    Again, we would greatly appreciate your notice if you believe that your study (or other studies that you know of), whether it be a working paper or an unpublished study, could help us in identifying the empirical effects of alliance diversity and firm performance.  
     
    Thank you in advance and sincerely,
     
    Katie Kirkpatrick
    Graduate Research Assistant
    Industrial/Organizational Psychology
    Seattle Pacific University
    Phone: 614-747-0102
    Email: kirkpatrickm@spu.edu
     
    Donghun "Don" Lee, Ph.D.
    Assistant Professor
    School of Business & Economics
    Seattle Pacific University
    3307 Third Ave. W. Suite 201
    Seattle, WA 98119
    Phone: 206-281-2555
    E-mail: donlee@spu.edu
    Homepage: http://www.spu.edu/depts/sbe/faculty/fac_lee.asp