Discussion: View Thread

Dear Colleagues,

Happy new year!

I am looking for articles on scale development and validation. I got
the following articles:

Podsakoff, P.M., MacKenzie, S.B., & Podsakoff, N.P. (In Press).
Recommendations for Creating Better Concept Definitions in the
Organizational, Behavioral, and Social Sciences. Organizational
Research Methods.

Welch C., Rumyantseva M., Hewerdine L. J. (2015). Using case research
to reconstruct concepts: A methodology and illustration.
Organizational Research Methods, 19, 111–130.

Podsakoff N. P., Podsakoff P. M., MacKenzie S. B., Klinger R. L.
(2013). Are we measuring what we say we’re measuring? Using video
techniques to supplement traditional construct validation procedures.
Journal of Applied Psychology, 98, 99–113.

Judge T. A., Kammeyer-Mueller J. D. (2012). General and specific
measures in organizational behavior research: Considerations,
examples, and recommendations for researchers. Journal of
Organizational Behavior, 33, 161–174.

MacKenzie S. B., Podsakoff P. M., Podsakoff N. P. (2011). Construct
measurement and validation procedures in MIS and behavioral research:
Integrating new and existing techniques. MIS Quarterly, 35, 293–334.

Suddaby R. (2010). Construct clarity in theories of management and
organization. Academy of Management Review, 35, 346–357.


If you know any other important articles on this topic, please let me
know it, thanks.


Chaoping

Chaoping LI Ph.D 李超平
Professor of OB&HRM
Director, Center for Personnel Selection and Assessment http://pj.ruc.edu.cn

Renmin University of China http://www.ruc.edu.cn
School of Public Administration and Policy http://spap.ruc.edu.cn
Institute of Organization and Human Resources
Beijing, China, 100872
Email: lichaoping@ruc.edu.cn ;chaoping.li@gmail.com
Web Site: www.lichaoping.com www.obhrm.net

In addition to your list, I found the following three articles to be useful:

Arnold, Mark J. and Kristy E. Reynolds (2003), “Hedonic Shopping Motivations,” Journal of Retailing, 79(2), 77-95.
The authors did a great job of explaining how they constructed their scale.

Churchill, Jr., Gilbert A. (1979), “A Paradigm for Developing Better Measures of Marketing Constructs,” Journal of Marketing Research, 16(1), 64-73.
Fabulous suggested procedure outline on page 66

Clark, Lee Anna and David Watson (1995), “Constructing Validity: Basic Issues in Objective Scale Development,” Psychological Assessment, 7(3), 309-319.
Was very helpful in clarifying my understanding of the theory and concepts

All the best, Francee

On 2/4/17, 5:06 AM, "Organizational Behavior Division Listserv on behalf of Chaoping Li" <OB@AOMLISTS.AOM.ORG on behalf of chaoping.li@GMAIL.COM> wrote:

Dear Colleagues,

Happy new year!

I am looking for articles on scale development and validation. I got
the following articles:

Podsakoff, P.M., MacKenzie, S.B., & Podsakoff, N.P. (In Press).
Recommendations for Creating Better Concept Definitions in the
Organizational, Behavioral, and Social Sciences. Organizational
Research Methods.

Welch C., Rumyantseva M., Hewerdine L. J. (2015). Using case research
to reconstruct concepts: A methodology and illustration.
Organizational Research Methods, 19, 111–130.

Podsakoff N. P., Podsakoff P. M., MacKenzie S. B., Klinger R. L.
(2013). Are we measuring what we say we’re measuring? Using video
techniques to supplement traditional construct validation procedures.
Journal of Applied Psychology, 98, 99–113.

Judge T. A., Kammeyer-Mueller J. D. (2012). General and specific
measures in organizational behavior research: Considerations,
examples, and recommendations for researchers. Journal of
Organizational Behavior, 33, 161–174.

MacKenzie S. B., Podsakoff P. M., Podsakoff N. P. (2011). Construct
measurement and validation procedures in MIS and behavioral research:
Integrating new and existing techniques. MIS Quarterly, 35, 293–334.

Suddaby R. (2010). Construct clarity in theories of management and
organization. Academy of Management Review, 35, 346–357.


If you know any other important articles on this topic, please let me
know it, thanks.


Chaoping

Chaoping LI Ph.D 李超平
Professor of OB&HRM
Director, Center for Personnel Selection and Assessment http://pj.ruc.edu.cn

Renmin University of China http://www.ruc.edu.cn
School of Public Administration and Policy http://spap.ruc.edu.cn
Institute of Organization and Human Resources
Beijing, China, 100872
Email: lichaoping@ruc.edu.cn ;chaoping.li@gmail.com
Web Site: www.lichaoping.com www.obhrm.net

This issue came up on one of the lists some time ago. I did not keep the questions or respondents (apologies), but here are the references that were shared at that time:

Scale development


Church, A. H. & Waclawski, J. (1998). Designing and using organizational surveys: A seven-step process. San Francisco, CA: Jossey-Bass.

Fowler, F. J. Jr., & Cosenza, C. (2008). Writing effective questions. In E. D. de Leeuw, J. J. Hox, D.A. Dillman, (Eds.), International handbook of survey methodology, (pp. 136-160). New York, NY: Taylor & Francis Group.

The online guide that Survey Monkey provides is also surprisingly good for question writing.

On of my mentors wrote a book called "taking the measure of Work"
might be helpful which you can purchase or borrow from your entities'
library. Here is this link if you want to purchase the compilation of
validate instruments>

http://www.amazon.com/Taking-Measure-Work-Validated-Organizational/dp/1623962196


Also, there is "Research in Organizations" which has a chapter on the
methodology for developing instrument by Hinkin. You might be able to
get the article or bowwow the book or buy it for this book is a very
good reference. See purchase info following >>>>

http://www.amazon.com/Research-Organizations-Foundations-Methods-Inquiry/dp/157675314X


Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: a content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806-838.

Edwards, J. R. (2001). Multidimensional constructs in organizational behavior research: An integrative analytical framework. Organizational Research Methods, 4(2), 144-192.

Edwards, J. R. (2011). The fallacy of formative measurement. Organizational Research Methods, 14(2), 370-388.

Law, K. S., Wong, C.-S., & Mobley, W. M. (1998). Toward a taxonomy of multidimensional constructs. Academy of Management Review, 23(4), 741-755.

Diamantopoulos, A., & Siguaw, J. A. (2006). Formative versus reflective indicators in organizational measure development: A comparison and empirical illustration. British Journal of Management, 17(4), 263-282.

DeVellis, R. F. (2003). Scale development: theory and applications (2nd ed.). Thousand Oaks, CA: Sage.

DeVellis, R.F. 1991. Scale Development: Theory and Applications. Newbury Park, Sage.


Ben Hardy and I published the attached in ORM in 2014 - you may find it useful as you think through item wording.

In addition, the other paper attached is with Terri Scandura. Part of it is pending publication in a Sage book. We developed a typology of threats to construct validity that you might find useful in thinking through your items.

Hope these help.

Lucy


MacKenzie, S.B., Podsakoff, P.M., & Podsakoff, N.P. (2011). "Construct measurement and validation procedures in MIS and behavioral research." MISQ, 35(2), 293-334.
Rossiter, J.R. (2002). The C-OAR-SE procedure for scale development in marketing. International Journal of Research in Marketing, 19, 305-335.
Bagozzi, R.P., & Edwards, J.R. (1998). A general approach for representing constructs in organizational research, Organizational Research Models, 1(1), 45-87.
Weijters, B. & Baumgartner, H. (2012), Misresponse to Reversed and Negated Items in Surveys: A Review, Journal of Marketing Research, 737-747.
Weijters, B, Cabooter, E., & Schillewaert, N. (2010), The effect of rating scale format on response styles: The number of response categories and response category labels, International Journal of Research in Marketing, 27, 236-247.
Herche, J., & Engelland, B. (1996), Reversed-polarity items and scale unidimensionality, Journal of the Academy of Marketing Science, 24, 4, 366-374.
Jarvis, C./Mackenzie, S./Podsakoff, P. (2003), A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research, Journal of Consumer Research, 30, 199-218.
Diamantopoulos, A./Winklhofer, H. (2001), Index Construction with Formative Indicators: An Alternative to Scale Development, Journal of Marketing Research, 38, 2, 269-277.
Schwarz/Oyserman (2001), Asking Questions about Behavior, American Journal of Evaluation, 22, 2, 127-160.


Hinken, T. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21, 967-988.

Hinken, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104-121.

Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift's electric factor analysis machine. Understanding Statistics, 2, 13-43.

There are others, but these two provide excellent step-by-step guidelines:

Hinkin, T. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21, 967–988.

Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104–121.





Bill Hefley, Ph.D., CDP, COP
Clinical Professor
Naveen Jindal School of Management
The University of Texas at Dallas
800 West Campbell Rd., SM 33
Richardson, TX 75080-3021
Tel: 1-972-883-5006
Office: JSOM 3.420
Email: William.Hefley@utdallas.edu
Books:
http://www.amazon.com/William-E.-Hefley/e/B002D1CTD0/
http://www.vanharen.us/index.php?route=product/search&filter_name=Hefley


Faculty Advisor, Project Management Club
Member, Academic Senate
Member, Academic Council





On 2/4/17, 5:06 AM, "Organizational Behavior Division Listserv on behalf of Chaoping Li" <OB@AOMLISTS.AOM.ORG on behalf of chaoping.li@GMAIL.COM> wrote:

Dear Colleagues,

Happy new year!

I am looking for articles on scale development and validation. I got
the following articles:

Podsakoff, P.M., MacKenzie, S.B., & Podsakoff, N.P. (In Press).
Recommendations for Creating Better Concept Definitions in the
Organizational, Behavioral, and Social Sciences. Organizational
Research Methods.

Welch C., Rumyantseva M., Hewerdine L. J. (2015). Using case research
to reconstruct concepts: A methodology and illustration.
Organizational Research Methods, 19, 111–130.

Podsakoff N. P., Podsakoff P. M., MacKenzie S. B., Klinger R. L.
(2013). Are we measuring what we say we’re measuring? Using video
techniques to supplement traditional construct validation procedures.
Journal of Applied Psychology, 98, 99–113.

Judge T. A., Kammeyer-Mueller J. D. (2012). General and specific
measures in organizational behavior research: Considerations,
examples, and recommendations for researchers. Journal of
Organizational Behavior, 33, 161–174.

MacKenzie S. B., Podsakoff P. M., Podsakoff N. P. (2011). Construct
measurement and validation procedures in MIS and behavioral research:
Integrating new and existing techniques. MIS Quarterly, 35, 293–334.

Suddaby R. (2010). Construct clarity in theories of management and
organization. Academy of Management Review, 35, 346–357.


If you know any other important articles on this topic, please let me
know it, thanks.


Chaoping

Chaoping LI Ph.D 李超平
Professor of OB&HRM
Director, Center for Personnel Selection and Assessment http://pj.ruc.edu.cn

Renmin University of China http://www.ruc.edu.cn
School of Public Administration and Policy http://spap.ruc.edu.cn
Institute of Organization and Human Resources
Beijing, China, 100872
Email: lichaoping@ruc.edu.cn ;chaoping.li@gmail.com
Web Site: www.lichaoping.com www.obhrm.net