Dear Colleagues,
First, I want to apologize for any cross-postings with other listservs, discussion boards, etc. I am requesting your assistance in locating published or unpublished studies for my dissertation research. I am conducting a meta-analysis investigating the influence of sample, organization, and job analytic process characteristics on both the reliability and accuracy of job analytic information. Studies in which a job analysis has been conducted and at least one index of job analytic accuracy (i.e., interrater reliability/agreement, intrarater reliability/agreement, rate-rerate reliability, factor structure of the job analytic survey, distractor item endorsement, or mean job analytic ratings) have been reported are appropriate for this analysis. I do not need primary data, nor will I be discussing the specific results of the studies. If you have a relevant study (or studies), please send electronic copies to amyduv@gmail.com. Citations to published work are appreciated as well. More detailed information about my research is provided below. Your assistance in locating relevant studies is greatly appreciated.
Sincerely,
----
Amy DuVernet, M.S.
Doctoral Student, Industrial/Organizational Psychology
North Carolina State University
amyduv@gmail.com
Details of Request
A meta-analysis is a statistical summary of existing primary research studies. An example of a recent meta-analysis conducted by the U. S. Department of Education that investigated the effectiveness of web-based training can be found at the following web address: http://www.ed.gov/rschstat/eval/tech/evidence-based-practices/finalreport.pdf. My analysis will examine the influence of sample, organization, and job analytic process characteristics on job analytic reliability and accuracy.
I am searching for studies that present an index of either job analytic reliability or job analytic accuracy. More specifically, studies must include an estimate of one of the following indices: interrater reliability/agreement, intrarater reliability/agreement, rate-rerate reliability, factor structure of the job analytic survey, distractor item endorsement, or mean job analytic ratings (or enough information to derive these indices). For example, a relevant study might provide the mean rating obtained from a job analytic survey on the importance of various tasks to the focal job.
In addition, I need contextual information about the study and its sample so that I can code for various relevant sample, organization, and job analytic process characteristics. These characteristics include: the organization's size (number of employees), the geographic dispersion of the organization, demographic variables (sample age, gender, ethnicity/race, and tenure), type of work completed in the focal job, amount of interdependence required by the focal job (requirement for interaction with other organizational members), number of incumbents in the focal job, purpose of conducting the job analysis, type of information gathered in the analysis (worker-oriented or task oriented), method of data collection (task survey, discussion panel, etc.), source of the job analytic information (job incumbent, supervisor, etc.), length of the job analytic survey (number of items), level of specificity of the survey (task, duty, etc.), rating scale employed in the survey (importance of the task, frequency with which the task is performed, etc.), and whether or not training was provided to the job analytic raters. If your study has any of this information available (or similar information), it would be useful in addition to the reliability and/or accuracy index.
I want to avoid publication bias in my study and ensure that my analysis is conducted on a complete set of studies. Any assistance you can provide in directing me to these types of studies or providing documents is greatly appreciated.