Discussion: View Thread

  • 1.  Experience Sampling Methodology: Free or Open Source Software?

    Posted 09-09-2014 14:33
    Hi,

    I'm considering a study utilizing the Experience Sampling Methodology (sometimes referred to as Ecological Momentary Assessment or in situ sampling). The data will be closed-ended subjective self-report survey items, however if you're aware of more robust (e.g., ambulatory) software then all the better. I'm looking for software that respondents can install on either Windows-based, Android, or IOS handheld devices. I'm trying to locate available software that is either free for academic research or open source. 

    I'm happy to compile a list of all available free/open source software and re-post. Thanks in advance. - Matt

    --
    ________________________
    Matt Monnot
    Malloy Hall 411
    School of Management
    University of San Francisco
    San Francisco, CA 94117
    phone: 415-422-2524
    email: mjmonnot@usfca.edu


  • 2.  Experience Sampling Methodology: Free or Open Source Software?

    Posted 09-09-2014 15:16

    Matt,

     

    The following article describes a few options:

     

    Uy, M. A., Foo, M. D., & Aguinis, H. 2010. Using experience sampling methodology to advance entrepreneurship theory and research. Organizational Research Methods, 13: 31-54. [available at http://mypage.iu.edu/~haguinis/pubs.html]

     

    I hope this helps!

     

    All the best,

     

    --Herman.

     

    Herman Aguinis, Ph.D.

    John F. Mee Chair of Management

    Professor of Organizational Behavior and Human Resources

    Founding Director, Institute for Global Organizational Effectiveness

    Department of Management and Entrepreneurship

    http://mypage.iu.edu/~haguinis/

     

    From: Organizational Behavior Division Listserv [mailto:OB@AOMLISTS.PACE.EDU] On Behalf Of Matt Monnot
    Sent: Tuesday, September 09, 2014 2:33 PM
    To: OB@AOMLISTS.PACE.EDU
    Subject: [OB-LIST] Experience Sampling Methodology: Free or Open Source Software?

     

    Hi,

     

    I'm considering a study utilizing the Experience Sampling Methodology (sometimes referred to as Ecological Momentary Assessment or in situ sampling). The data will be closed-ended subjective self-report survey items, however if you're aware of more robust (e.g., ambulatory) software then all the better. I'm looking for software that respondents can install on either Windows-based, Android, or IOS handheld devices. I'm trying to locate available software that is either free for academic research or open source. 

     

    I'm happy to compile a list of all available free/open source software and re-post. Thanks in advance. - Matt

     

    --

    ________________________

    Matt Monnot
    Malloy Hall 411

    School of Management
    University of San Francisco
    San Francisco, CA 94117
    phone: 415-422-2524
    email: mjmonnot@usfca.edu



  • 3.  Experience Sampling Methodology: Free or Open Source Software?

    Posted 09-09-2014 18:01
    Hi Matt-

    I had a similar question about a year ago, as I was planning a similar study then. What we actually found was that hosing the survey on Qualtrics (using a mobile-friendly format for questions) and emailing out survey links twice a day with an automated service like Boomerang was the easiest (and cheapest) way to go. Obviously, most people receive emails on their smartphones, so links can easily be sent that way. And for those who don't, it is actually possible to send an email to their cell phone via an SMS (see http://www.nytimes.com/2011/11/03/technology/personaltech/how-to-send-text-messages-by-e-mail.html?_r=0). As long as you cover these two options in the training (when and how the links will be sent and how to access them) it's actually a pretty easy way to go for you and for participants. Of course, participants would need a special code (we used middle initial then six digit birthdate) to enter each time so you can link the data. In our study we collected data twice per day for 2 weeks from about 150 people, and we had very few problems with this method.

    And if you still want an app, we uncovered a few in our searching - I can't vouch for their effectiveness but they were on our list of finalists before we decided on the email method:


    Hope this helps!

    Liz


    Dr. Liz Boyd, Ph.D.
    Assistant Professor of Management
    Research Director, Women's Leadership Center
    Kennesaw State University
    1000 Chastain Blvd.
    Kennesaw, GA
    317-220-2381
    eboyd17@kennesaw.edu

    On Tue, Sep 9, 2014 at 2:33 PM, Matt Monnot <mjmonnot@usfca.edu> wrote:
    Hi,

    I'm considering a study utilizing the Experience Sampling Methodology (sometimes referred to as Ecological Momentary Assessment or in situ sampling). The data will be closed-ended subjective self-report survey items, however if you're aware of more robust (e.g., ambulatory) software then all the better. I'm looking for software that respondents can install on either Windows-based, Android, or IOS handheld devices. I'm trying to locate available software that is either free for academic research or open source. 

    I'm happy to compile a list of all available free/open source software and re-post. Thanks in advance. - Matt

    --
    ________________________
    Matt Monnot
    Malloy Hall 411
    School of Management
    University of San Francisco
    San Francisco, CA 94117
    phone: 415-422-2524
    email: mjmonnot@usfca.edu



  • 4.  Experience Sampling Methodology: Free or Open Source Software?

    Posted 09-09-2014 18:10
    Hi Matt,

    iRxReminder is just bringing to market experience sampling software for iOS and Android called . Easy to set-up with no programming required. Its $249 for a license. See ESm.iRxReminder.com. That's the beta site. You can use the Android beta for free at the moment. Take a look, and if you are interested I can arrange for a demo.

    TS

    Anthony Sterns PhD
    Adjunct Associate Professor
    330.606.6675

    On Tue, Sep 9, 2014 at 2:33 PM, Matt Monnot <mjmonnot@usfca.edu> wrote:
    Hi,

    I'm considering a study utilizing the Experience Sampling Methodology (sometimes referred to as Ecological Momentary Assessment or in situ sampling). The data will be closed-ended subjective self-report survey items, however if you're aware of more robust (e.g., ambulatory) software then all the better. I'm looking for software that respondents can install on either Windows-based, Android, or IOS handheld devices. I'm trying to locate available software that is either free for academic research or open source. 

    I'm happy to compile a list of all available free/open source software and re-post. Thanks in advance. - Matt

    --
    ________________________
    Matt Monnot
    Malloy Hall 411
    School of Management
    University of San Francisco
    San Francisco, CA 94117
    phone: 415-422-2524
    email: mjmonnot@usfca.edu



    --
    Anthony Sterns PhD
    (330) 258 9000
    (330) 606 6675 cell


  • 5.  Experience Sampling Methodology: Free or Open Source Software?

    Posted 09-09-2014 19:53

    Matt,

     

    It depends upon how much of the process that you want to automate.  iOS and Android smartphones will both have web browsers; so an inexpensive way to do this is to simple develop a webpage to collect data (e.g., use whatever you already have access to, like SurveyMonkey or Qualtrics) and then text message a link to the survey to your participants (which can be done via a web browser) at random or pre-determined intervals (which can be determined via Excel).  If you want those intervals to be determined automatically, or if you want the text messaging to be done automatically, or if you prefer to use smartphone notifications instead, etc., etc., all of these things will make a dedicated app (or at least, a management platform) more desirable.

     

    There are a couple of platforms I've heard of to do this sort of management, although I haven't used either myself, so YMMV:

    https://metricwire.com/

    http://beepme.yourexp.at/

     

    Having said all that, I recall seeing a study recently (can't find the cite though, sorry – might have been at ACM CHI or JEP:Applied?) that text messages are more likely to result in a successful survey completion than an app notification for this sort of thing.  The main issue is that various phone architectures handle app notifications quite differently – and may not even show up on some phones – but text messages are handled in a more universal manner that is less likely to confuse participants (and are simply more noticeable than notifications if you're not actively using your phone).

     

    Hope that helps!

    -Richard

     

    ---

    Richard N. Landers, Ph.D.

    Assistant Professor, Industrial/Organizational Psychology

    Old Dominion University | Mills Godwin Building 346E, Norfolk VA 23529

    Main: http://rlanders.net | Blog: http://neoacademic.com | Lab: http://tntlab.org

    Tw: @rnlanders | Ph: 757-683-4212 | Fx: 757-683-5087

     

    From: Organizational Behavior Division Listserv [mailto:OB@aomlists.pace.edu] On Behalf Of Anthony Sterns
    Sent: Tuesday, September 9, 2014 6:10 PM
    To: OB@aomlists.pace.edu
    Subject: Re: [OB-LIST] Experience Sampling Methodology: Free or Open Source Software?

     

    Hi Matt,

     

    iRxReminder is just bringing to market experience sampling software for iOS and Android called . Easy to set-up with no programming required. Its $249 for a license. See ESm.iRxReminder.com. That's the beta site. You can use the Android beta for free at the moment. Take a look, and if you are interested I can arrange for a demo.

     

    TS


    Anthony Sterns PhD

    Adjunct Associate Professor

    330.606.6675

     

    On Tue, Sep 9, 2014 at 2:33 PM, Matt Monnot <mjmonnot@usfca.edu> wrote:

    Hi,

     

    I'm considering a study utilizing the Experience Sampling Methodology (sometimes referred to as Ecological Momentary Assessment or in situ sampling). The data will be closed-ended subjective self-report survey items, however if you're aware of more robust (e.g., ambulatory) software then all the better. I'm looking for software that respondents can install on either Windows-based, Android, or IOS handheld devices. I'm trying to locate available software that is either free for academic research or open source. 

     

    I'm happy to compile a list of all available free/open source software and re-post. Thanks in advance. - Matt

     

    --

    ________________________

    Matt Monnot
    Malloy Hall 411

    School of Management
    University of San Francisco
    San Francisco, CA 94117
    phone: 415-422-2524
    email: mjmonnot@usfca.edu



     

    --
    Anthony Sterns PhD
    (330) 258 9000
    (330) 606 6675 cell



  • 6.  Experience Sampling Methodology: Free or Open Source Software?

    Posted 09-10-2014 14:43
    Hi Matt,

    We hosted a PDW at the Academy of Management on Digital ESM this summer in Philadelphia. We included a list of applications from Tamlin Conner of the University of Otago, New Zealand. That pdf file can be found here:

    Also there is a Digital ESM mailing list at Claremont Graduate University in Claremont, CA. This group is for researchers and practitioners interested in using digital technologies for experience sampling. The group currently has about 50 members. The link below takes you to a page that asks you to log into a Google account then apply for membership.


    And finally, we have been experimenting with PACO. PACO (Personal Analytics Companion) is an open source platform for conducting experience sampling surveys on smartphones. The apps can be downloaded from the Android Play store and the iTunes store. PACO was developed by Bob Evans, a software engineer at Google. Surveys (or "experiments" as they are called in Paco) are created on the web and pushed to the app. A Google (Gmail) account is needed to participate. The app is free but is in beta. 

    Thanks for compiling what is available at the moment. It will be great to see what else is happening.

    Best,
    Cindy

    --
    Cynthia L. Sherman, Ph.D.

    School of Social Science, Policy, and Evaluation
    Division of Behavioral and Organizational Sciences    
    Claremont Graduate University
    Claremont, CA 91711
    Email:  cynthia.sherman@cgu.edu





    On Sep 9, 2014, at 11:33 AM, Matt Monnot <mjmonnot@USFCA.EDU> wrote:

    Hi,

    I'm considering a study utilizing the Experience Sampling Methodology (sometimes referred to as Ecological Momentary Assessment or in situ sampling). The data will be closed-ended subjective self-report survey items, however if you're aware of more robust (e.g., ambulatory) software then all the better. I'm looking for software that respondents can install on either Windows-based, Android, or IOS handheld devices. I'm trying to locate available software that is either free for academic research or open source. 

    I'm happy to compile a list of all available free/open source software and re-post. Thanks in advance. - Matt

    --
    ________________________
    Matt Monnot
    Malloy Hall 411
    School of Management
    University of San Francisco
    San Francisco, CA 94117
    phone: 415-422-2524
    email: mjmonnot@usfca.edu