Sawtooth Software Conference 2019 | San Diego, CA, USA | September 23–27
Early-bird pricing ends August 15!

Enable test mode on live surveys

A Better Testing Experience for Remote Stakeholders and Clients Who Don’t Have Lighthouse on Their Computer

We all know and love the Test Survey interface: toggling back and forth between mobile/desktop views, the question drop-down menu that allows you to skip to questions and navigate your survey more efficiently for testing, etc.

Image of Lighthouse Studio interface #1

The Drawback

Test mode only works locally from your machine where Lighthouse Studio is running. This means that clients and colleagues (that don’t have Lighthouse Studio on their computer) can only test your survey by taking it online via an access link and don’t have access to the test mode views or functionality.

This can be particularly tiresome when someone is testing elements of a survey located towards the end of an especially long study.

The Hack

Use this trick to enable Test Mode for people testing your survey online for easier navigation from section to section and the ability to toggle between mobile and desktop views.


  1. First launch Test Survey locally on your computer. Your survey will open on your default browser. (This version of your survey is hosted on your personal computer and is only accessible to you.)
    Image of Lighthouse Studio interface #2
  2. Once inside the test survey, highlight and copy (1) the ampersand, (2) the variable hid_test_mode, and (3) the variable value. It will look something like this: &hid_test_mode=D93FVW1U538ZY7PWVTJVU71QBQSKC4

    (The value of the hid_test_mode variable, the long alphanumeric string, is a code unique to your survey. It is a security feature that makes it much harder for a respondent familiar with Sawtooth Software surveys to turn on test-mode while taking your survey.)

    Image of Lighthouse Studio interface #3
     
  3. Next go to the “Get Links” menu in your Hosting Management (your survey should already be uploaded to the server and available online) and copy your one-click link.
    Image of Lighthouse Studio interface #4

  4. Now add on the ‘&hid_test_mode=######’ that you pulled from the local link (the version of your survey only accessible from your computer) to the end of the URL of your live survey. i.e.
    https://SampleStudyMaxDiff.sawtoothsoftware.com/cgi-bin/ciwweb.pl?studyname=mxd&examplePASSIN=VALUE
    +
    &hid_test_mode=D93FVW1U538ZY7PWVTJVU71QBQSKC4
    =
    https://samplestudymaxdiff.sawtoothsoftware.com/cgi-bin/ciwweb.pl?studyname=mxd&examplePASSIN=VALUE&hid_test_mode=D93FVW1U538ZY87PWVTJVU71Q4BQSKC4&hid_pagenum=1&hid_link=1&hid_javascript=1&hid_screenwidth=1500

  5. Now you have a link to an online version of your survey that is enabled with test mode and you can share this with anyone else that needs it for more efficient testing of your survey.
    Image of Lighthouse Studio interface #6
If you’d like to see this “hack” become a regular feature in Lighthouse Studio, let us know about it! We love to get feedback from our users: https://feedback.sawtoothsoftware.com.

 

How MaxDiff Is a Better Measurement Technique than Rating Scales

At the April 2019 Quirk’s Event in Chicago, David Hengehold (P&G) and Megan Peitz (Numerious) showed how MaxDiff (best-worst scaling) often is a better survey measurement technique vs. ratings scales. David shared how P&G uses MaxDiff with great results. In Chicago, David & Megan showed an interactive MaxDiff survey demo for Ice Cream preferences, very similar to this:

Read More

Can Default Main Effects Conjoint Models Do Well with Brand/Price Curves?

One of the celebrated capabilities of CBC (Choice-Based Conjoint) is the ability to model different price curves for different brands/SKUs. People often think this necessarily involves adding interaction effects to the utility models, or by creating nested alternative-price attributes within each brand/SKU.  But, that’s not always the case…

Read More

Quick and Easy Power Analysis for Choice Experiments

Four clients have asked about this topic in the past month, so perhaps it's worth a post. It turns out that there is a quick way to use Lighthouse Studio to do power analysis for choice-based conjoint experiments.

Say for example that a client wants a choice-based conjoint experiment with four 3-level and one 2-level attributes. The client plans to show each respondent 10 tasks each with two alternatives and a none and wants to know what sizes of significant coefficients (utilities) the design will be able to detect (at a given level of confidence and power). To answer the client’s questions, follow these four steps:

Read More

Call for Papers and Presentations: Sawtooth Software Conference 2019

The 2019 Sawtooth Software Conference will be held September 25-27, 2019 in San Diego, California at the Hilton San Diego Resort & Spa. It is held only once every 18 months and 175 to 250 people are expected. 

We're looking to increase diversity in the program in terms of demographics, industries, and new perspectives.  Even if you’ve never presented at a conference before, we welcome your proposal!  If you know of great speakers in underrepresented groups, please let us know and we'll reach out to invite them to submit.

Read More