The behaviour of the mobile generation is changing and market research methodologies need to keep up. Survey chunking on mobile is our answer to the need for more in-depth studies on mobile.
Survey chunking - the process of dividing a survey into shorter sections which respondent can answer in one go or in several phases.
We believe that the age of 30-minute surveys is over. However, the need for more in-depth approach for certain projects remains. Our experience with over 10 million mobile surveys shows that drop-off rates start to increase after the 15th question. We were sure there was a way around that limitation.
Same person answers both chunks
This lead us to research and validate a hypothesis that survey chunking on mobile will not just give researchers enough data for their research but in fact improves the data quality of the answers.
We conducted a pilot research project in the UK to test the hypothesis that survey chunking is the answer for doing longer research on mobile. The experiment proved what we instinctively knew after having run over 10 million surveys in 57 countries - taking surveys in shorter "bursts" improves data quality.
Source: UK data from On Device Research study, August 2013; n=2324
Survey fatigue is a well-known problem with long surveys - respondents start to lose attention. They skim question and answer texts, select random answers and generally try to get to the end of the survey as fast as possible.
Chunking is an excellent solution to this problem in mobile surveys. Chunked surveys clearly outperform straight long surveys - far fewer people fall for the trap questions and the location of the questions in the surveys stops affecting data quality.
Consumers have changed and the mobile generation do things at their convenience. Research methodologies need to change with them while allowing researchers to collect enough data. - Alistair Hill, CEO of On Device Research