The quality of website design is a main factor that affects user experience and satisfaction with an e-commerce site. This has been confirmed by many existing literature. However, most of these studies are based on user response through questionnaire surveys. It is well-known that user responses are potentially inaccurate and are subjective to the common method bias. Recently, neuroscience method that takes advantage of neuro-scientific equipment to collect psychophysiological evidence has gained much attention in social sciences and information systems. Therefore, it is interesting to compare our findings from behavioral and neuroscience studies to see whether this new method may provide insights into our understanding of website design effect.
With the above purpose in mind, this study designed a field experiment on existing e-tailing websites in Taiwan and China. Both behavioral and neuroscience methods were applied to collect data about their flow experience and user satisfaction. The particular instrument for collecting brain wave data was a one-point electro-encephalogram (EEG), which is useful for measuring attention and relaxation. Our research model includes five main website design factors (convenience, aesthetics, content, interactivity and customization) as independent variables, flow experience as a mediator, and user satisfaction as the dependent variable. Our results indicate that all five design factors had significant impact on the flow experience and the flow experience had significant positive effect on user satisfaction in our behavior study. Our neuroscience study, however, shows different findings: only convenience, content, and customization had positive impact on the flow experience. Although the effect of flow experience (measured by attention and relaxation) on user satisfaction still exist, but the R-square value is much lower (reduced from 0.56 to 0.10). We argue that there are two possible interpretations: one is that the measurement we used may not be able to capture the full flow experience as a questionnaire could do. Another alerting explanation is that previous research on flow experience and user satisfaction may have overlooked the potential common method bias issue in analyzing their data.
Liang, Ting-Peng and Chen, Sih-Fan, "How Website Design Quality Affects Flow Experience and User Satisfaction: A Comparison of Behavioral and Neuroscience Studies" (2014). ICEB 2014 Proceedings (Taipei, Taiwan). 39.