Abstract
There is no consensus on whether field tests are necessary in evaluating mobile systems. Empirical studies have compared evaluations in the laboratory environment and field environment, but they provide different results due to the lack of consistent testing environments. Contributing to mobile system evaluation exploration, this study conducts a comparative analysis between laboratory study and field study by recreating the natural context in the laboratory and using recording software embedded in the mobile device. The results show that involving natural use context in a controlled testing environment identifies more usability problems than a complex field test, when the objective is to uncover mobile system design details. If the goal of a usability evaluation is to involve users' natural behaviors and examine context-dependent usability problems, a field test is necessary. We further analyze how to effectively simulate the natural context in the laboratory environment. The conclusion shows that the results might be different when using different user pools.
Library of Congress Subject Headings
User interfaces (Computer systems)--Testing; Mobile communication systems--Testing
Publication Date
2012
Document Type
Thesis
Department, Program, or Center
Information Sciences and Technologies (GCCIS)
Advisor
Yacci, Michael
Advisor/Committee Member
Jefferson, Anthony
Recommended Citation
Wang, Yao, "What is good enough for mobile system evaluation: A Comparison of laboratory and field setting" (2012). Thesis. Rochester Institute of Technology. Accessed from
https://repository.rit.edu/theses/793
Campus
RIT – Main Campus
Comments
Note: imported from RIT’s Digital Media Library running on DSpace to RIT Scholar Works. Physical copy available through RIT's The Wallace Library at: QA76.9.U83 W364 2012