Abstract
Usability is generally considered as a metric to judge the efficacy of any interface. This is also true for the web pages of a website. There are different factors - efficiency, memorability, learnability, errors, and aesthetics play significant roles in order to determine usability. In this work, we proposed a computational model to predict the efficiency with which users can do a particular task on a website. We considered seventeen features of web pages that may affect the efficiency of a task. The statistical significance of these features was tested based on the empirical data collected using twenty websites. For each website, a representative task was identified. Twenty participants completed these tasks using a controlled environment within a group. Task completion times were recorded for feature identification. The one Dimensional ANOVA study reveals sixteen out of the seventeen are statistically significant for efficiency measurement. Using these features, a computational model was developed based on the Support Vector Regression. Experimental results show that our model can predict the efficiency of web pages’ tasks with an accuracy of 90.64%.
Similar content being viewed by others
References
Agoston (2005) Computer graphics and geometric modeling: implementation and algorithms. Springer
Alhadreti O, Mayhew P (2017) To intervene or not to intervene: an investigation of three think-aloud protocols in usability testing. J Usability Stud 12 (3):111–132
Berry LH (2000) Cognitive effects of web page design. In: Instructional and cognitive impacts of web-based education. IGI global, pp 41–55
Blackmon MH, Polson PG, Kitajima M, Lewis C (2002) Cognitive walkthrough for the web. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 463–470
Boren T, Ramey J (2000) Thinking aloud: reconciling theory and practice. IEEE Trans Prof Commun 43(3):261–278
Borges JA, Morales I, Rodriguez NJ (1996) Guidelines for designing usable world wide web pages. In: Conference companion on human factors in computing systems, pp 277–278
Bylinskii Z (2015) Computational understanding of image memorability. PhD Thesis Massachusetts institute of technology
Card SK (2018) The psychology of human-computer interaction. Crc Press
Card SK, Moran TP, Newell A (1980) The keystroke-level model for user performance time with interactive systems. Commun ACM 23(7):396–410
Card S, Moran T, Newell A (1983) The psychology of Human-Computer Interaction. New Jersey: Lawerence Erlbaum Associates. Inc, Hillsdale
Cawley GC, Talbot NL (2010) On over-fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res 11:2079–2107
Cohendet R, Yadati K, Duong NQ, Demarty C-H (2018) Annotating, understanding, and predicting long-term video memorability. In: Proceedings of the 2018 ACM on international conference on multimedia retrieval, pp 178–186
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297
Faraday P (2000) Visually critiquing web pages. In: Multimedia’99. Springer, pp 155–166
Fetterly D, Manasse M, Najork M, Wiener JL (2004) A large-scale study of the evolution of web pages. Softw Practice Exp 34(2):213–237
Fitts PM (1954) The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psych 47(6):381
Galitz WO (2007) The essential guide to user interface design: an introduction to GUI design principles and techniques. Wiley
Hick WE (1952) On the rate of gain of information. Quarter J Exp Psych 4(1):11–26
Hill AL (2001) Readability of screen displays as a function of color contrast and luminance contrast. Stephen F. Austin State University
Hyman R (1953) Stimulus information as a determinant of reaction time. J Exp Psych 45(3):188
(2001) IBM: cost justifying ease of use
Ivory MY, Sinha RR, Hearst MA (2001) Empirically validated web page design metrics. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 53–60
John B, Vera A, Matessa M, Freed M, Remington R (2002) Automating cpm-goms. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 147–154
Kieras DE (1988) Towards a practical goms model methodology for user interface design. In: Handbook of human-computer interaction. Elsevier, pp 135–157
Kieras D (1994) Goms modeling of user interfaces using ngomsl. In: Conference companion on human factors in computing systems, pp 371–372
Landauer TK, McNamara DS, Dennis S, Kintsch W (2013) Handbook of latent semantic analysis psychology press
Larson K, Czerwinski M (1998) Web page design: implications of memory, structure and scent for information retrieval. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 25–32
Lee S, Sah YJ (2020) Development of an approach to measuring learnability based on ngomsl from perspectives of extended learnability. Int J Human–Comput Inter 36(2):199–209
Liu W, Gori J, Rioul O, Beaudouin-Lafon M, Guiard Y (2020) How relevant is hick’s law for hci?. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–11
Mahatody T, Sagar M, Kolski C (2010) State of the art on the cognitive walkthrough method, its variants and evolutions. Int J Human–Comput Inter 26(8):741–785
Maity R, Bhattacharya S (2017) A model to compute webpage aesthetics quality based on wireframe geometry. In: IFIP conference on human-computer interaction. Springer, pp 85–94
Maity R, Bhattacharya S (2019) Is my interface beautiful?—a computational model-based approach. IEEE Trans Computat Social Syst 6(1):149–161
Maity R, Bhattacharya S (2020) A quantitative approach to measure webpage aesthetics. Int J Technol Human Inter (IJTHI) 16(2):53–68
Maity R, Madrosiya A, Bhattacharya S (2016) A computational model to predict aesthetic quality of text elements of gui. Proced Comput Sci 84:152–159
Maity R, Uttav A, Verma G, Bhattacharya S (2015) A non-linear regression model to predict aesthetic ratings of on-screen images. In: Proceedings of the annual meeting of the australian special interest group for computer human interaction, pp 44–52
Morris ME, Hinrichs RJ (1996) Web page design: a different multimedia. Prentice-hall, inc
Nielsen J (1994) Usability engineering. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA
Nielsen J (1994) Estimating the number of subjects needed for a thinking aloud test. Int J Human-Comput Studies 41(3):385–397
Nielsen J (1995) How to conduct a heuristic evaluation. Nielsen Norman Group 1:1–8
Nielsen J (2012) Usability 101: introduction to usability
Oulasvirta A (2019) It’s time to rediscover hci models. Interactions 26(4):52–56
Quiñones D, Rusu C (2017) How to develop usability heuristics: a systematic literature review. Comput Standards Inter 53:89–122
Richardson RT, Drexler TL, Delparte DM (2014) Color and contrast in e-learning design: a review of the literature and recommendations for instructional designers and web developers. MERLOT J Online Learn Teach 10(4):657–670
Saha S, Basumatary D, Senapati A, Maity R (2021) Is there any further scope for improving the efficiency of modern websites?. In: 2021 6th International conference for convergence in technology (I2CT). IEEE, pp 1–7
Seow SC (2005) Information theoretic models of hci: a comparison of the hick-hyman law and fitts’ law. Human-Comput Inter 20(3):315–352
Shneiderman B, Plaisant C, Cohen MS, Jacobs S, Elmqvist N, Diakopoulos N (2016) Designing the user interface: strategies for effective human-computer interaction pearson
Singh N, Bhattacharya S (2010) A ga-based approach to improve web page aesthetics. In: Proceedings of the first international conference on intelligent interactive technologies and multimedia, pp 29–32
Smith-Jackson TL (2004) Cognitive walk-through method (cwm). In: Handbook of human factors and ergonomics methods. CRC Press, pp 785–793
Squalli-Houssaini H, Duong NQ, Gwenaëlle M, Demarty C-H (2018) Deep learning for predicting image memorability. In: 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2371–2375
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors have no relevant financial/ no financial interest to disclose.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Apurbalal Senapati and Ranjan Maity are contributed equally to this work.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Saha, S., Senapati, A. & Maity, R. An approach to predict the task efficiency of web pages. Multimed Tools Appl 82, 25217–25233 (2023). https://doi.org/10.1007/s11042-023-14619-3
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1007/s11042-023-14619-3