Conference paper 2023

Using A/B Testing as a Pedagogical Tool for Iterative Design in HCI Classrooms

RM
Reza, Mohi
 MI
Musabirov, Ilya
 LN
Laundry, Nathan
 LM
Liut, Michael
 WJ
Williams, Joseph Jay
ACM International Conference Proceeding Series
Conference · pp. 43-48
Abstract

This paper explores the use of A/B testing as a pedagogical tool for iterative design in HCI classrooms and outlines a vision for experiment-inspired design. The traditional focus on the statistical aspects of A/B testing education has meant that the equally crucial role of iterative design embedded within the experimental process has not received commensurate attention. By incorporating iterative design learning activities that are scaffolded by A/B testing tools, HCI students can gain transferable skills and experience in doing multiple cycles of ideation, prototyping, testing, and evaluation, and simultaneously contribute to continual course improvement. We reconsider the role of experimentation in HCI education as a means for exploring complex design spaces. Drawing from our experience in teaching this approach and conducting education research involving sequences of online controlled experiments, we present examples of how to use A/B testing as a pedagogical tool for iterative design in HCI classrooms. © 2023 Owner/Author.

Keywords

Author Keywords

HCI Education A/B Testing Iterative Design

Index Keywords

Curricula Students Human engineering Transferable skills HCI education Learning Activity Pedagogical tools Design learning A/B testing Iterative design Multiple cycles Testing and evaluation Testing tools
Author Affiliations
University of Toronto, Toronto, ON, Canada
University of Guelph, Guelph, ON, Canada
Funding & Acknowledgements
National Science Foundation, NSF
Grant: 2209819
We are grateful to Kenji Tan and Ege Mert Akin at the University of Toronto for their input on early drafts of this manuscript. This work was partially supported by grants from the Office of Naval Research (N00014-18-1-2755, N00014-21-1-2576), the Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06968), and the National Science Foundation (2209819).
National Science Foundation, NSF
We are grateful to Kenji Tan and Ege Mert Akin at the University of Toronto for their input on early drafts of this manuscript. This work was partially supported by grants from the Office of Naval Research (N00014-18-1-2755, N00014-21-1-2576), the Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06968), and the National Science Foundation (2209819).
Natural Sciences and Engineering Research Council of Canada, NSERC
Grant: RGPIN-2019-06968
We are grateful to Kenji Tan and Ege Mert Akin at the University of Toronto for their input on early drafts of this manuscript. This work was partially supported by grants from the Office of Naval Research (N00014-18-1-2755, N00014-21-1-2576), the Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06968), and the National Science Foundation (2209819).
Natural Sciences and Engineering Research Council of Canada, NSERC
We are grateful to Kenji Tan and Ege Mert Akin at the University of Toronto for their input on early drafts of this manuscript. This work was partially supported by grants from the Office of Naval Research (N00014-18-1-2755, N00014-21-1-2576), the Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06968), and the National Science Foundation (2209819).
Office of Naval Research, ONR
Grant: N00014-21-1-2576, N00014-18-1-2755
We are grateful to Kenji Tan and Ege Mert Akin at the University of Toronto for their input on early drafts of this manuscript. This work was partially supported by grants from the Office of Naval Research (N00014-18-1-2755, N00014-21-1-2576), the Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06968), and the National Science Foundation (2209819).
Office of Naval Research, ONR
We are grateful to Kenji Tan and Ege Mert Akin at the University of Toronto for their input on early drafts of this manuscript. This work was partially supported by grants from the Office of Naval Research (N00014-18-1-2755, N00014-21-1-2576), the Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06968), and the National Science Foundation (2209819).
References 10 References
1 American Educator, (2012)
2 Journal of Career and Technical Education, (2010)
3 Eiselmayer, Alexander, Touchstone2: An Interactive Environment for Exploring Trade-offs in HCI Experiment Design, Conference on Human Factors in Computing Systems - Proceedings, (2019)
4 Frerejean, Jimmy, Designing instruction for complex learning: 4C/ID in higher education, European Journal of Education, 54, 4, pp. 513-524, (2019)
5 Scandinavian Journal of Information Systems, (2007)
6 Guilford Publications, (2019)
7 Teaching Matters 2010 Conference, (2010)
8 Kaptein, Maurits Clemens, Powerful and consistent analysis of likert-type ratingscales, Conference on Human Factors in Computing Systems - Proceedings, 4, pp. 2391-2394, (2010)
9 Kirschner, Paul A., Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching, Educational Psychologist, 41, 2, pp. 75-86, (2006)
10 Kohavi, Ron, Online controlled experiments at large scale, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Part F128815, pp. 1168-1176, (2013)
Quick Actions
Full Text via DOI
Citation Metrics
0
Times Cited (Scopus)
References 10
Document Identifiers