Implementing A/B Testing and Hypothesis-driven Development for Product Performance Optimization
DOI:
https://doi.org/10.36676/jrps.v15.i4.16Keywords:
A/B testing, hypothesis-driven development, product performance, iterative experimentationAbstract
A/B testing and hypothesis-driven development (HDD) are two must-haves to maximize product performance. A/B testing refers to the ability to compare the multiple variations of a feature or design by measuring responses from users, while HDD is the systematic approach that forms and tests hypotheses through iterative cycles. This paper explores the relationship of methodologies involved and has a comprehensive analysis of theoretical foundations, historical development, and best practices on both. The study also has other major challenges, which include ethics issues, sample size, and balancing innovation with data-driven decisions. This research is actionable, providing insight for the practitioner who is interested in enhancing user engagement, conversion rates, and general success of a product, all by making use of the present trends and emerging technologies.
Downloads
References
Kohavi, R., & Longbotham, R. (2020). Online Controlled Experiments and A/B Testing. Communications of the ACM, 63(11), 72-81. DOI: 10.1145/3424679
Thomke, S. H. (2020). Experimentation Matters: Unlocking the Potential of New Technologies for Innovation. Research-Technology Management, 63(4), 36-44. DOI: 10.1080/08956308.2020.1765523
Rosenthal, E. (2019). Hypothesis-Driven Development: A Scientific Approach to Product Development. IEEE Engineering Management Review, 47(2), 132-137. DOI: 10.1109/EMR.2019.2911684
Sambasivan, N., et al. (2019). “Dirty” Data Can Be a Big Problem in Machine Learning for Software Development. IEEE Software, 36(6), 48-55. DOI: 10.1109/MS.2019.2933333
Tollefson, J. (2018). How to Make the Most of A/B Testing. MIT Sloan Management Review, 59(3), 12-13.
Lantz, B. (2018). The Impact of A/B Testing on Conversion Rates in E-commerce. Journal of Electronic Commerce Research, 19(1), 1-13.
Hill, A. V. (2017). The Hypothesis-Driven Development Process. Journal of Management and Engineering Integration, 10(1), 41-48. DOI: 10.26681/jmei.2017.100105
Kohavi, R., et al. (2017). Trustworthy Online Controlled Experiments: Five Years See the Future. *Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Science, 1489-1498. DOI: 10.1145/3097983.3098044
Schrage, M. (2017). The Myth of the A/B Testing Utopia. MIT Sloan Management Review, 58(2), 12-13.
Thomke, S. H., & Manzi, J. (2017). The Discipline of Experimentation. Harvard Business Review, 95(9), 126-133.
Gupta, P. (2016). A/B Testing for Experience: Challenges and Opportunities. International Journal of Information Technology and Computer Science, 8(3), 44-53. DOI: 10.5815/ijitcs.2016.03.06
Davenport, T. H. (2016). How to Make A/B Testing Work for Your Company. Wall Street Journal, 12.*
Kohavi, R., et al. (2015). Online Experiments: Lessons Learned. Computer, 48(9), 82-85. DOI: 10.1109/MC.2015.261
Rosenthal, E., & Blank, S. (2015). The Startup Owner’s Manual: The Step-By-Step Guide for Building a Great Company. K&S Ranch Publishers.
Schrage, M. (2014). The A/B Test (or The Power of Unlikely Journeys). MIT Sloan Management Review, 56(1), 12-13.
Thomke, S. H. (2014). The Discipline of Business Experimentation. Design Management Review, 25(2), 32-38.
Kohavi, R., et al. (2013). Online Controlled Experiments at Large Scale. *Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Science, 1168-1176. DOI: 10.1145/2487575.2488217
Linderman, K., et al. (2013). The Power of Experimentation: A New Way to Accelerate Innovation. Manufacturing & Service Operations Management, 15(2), 158-163. DOI: 10.1287/msom.1120.0435
Davenport, T. H. (2012). How to Design Smart Business Experiments. Harvard Business Review, 90(2), 100-106.
Thomke, S. H. (2012). Experimentation Matters: Unlocking the Potential of New Technologies for Innovation. Harvard Business Review Press. ISBN: 978-1422187336
Kohavi, R., & Round, M. (2012). Front Line Internet: Making the Most of A/B Testing. Queue, 10(10), 20-32. DOI: 10.1145/2371297.2367626
Schrage, M. (2011). The Mutual Understanding of A/B Testing. MIT Sloan Management Review, 52(2), 12-13.
Tichy, P., & Meyer, A. D. (2011). A/B Testing for Experience Design. Journal of Usability Studies, 6(2), 76-85.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 International Journal for Research Publication and Seminar
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.