skip to main content
survey
Free Access
Just Accepted

A Systematic Literature Review on Reasons and Approaches for Accurate Effort Estimations in Agile

Authors Info & Claims
Online AM:01 May 2024Publication History
Skip Abstract Section

Abstract

Background: Accurate effort estimation is crucial for planning in Agile iterative development. Agile estimation generally relies on consensus-based methods like planning poker, which require less time and information than other formal methods (e.g., COSMIC) but are prone to inaccuracies. Understanding the common reasons for inaccurate estimations and how proposed approaches can assist practitioners is essential. However, prior systematic literature reviews (SLR) only focus on the estimation practices (e.g., [26, 127]) and the effort estimation approaches (e.g., [6]). Aim: We aim to identify themes of reasons for inaccurate estimations and classify approaches to improve effort estimation. Method: We conducted an SLR and identified the key themes and a taxonomy. Results: The reasons for inaccurate estimation are related to information quality, team, estimation practice, project management, and business influences. The effort estimation approaches were the most investigated in the literature, while only a few aim to support the effort estimation process. Yet, few automated approaches are at risk of data leakage and indirect validation scenarios. Recommendations: Practitioners should enhance the quality of information for effort estimation, potentially by adopting an automated approach. Future research should aim to improve the information quality, while avoiding data leakage and indirect validation scenarios.

References

  1. Muhammad Adnan, Muhammad Afzal, and Khadim Hussain Asif. 2019. Ontology-Oriented Software Effort Estimation System for E-commerce Applications Based on Extreme Programming and Scrum Methodologies. The Computer Journal 62, 11 (2019), 1605–1624.Google ScholarGoogle ScholarCross RefCross Ref
  2. Asaad Algarni and Kenneth Magel. 2019. Applying Software Design Metrics to Developer Story: A Supervised Machine Learning Analysis. In Proceedings of the IEEE International Conference on Cognitive Machine Intelligence (CogMI). 156–159.Google ScholarGoogle ScholarCross RefCross Ref
  3. Mohammed Alhamed and Tim Storer. 2021. Playing Planning Poker in Crowds: Human Computation of Software Effort Estimates. In Proceedings of the International Conference on Software Engineering (ICSE). 1–12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Jasem M Alostad, Laila RA Abdullah, and Lamya Sulaiman Aali. 2017. A Fuzzy based Model for Effort Estimation in Scrum Projects. International Journal of Advanced Computer Science and Applications 8, 9(2017), 270–277.Google ScholarGoogle Scholar
  5. Bushra Alsaadi, Bashaer Alsaadi, Mashaal Alfhaid, Athir Alghamdi, Nedaa Almuallim, and Bahjat Fakieh. 2021. Scrum Poker Estimator: A Planning Poker Tool for Accurate Story Point Estimation.International Journal of Computer Information Systems & Industrial Management Applications 13(2021).Google ScholarGoogle Scholar
  6. Bashaer Alsaadi and Kawther Saeedi. 2022. Data-driven effort estimation techniques of agile user stories: a systematic literature review. Artificial Intelligence Review(2022), 1–32.Google ScholarGoogle Scholar
  7. Abdullah Altaleb, Muna Altherwi, and Andy Gravell. 2020. A Pair Estimation Technique of Effort Estimation in Mobile App Development for Agile Process: Case Study. In Proceedings of the International Conference on Information Science and Systems (ICISS). 29–37.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Abdullah Altaleb, Muna Altherwi, and Andy Gravell. 2020. An Industrial Investigation into Effort Estimation Predictors for Mobile App Development in Agile Processes. In Proceedings of the International Conference on Industrial Technology and Management (ICITM). 291–296.Google ScholarGoogle ScholarCross RefCross Ref
  9. Beatrice Andrew and Ali Selamat. 2012. Systematic Literature Review of Missing Data Imputation Techniques for Effort Prediction. In Proceedings of the International Conference on Information and Knowledge Management. 222–226.Google ScholarGoogle Scholar
  10. Ardiansyah Ardiansyah, Ridi Ferdiana, and Adhistya Erna Permanasari. 2022. MUCPSO: A Modified Chaotic Particle Swarm Optimization with Uniform Initialization for Optimizing Software Effort Estimation. Applied Sciences 12, 3 (2022), 1081.Google ScholarGoogle ScholarCross RefCross Ref
  11. Mohit Arora, Sahil Verma, Kavita, Marcin Wozniak, Jana Shafi, and Muhammad Fazal Ijaz. 2022. An efficient ANFIS-EEBAT approach to estimate effort of Scrum projects. Scientific Reports 12, 1 (2022), 7974.Google ScholarGoogle ScholarCross RefCross Ref
  12. Waqar Aslam, Farah Ijaz, Muhammad Ikram Ullah Lali, and Waqar Mehmood. 2017. Risk Aware and Quality Enriched Effort Estimation for Mobile Applications in Distributed Agile Software Development.Journal of Information Science and Engineering 33, 6(2017), 1481–1500.Google ScholarGoogle Scholar
  13. Sufyan Basri, Nazri Kama, Haslina Md Sarkan, Saiful Adli, and Faizura Haneem. 2016. An Algorithmic-Based Change Effort Estimation Model for Software Development. In Proceedings of the Asia-Pacific Software Engineering Conference (APSEC). 177–184.Google ScholarGoogle ScholarCross RefCross Ref
  14. S. Bick, K. Spohrer, R. Hoda, A. Scheerer, and A. Heinzl. 2018. Coordination Challenges in Large-Scale Software Development: A Case Study of Planning Misalignment in Hybrid Settings. Transactions of Software Engineering (TSE) 44, 10 (2018), 932–950.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Saurabh Bilgaiyan, Kunwar Aditya, Samaresh Mishra, and Madhabananda Das. 2018. Chaos-based modified morphological genetic algorithm for software development cost estimation. In Proceedings of the Progress in Computing, Analytics and Networking. Springer, 31–40.Google ScholarGoogle ScholarCross RefCross Ref
  16. Saurabh Bilgaiyan, Samaresh Mishra, and Madhabananda Das. 2019. Effort estimation in agile software development using experimental validation of neural network models. International Journal of Information Technology 11, 3(2019), 569–573.Google ScholarGoogle ScholarCross RefCross Ref
  17. Ricardo Britto, Emilia Mendes, and Jürgen Börstler. 2015. An Empirical Investigation on Effort Estimation in Agile Global Software Development. In Proceedings of the International Conference on Global Software Engineering. 38–45.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Luigi Buglione and Alain Abran. 2013. Improving the User Story Agile Technique Using the INVEST Criteria. In Proceedings of the International Workshop on Software Measurement. 49–53.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Shariq Aziz Butt, Tuncay Ercan, Muhammad Binsawad, Paola-Patricia Ariza-Colpas, Jorge Diaz-Martinez, Gabriel Pineres-Espitia, Emiro De-La-Hoz-Franco, Marlon Alberto Pineres Melo, Roberto Morales Ortega, and Juan-David De-La-Hoz-Hernandez. 2023. Prediction based cost estimation technique in agile development. Advances in Engineering Software 175 (2023), 103329.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Shariq Aziz Butt, Ayesha Khalid, Tuncay Ercan, Paola Patricia Ariza-Colpas, Acosta-Coll Melisa, Gabriel Pineres-Espitia, Emiro De-La-Hoz-Franco, Marlon Alberto Pineres Melo, and Roberto Morales Ortega. 2022. A software-based cost estimation technique in scrum using a developer’s expertise. Advances in Engineering Software 171 (2022), 103159.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Oscar Chaparro, Jing Lu, Fiorella Zampetti, Laura Moreno, Massimiliano Di Penta, Andrian Marcus, Gabriele Bavota, and Vincent Ng. 2017. Detecting Missing Information in Bug Descriptions. In Proceedings of the joint meeting on Foundations of Software Engineering (ESEC/FSE). 396–407.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Morakot Choetkiertikul, Hoa Khanh Dam, Truyen Tran, Trang Thi Minh Pham, Aditya Ghose, and Tim Menzies. 2019. A deep learning model for estimating story points. Transactions of Software Engineering (TSE) 45, 07 (2019), 637–656.Google ScholarGoogle ScholarCross RefCross Ref
  23. Jitender Choudhari and Ugrasen Suman. 2012. Phase wise Effort Estimation for Software Maintenance: An Extended SMEEM Model. In Proceedings of the CUBE International Information Technology Conference. 397–402.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Evita Coelho and Anirban Basu. 2012. Effort Estimation in Agile Software Development using Story Points. International Journal of Applied Information Systems (IJAIS) 3, 7(2012), 7–10.Google ScholarGoogle ScholarCross RefCross Ref
  25. Mike Cohn. 2006. Agile estimating and planning. Pearson Education.Google ScholarGoogle Scholar
  26. Marco Conoscenti, Veronika Besner, Antonio Vetrò, and Daniel Méndez Fernández. 2019. Combining data analytics and developers feedback for identifying reasons of inaccurate estimations in agile software development. Journal of Systems and Software (JSS) 156 (2019), 126–135.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Iftincă Dan, Rusu Cătălin, and Oswald Oliver. 2020. An NLP Approach to Estimating Effort in a Work Environment. In International Conference on Software, Telecommunications and Computer Networks. 1–6.Google ScholarGoogle ScholarCross RefCross Ref
  28. Emanuel Dantas, Antonio Alexandre Moura Costa, Marcus Vinicius, Mirko Perkusich, Hyggo Oliveira de Almeida, and Angelo Perkusich. 2019. An Effort Estimation Support Tool for Agile Software Development: An Empirical Evaluation. In International Journal of Software Engineering and Knowledge Engineering (IJSEKE). 82–116.Google ScholarGoogle Scholar
  29. Emanuel Dantas, Mirko Perkusich, Ednaldo Dilorenzo, Danilo FS Santos, Hyggo Almeida, and Angelo Perkusich. 2018. Effort Estimation in Agile Software Development: an Updated Review. International Journal of Software Engineering and Knowledge Engineering (IJSEKE) 28, 11n12 (2018), 1811–1831.Google ScholarGoogle Scholar
  30. Vachik S Dave and Kamlesh Dutta. 2014. Neural network based models for software effort estimation: a review. Artificial Intelligence Review 42, 2 (2014), 295–307.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Srdjana Dragicevic, Stipe Celar, and Mili Turic. 2017. Bayesian network model for task effort estimation in agile software development. Journal of Systems and Software (JSS) 127 (2017), 109–119.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Omar El Beggar. 2023. IFEJM: New Intuitionistic Fuzzy Expert Judgment Method for Effort Estimation in Agile Software Development. Arabian Journal for Science and Engineering(2023), 1–22.Google ScholarGoogle Scholar
  33. Neil A Ernst and Gail C Murphy. 2012. Case Studies in Just-In-Time Requirements Analysis. In Proceedings of the International Workshop on Empirical Requirements Engineering (EmpiRE). 25–32.Google ScholarGoogle ScholarCross RefCross Ref
  34. Hasan O Farahneh and Ayman A Issa. 2011. A Linear Use Case Based Software Cost Estimation Model. International Journal of Computer and Information Engineering 5, 1(2011), 31–35.Google ScholarGoogle Scholar
  35. Marta Fernández-Diego, Erwin R Méndez, Fernando González-Ladrón-De-Guevara, Silvia Abrahão, and Emilio Insfran. 2020. An Update on Effort Estimation in Agile Software Development: a Systematic Literature Review. IEEE Access 8(2020), 166768–166800.Google ScholarGoogle ScholarCross RefCross Ref
  36. Jannik Fischbach, Andreas Vogelsang, Dominik Spies, Andreas Wehrle, Maximilian Junker, and Dietmar Freudenstein. 2020. SPECMATE: Automated Creation of Test Cases from Acceptance Criteria. In 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). 321–331.Google ScholarGoogle ScholarCross RefCross Ref
  37. Martin Fowler and Jim Highsmith. 2001. The agile manifesto. Software Development 9, 8 (2001), 28–32.Google ScholarGoogle Scholar
  38. Michael Fu and Chakkrit Tantithamthavorn. 2022. GPT2SP: A transformer-based agile story point estimation approach. IEEE Transactions on Software Engineering 49, 2 (2022), 611–625.Google ScholarGoogle ScholarCross RefCross Ref
  39. Swarnima Singh Gautam and Vrijendra Singh. 2018. The state-of-the-art in software development effort estimation. Journal of Software: Evolution and Process 30, 12 (2018), e1983.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Fabian Gilson, Matthias Galster, and François Georis. 2019. Extracting Quality Attributes from User Stories for Early Architecture Decision Making. In Proceedings of the International Conference on Software Architecture Companion (ICSA-C). 129–136.Google ScholarGoogle ScholarCross RefCross Ref
  41. Fabian Gilson, Matthias Galster, and François Georis. 2020. Generating Use Case Scenarios from User Stories. In Proceedings of the International Conference on Software and System Processes. 31–40.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Don Gotterbarn, Keith Miller, and Simon Rogerson. 1999. Computer Society and ACM Approve Software Engineering Code of Ethics. Computer 32, 10 (1999), 84–88.Google ScholarGoogle ScholarCross RefCross Ref
  43. Nikhil Govil and Ashish Sharma. 2022. Estimation of cost and development effort in Scrum-based software projects considering dimensional success factors. Advances in Engineering Software 172 (2022), 103209.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Simon Grapenthin, Matthias Book, Thomas Richter, and Volker Gruhn. 2016. Supporting Feature Estimation with Risk and Effort Annotations. In Proceedings of the Euromicro Conference on Software Engineering and Advanced Application. 17–24.Google ScholarGoogle ScholarCross RefCross Ref
  45. Stein Grimstad, Magne Jørgensen, and Kjetil Moløkken-Østvold. 2006. Software effort estimation terminology: The tower of Babel. Information and Software Technology (IST) 48, 4 (2006), 302–310.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Muaz Gultekin and Oya Kalipsiz. 2020. Story Point-Based E®ort Estimation Model with Machine Learning Techniques. International Journal of Software Engineering and Knowledge Engineering (IJSEKE) 30, 01 (2020), 43–66.Google ScholarGoogle ScholarCross RefCross Ref
  47. Neha Gupta and Rajendra Prasad Mahapatra. 2022. Automated software effort estimation for agile development system by heuristically improved hybrid learning. Concurrency and Computation: Practice and Experience 34, 25(2022), e7267.Google ScholarGoogle ScholarCross RefCross Ref
  48. Gordon H Guyatt, Andrew D Oxman, Gunn E Vist, Regina Kunz, Yngve Falck-Ytter, Pablo Alonso-Coello, and Holger J Schünemann. 2008. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. British Medical Journal (BMJ) 336, 7650 (2008), 924–926.Google ScholarGoogle ScholarCross RefCross Ref
  49. Tuna Hacaloğlu and Onur Demirörs. 2018. Challenges of Using Software Size in Agile Software Development: A Systematic Literature Review. In Proceedings of the International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement (IWSM-MENSURA).Google ScholarGoogle Scholar
  50. Jo Erskine Hannay, Hans Christian Benestad, and Kjetil Strand. 2019. Agile Uncertainty Assessment for Benefit Points and Story Points. IEEE Software 36, 4 (2019), 50–62.Google ScholarGoogle ScholarCross RefCross Ref
  51. Peter Hearty, Norman Fenton, David Marquez, and Martin Neil. 2009. Predicting project velocity in XP using a learning dynamic Bayesian network model. Transactions of Software Engineering (TSE) 35, 1 (2009), 124–137.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Petra Heck and Andy Zaidman. 2017. A framework for quality assessment of just-in-time requirements: the case of open source feature requests. Requirements Engineering (RE) 22, 4 (2017), 453–473.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Petra Heck and Andy Zaidman. 2018. A Systematic Literature Review on Quality Criteria for Agile Requirements Specifications. Software Quality Journal 26, 1 (2018), 127–160.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. M Hemrajani and Vyas N. 2021. Predicting Effort of Agile Software Projects Using Linear Regression, Ridge Regression and Logistic Regression. (2021), 14–19.Google ScholarGoogle Scholar
  55. Rashina Hoda and Latha K. Murugesan. 2016. Multi-Level Agile Project Management Challenges: A Self-Organizing Team Perspective. Journal of Systems and Software (JSS) 117 (2016), 245–257.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Rashina Hoda, James Noble, and Stuart Marshall. 2010. How Much is Just Enough? Some Documentation Patterns on Agile Projects. In Proceedings of the European Conference on Pattern Languages of Programs. 1–13.Google ScholarGoogle Scholar
  57. Ali Idri, Fatima azzahra Amazal, and Alain Abran. 2015. Analogy-based software development effort estimation: A systematic mapping and review. Information and Software Technology (IST) 58 (2015), 206–230.Google ScholarGoogle ScholarCross RefCross Ref
  58. Ali Idri, Mohamed Hosni, and Alain Abran. 2016. Systematic literature review of ensemble effort estimation. Journal of Systems and Software (JSS) 118 (2016), 151–175.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Magne Jørgensen. 2004. A review of studies on expert estimation of software development effort. Journal of Systems and Software (JSS) 70, 1-2 (2004), 37–60.Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Sungjoo Kang, Okjoo Choi, and Jongmoon Baik. 2010. Model-Based Dynamic Cost Estimation and Tracking Method for Agile Software Development. In Proceedings of the International Conference on Computer and Information Science. 743–748.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Hrvoje Karna, Sven Gotovac, and Linda Vicković. 2020. Data Mining Approach to Effort Modeling On Agile Software Projects. Informatica 44, 2 (2020).Google ScholarGoogle Scholar
  62. Hrvoje Karna, Sven Gotovac, Linda Vicković, and Luka Mihanović. 2020. The Effects of Turnover on Expert Effort Estimation. Journal of Information and Organizational Sciences 44, 1 (2020), 51–81.Google ScholarGoogle ScholarCross RefCross Ref
  63. HAITHEM KASSEM, KHALED MAHAR, and AMANI SAAD. 2022. Software Effort Estimation Using Hierarchical Attention Neural Network. Journal of Theoretical and Applied Information Technology 100, 18(2022).Google ScholarGoogle Scholar
  64. Haithem Kassem, Khaled Mahar, and Amani A Saad. 2023. Story Point Estimation Using Issue Reports With Deep Attention Neural Network. e-Informatica Software Engineering Journal 17, 1 (2023).Google ScholarGoogle Scholar
  65. Anupama Kaushik, Devendra Kr Tayal, and Kalpana Yadav. 2020. A fuzzified story point approach for agile projects. International Journal of Agile Systems and Management 13, 2(2020), 103–129.Google ScholarGoogle ScholarCross RefCross Ref
  66. Anupama Kaushik, Devendra Kumar Tayal, and Kalpana Yadav. 2022. The role of neural networks and metaheuristics in agile software development effort estimation. In Research Anthology on Artificial Neural Network Applications. 306–328.Google ScholarGoogle Scholar
  67. Thanh Tung Khuat and My Hanh Le. 2018. A Novel Hybrid ABC-PSO Algorithm for Effort Estimation of Software Projects Using Agile Methodologies. Journal of Intelligent Systems 27, 3 (2018), 489–506.Google ScholarGoogle ScholarCross RefCross Ref
  68. Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. (2007).Google ScholarGoogle Scholar
  69. Barbara Kitchenham, Lech Madeyski, and David Budgen. 2022. SEGRESS: Software engineering guidelines for reporting secondary studies. IEEE Transactions on Software Engineering 49, 3 (2022), 1273–1298.Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Kevin Logue and Kevin McDaid. 2008. Agile release planning: Dealing with uncertainty in development time and business value. In Proc of the IEEE International Conference and Workshop on the Engineering of Computer Based Systems. 437–442.Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Kashumi Madampe, Rashina Hoda, and John Grundy. 2020. A Multi-dimensional Study of Requirements Changes in Agile Software Development Projects. arXiv preprint arXiv:2012.03423(2020).Google ScholarGoogle Scholar
  72. Gusti Raditia Madya, Eko K Budiardjo, and Kodrat Mahatma. 2022. PREP: A Post-Requirements Effort Estimation Method in Scrum’s Sprint Grooming. In 2022 International Conference on Data and Software Engineering (ICoDSE). IEEE, 132–137.Google ScholarGoogle Scholar
  73. Viljan Mahnič and Tomaž Hovelja. 2012. On using planning poker for estimating user stories. Journal of Systems and Software (JSS) 85, 9 (2012), 2086–2095.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Marek MAJCHRZAK and Lech Madeyski. 2016. Factors influencing user story estimations: an industrial interview and a conceptual model. Central and Eastern European Journal of Management and Economics (CEEJME)4(2016), 261–280.Google ScholarGoogle Scholar
  75. Onkar Malgonde and Kaushal Chari. 2019. An ensemble-based model for predicting agile software development effort. Empirical Software Engineering (EMSE) 24, 2 (2019), 1017–1055.Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Bhaskar Marapelli, Anil Carie, and Sardar MN Islam. 2020. RNN-CNN MODEL: A Bi-directional Long Short-Term Memory Deep Learning Network For Story Point Estimation. In Proceedings of the International Conference on Innovative Technologies in Intelligent Systems and Industrial Applications (CITISIA). 1–7.Google ScholarGoogle Scholar
  77. Agnieszka Marczak-Czajka and Jane Cleland-Huang. 2023. Using ChatGPT to Generate Human-Value User Stories as Inspirational Triggers. In 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW). 52–61.Google ScholarGoogle ScholarCross RefCross Ref
  78. Zainab Masood, Rashina Hoda, and Kelly Blincoe. 2020. Real World Scrum A Grounded Theory of Variations in Practice. Transactions on Software Engineering (TSE) 48, 5 (2020), 1579–1591.Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Pedro Miranda, J Pascoal Faria, Filipe F Correia, Ahmed Fares, Ricardo Graça, and João Mendes Moreira. 2021. An Analysis of Monte Carlo Simulations for Forecasting Software Projects. In Proceedings of the Annual ACM Symposium on Applied Computing. 1550–1558.Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Kayhan Moharreri, Alhad Vinayak Sapre, Jayashree Ramanathan, and Rajiv Ramnath. 2016. Cost-Effective Supervised Learning Models for Software Effort Estimation in Agile Environments. In Proceedings of the IEEE Annual computer software and applications conference (COMPSAC), Vol.  2. 135–140.Google ScholarGoogle ScholarCross RefCross Ref
  81. Assia Najm, Abdelali Zakrani, and Abdelaziz Marzak. 2022. An enhanced support vector regression model for agile projects cost estimation. IAES International Journal of Artificial Intelligence (IJ-AI) 11, 1(2022), 265.Google ScholarGoogle ScholarCross RefCross Ref
  82. Nuno Nunes, Larry Constantine, and Rick Kazman. 2011. iUCP: Estimating Interactive-Software Project Size with Enhanced Use-Case Points. IEEE software 28, 4 (2011).Google ScholarGoogle Scholar
  83. Mohd Owais and R Ramakishore. 2016. Effort, duration and cost estimation in agile software development. In 2016 Ninth International Conference on Contemporary Computing (IC3). 1–5.Google ScholarGoogle ScholarCross RefCross Ref
  84. Matthew J Page, Joanne E McKenzie, Patrick M Bossuyt, Isabelle Boutron, Tammy C Hoffmann, Cynthia D Mulrow, Larissa Shamseer, Jennifer M Tetzlaff, Elie A Akl, Sue E Brennan, et al. 2021. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery 88 (2021), 105906.Google ScholarGoogle ScholarCross RefCross Ref
  85. Aditi Panda, Shashank Mouli Satapathy, and Santanu Kumar Rath. 2015. Empirical Validation of Neural Network Models for Agile Software Effort Estimation based on Story Points. Procedia Computer Science 57 (2015), 772–781.Google ScholarGoogle ScholarCross RefCross Ref
  86. Abu Wahid Md Masud Parvez. 2013. Efficiency Factor and Risk Factor Based User Case Point Test Effort Estimation Model Compatible with Agile Software Development. In Proceedings of the International Conference on Information Technology and Electrical Engineering (ICITEE). IEEE, 113–118.Google ScholarGoogle Scholar
  87. Jirat Pasuksmit. 2023. Supplementary material: A Systematic Literature Review on Reasons and Approaches for Accurate EffortEstimations in Agile. (12 2023). https://doi.org/10.6084/m9.figshare.22122245.v6Google ScholarGoogle ScholarCross RefCross Ref
  88. Jirat Pasuksmit, Patanamon Thongtanunam, and Shanika Karunasekera. 2021. Towards Just-Enough Documentation for Agile Effort Estimation: What Information Should Be Documented?. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME). 114–125.Google ScholarGoogle ScholarCross RefCross Ref
  89. Jirat Pasuksmit, Patanamon Thongtanunam, and Shanika Karunasekera. 2022. Story points changes in agile iterative development: An empirical study and a prediction approach. Empirical Software Engineering (EMSE) 27, 6 (2022), 156.Google ScholarGoogle ScholarDigital LibraryDigital Library
  90. Jirat Pasuksmit, Patanamon Thongtanunam, and Shanika Karunasekera. 2022. Towards reliable agile iterative planning via predicting documentation changes of work items. In Proceedings of the International Conference on Mining Software Repositories (MSR). 35–47.Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Freddy Paz, Claudia Zapata, and José Antonio Pow-Sang. 2014. An Approach for Effort Estimation in Incremental Software Development using Cosmic Function Points. In Proceedings of the International Symposium on Empirical Software Engineering and Measurement (ESEM). 1–4.Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. Mirko Perkusich, Lenardo Chaves e Silva, Alexandre Costa, Felipe Ramos, Renata Saraiva, Arthur Freire, Ednaldo Dilorenzo, Emanuel Dantas, Danilo Santos, Kyller Gorgônio, et al. 2020. Intelligent software engineering in the context of agile software development: A systematic literature review. Information and Software Technology (IST) 119 (2020), 106241.Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. Mark Petticrew and Helen Roberts. 2008. Systematic reviews in the social sciences: A practical guide. John Wiley & Sons.Google ScholarGoogle Scholar
  94. Hung Phan and Ali Jannesari. 2022. Heterogeneous Graph Neural Networks for Software Effort Estimation. In Proceedings of the 16th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. 103–113.Google ScholarGoogle ScholarDigital LibraryDigital Library
  95. Hung Phan and Ali Jannesari. 2022. Story point level classification by text level graph neural network. In Proceedings of the 1st International Workshop on Natural Language-based Software Engineering. 75–78.Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Rashmi Popli and Naresh Chauhan. 2014. Cost and effort estimation in agile software development. In 2014 international conference on reliability optimization and information technology (ICROIT). 57–61.Google ScholarGoogle ScholarCross RefCross Ref
  97. Simone Porru, Alessandro Murgia, Serge Demeyer, Michele Marchesi, and Roberto Tonelli. 2016. Estimating Story Points from Issue Reports. In Proceedings of the International Conference on Predictive Models and Data Analytics in Software Engineering. 2:1–2:10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  98. Hosahalli Mahalingappa Premalatha and Chimanahalli Venkateshavittalachar Srikrishna. 2019. Effort estimation in agile software development using evolutionary cost-sensitive deep belief network. International Journal of Information Technology 12, 2(2019), 261–269.Google ScholarGoogle Scholar
  99. NV Prykhodko and SB Prykhodko. 2019. A multiple non-linear regression model to estimate the agile testing efforts for small web projects. Radio Electronics, Computer Science, Control2 (2019), 158–166.Google ScholarGoogle Scholar
  100. Melvina Autar Ramessur and Soulakshmee Devi Nagowah. 2021. A predictive model to estimate effort in a sprint using machine learning techniques. International Journal of Information Technology 13, 3(2021), 1101–1110.Google ScholarGoogle ScholarCross RefCross Ref
  101. Atef Tayh Raslan and Nagy Ramadan Darwish. 2018. An Enhanced Framework for Effort Estimation of Agile Projects. International Journal of Intelligent Engineering and Systems 11, 3(2018), 205–214.Google ScholarGoogle ScholarCross RefCross Ref
  102. Eduardo Rodríguez Sánchez, Eduardo Filemón Vázquez Santacruz, and Humberto Cervantes Maceda. 2023. Effort and Cost Estimation Using Decision Tree Techniques and Story Points in Agile Software Development. Mathematics 11, 6 (2023), 1477.Google ScholarGoogle ScholarCross RefCross Ref
  103. Paweł Rola and Dorota Kuchta. 2019. Application of fuzzy sets to the expert estimation of Scrum-based projects. Symmetry 11, 8 (2019), 1032.Google ScholarGoogle ScholarCross RefCross Ref
  104. Wilson Rosa, Bradford K Clark, Raymond Madachy, and Barry W Boehm. 2021. Empirical effort and schedule estimation models for agile processes in the US DoD. IEEE Transactions on Software Engineering 48, 8 (2021), 3117–3130.Google ScholarGoogle ScholarDigital LibraryDigital Library
  105. Wilson Rosa and Sara Jardine. 2023. Data-driven agile software cost estimation models for DHS and DoD. Journal of Systems and Software (JSS) 203 (2023), 111739.Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Wilson Rosa, Raymond Madachy, Bradford Clark, and Barry Boehm. 2017. Early Phase Cost Models for Agile Software Processes in the US DoD. In Proceedings of the International Symposium on Empirical Software Engineering and Measurement (ESEM). 30–37.Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. Kenneth S Rubin. 2012. Essential Scrum: A Practical Guide to the Most Popular Agile Process.Google ScholarGoogle ScholarDigital LibraryDigital Library
  108. Zaineb Sakhrawi, Asma Sellami, and Nadia Bouassida. 2021. Support vector regression for enhancement effort prediction of Scrum projects from COSMIC functional size. Innovations in Systems and Software Engineering (2021), 1–17.Google ScholarGoogle Scholar
  109. Zaineb Sakhrawi, Asma Sellami, and Nadia Bouassida. 2022. Software enhancement effort estimation using stacking ensemble model within the scrum projects: a proposed web interface. In Proceedings of the International Conference on Software Technologies (ICSOFT). 91–100.Google ScholarGoogle ScholarCross RefCross Ref
  110. Eduardo Rodríguez Sánchez, Humberto Cervantes Maceda, and Eduardo Vazquez Santacruz. 2022. Software effort estimation for Agile Software Development using a strategy based on K-nearest neighbors algorithm. In IEEE Mexican International Conference on Computer Science (ENC). 1–6.Google ScholarGoogle ScholarCross RefCross Ref
  111. RC Sandeep, Mary Sánchez-Gordón, Ricardo Colomo-Palacios, and Monica Kristiansen. 2022. Effort Estimation in Agile Software Development: A Exploratory Study of Practitioners’ Perspective. In Proceedings of the International Conference on Lean and Agile Software Development. 136–149.Google ScholarGoogle ScholarCross RefCross Ref
  112. Shashank Mouli Satapathy, Aditi Panda, and Santanu Rath. 2014. Story Point Approach based Agile Software Effort Estimation using Various SVR Kernel Methods. Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE 2014.Google ScholarGoogle Scholar
  113. Ezequiel Scott and Dietmar Pfahl. 2018. Using Developers’ Features to Estimate Story Points. In Proceedings of the International Conference on Software and System Process. 106–110.Google ScholarGoogle Scholar
  114. Amrita Sharma and Neha Chaudhary. 2020. Linear regression model for agile software development effort estimation. In Proceedings of the International Conference on Recent Advances and Innovations in Engineering. 1–4.Google ScholarGoogle ScholarCross RefCross Ref
  115. Amrita Sharma and Neha Chaudhary. 2022. The combined model for software development effort estimation using polynomial regression for heterogeneous projects. Radioelectronic and computer systems2 (2022), 75–82.Google ScholarGoogle Scholar
  116. Pinkashia Sharma and Jaiteg Singh. 2017. Systematic Literature Review on Software Effort Estimation Using Machine Learning Approaches. In Proceedings of the International Conference on Next Generation Computing and Information Systems. 43–47.Google ScholarGoogle ScholarCross RefCross Ref
  117. Prerna Singal, Prabha Sharma, and A Charan Kumari. 2022. Integrating software effort estimation with risk management. International Journal of System Assurance Engineering and Management 13, 5(2022), 2413–2428.Google ScholarGoogle ScholarCross RefCross Ref
  118. Davide Taibi, Valentina Lenarduzzi, Philipp Diebold, and Ilaria Lunesu. 2017. Operationalizing the Experience Factory for Effort Estimation in Agile Processes. In Proceedings of the International Conference on Evaluation and Assessment in Software Engineering (EASE). 31–40.Google ScholarGoogle ScholarDigital LibraryDigital Library
  119. Ritesh Tamrakar and Magne Jørgensen. 2012. Does the use of Fibonacci numbers in Planning Poker affect effort estimates?. In Proceedings of the International Conference on Evaluation and Assessment in Software Engineering. 228–232.Google ScholarGoogle ScholarCross RefCross Ref
  120. Binish Tanveer, Anna Maria Vollmer, and Ulf Martin Engel. 2017. Utilizing change impact analysis for effort estimation in agile development. In Proceedings of the Euromicro Conference on Software Engineering and Advanced Applications (SEAA). 430–434.Google ScholarGoogle ScholarCross RefCross Ref
  121. Vali Tawosi, Afnan Al-Subaihin, Rebecca Moussa, and Federica Sarro. 2022. A versatile dataset of agile open source software projects. In Proceedings of the International Conference on Mining Software Repositories (MSR). 707–711.Google ScholarGoogle ScholarDigital LibraryDigital Library
  122. Vali Tawosi, Afnan Al-Subaihin, and Federica Sarro. 2022. Investigating the Effectiveness of Clustering for Story Point Estimation. In Proceedings of the International Conference on Software Analysis, Evolution and Reengineering (SANER). 827–838.Google ScholarGoogle ScholarCross RefCross Ref
  123. Vali Tawosi, Federica Sarro, Alessio Petrozziello, and Mark Harman. 2021. Multi-objective software effort estimation: A replication study. Transactions on Software Engineering (TSE) 48, 8 (2021), 3185–3205.Google ScholarGoogle ScholarDigital LibraryDigital Library
  124. Adam Trendowicz, Jürgen Münch, and Ross Jeffery. 2011. State of the Practice in Software Effort Estimation: A Survey and Literature Review. In Proceedings of the Software Engineering Techniques: Third IFIP TC 2 Central and East European Conference (CEE-SET). 232–245.Google ScholarGoogle ScholarCross RefCross Ref
  125. Muhammad Usman, Jürgen Börstler, and Kai Petersen. 2017. An Effort Estimation Taxonomy for Agile Software Development. International Journal of Software Engineering and Knowledge Engineering (IJSEKE) 27, 4 (2017), 641–674.Google ScholarGoogle ScholarCross RefCross Ref
  126. Muhammad Usman, Ricardo Britto, Lars-Ola Damm, and Jürgen Börstler. 2018. Effort estimation in large-scale software development: An industrial case study. Information and Software Technology (IST) 99 (2018), 21–40.Google ScholarGoogle ScholarDigital LibraryDigital Library
  127. Muhammad Usman, Emilia Mendes, and Jürgen Börstler. 2015. Effort Estimation in Agile Software Development: A Survey on the State of the Practice. In Proceedings of the International Conference on Evaluation and Assessment in Software Engineering (EASE). 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  128. Muhammad Usman, Emilia Mendes, Francila Weidt, and Ricardo Britto. 2014. Effort Estimation in Agile Software Development: A Systematic Literature Review. In Proceedings of the International Conference on Predictive Models in Software Engineering. 82–91.Google ScholarGoogle ScholarDigital LibraryDigital Library
  129. Muhammad Usman, Kai Petersen, Jürgen Börstler, and Pedro Santos Neto. 2018. Developing and using checklists to improve software effort estimation: A multi-case study. Journal of Systems and Software (JSS) 146 (2018), 286–309.Google ScholarGoogle ScholarCross RefCross Ref
  130. Antonio Vetro, Rupert Dürre, Marco Conoscenti, Daniel Méndez Fernández, and Magne Jørgensen. 2018. Combining Data Analytics with Team Feedback to Improve the Estimation Process in Agile Software Development. Foundations of Computing and Decision Sciences 43, 4 (2018), 305–334.Google ScholarGoogle ScholarCross RefCross Ref
  131. Jianfeng Wen, Shixian Li, Zhiyong Lin, Yong Hu, and Changqin Huang. 2012. Systematic literature review of machine learning based software development effort estimation models. Information and Software Technology (IST) 54, 1 (2012), 41–59.Google ScholarGoogle ScholarDigital LibraryDigital Library
  132. Ewelina Wińska, Estera Kot, and Włodzimierz Dąbrowski. 2021. Reducing the uncertainty of agile software development using a random forest classification algorithm. In International Conference on Lean and Agile Software Development. Springer, 145–155.Google ScholarGoogle ScholarCross RefCross Ref
  133. Shahid Kamal Tipu Ziauddin and Shahrukh Zia. 2012. An Effort Estimation Model for Agile Software Development. Advances in computer science and its applications 2, 1(2012), 314–324.Google ScholarGoogle Scholar
  134. Thomas Zimmermann, Rahul Premraj, Nicolas Bettenburg, Sascha Just, Adrian Schroter, and Cathrin Weiss. 2010. What Makes a Good Bug Report?Transactions of Software Engineering (TSE) 36, 5 (2010), 618–643.Google ScholarGoogle Scholar

Index Terms

  1. A Systematic Literature Review on Reasons and Approaches for Accurate Effort Estimations in Agile

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Computing Surveys
      ACM Computing Surveys Just Accepted
      ISSN:0360-0300
      EISSN:1557-7341
      Table of Contents

      Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Online AM: 1 May 2024
      • Accepted: 24 April 2024
      • Revised: 15 April 2024
      • Received: 17 October 2022

      Check for updates

      Qualifiers

      • survey
    • Article Metrics

      • Downloads (Last 12 months)79
      • Downloads (Last 6 weeks)79

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader