Reflecting on the Diagnostic Mathematics Information for Student Retention and Success (DMISRS) journey: Key insights into negotiating large-scale collaborative projects
DOI:
https://doi.org/10.38140/pie.v43i4.9198Keywords:
mathematics educators, communities of practice, theory of change, STEM, mathematics, collaborative projectsAbstract
Student retention and success in science, technology, engineering and mathematics (STEM) programmes is particularly poor and important, given the worldwide shortage of these skills. Educational research has advanced our knowledge of effective teaching and learning in undergraduate STEM programmes, leading to innovations to improve the prevailing situation. However, translating these innovations into tangible pedagogical reforms has proven challenging, and many efforts designed to promote change have fallen short of their intended outcomes. Mathematics is often the subject that becomes a barrier to success. While mathematics educators may try to address these issues, they have few opportunities to work collaboratively and to share their experiences in a safe and supportive environment. The Diagnostic Mathematics Information for Student Retention and Success (DMISRS) project’s initial aim was based on a theory of change. A theory of change builds upon the assumption that change is a complex process influenced by multiple internal and external factors to the system under examination and needs to be constantly reviewed. During the project, it became evident that the initial theory of change, while laudable, was not the most appropriate in the given context. The team then adjusted the project to work collaboratively with and through mathematics colleagues at their institutions. In this paper, we reflect on the organic nature of the shaping and reshaping of the DMISRS project. We then review how the project team had to respond to the challenges and navigate the disruptions faced actively. We share our experiences and lessons learnt, which will be relevant to other similar large-scale collaborative projects.
References
Adler, J., Alshwaikh, J., Essack, R. & Gcsamba, L. 2016. Mathematics education research in South Africa 2007–2015: Review and reflection. African Journal of Research in Mathematics, Science and Technology Education, 21: 1-14 https://10.1080/18117295.2016.1265858
Ancona, D. G., & Caldwell, D. F. 1992. Bridging the boundary: External activity and performance in organisational teams. Administrative Science Quarterly, 37(4): 634–665. https://doi.org/10.2307/2393475
Belcher, B.M., Bonaiuti, E. & Thiele, G. 2024. Applying theory of change in research program planning: Lessons from CGIAR. Environmental Science & Policy, 160: 103850. https://doi.org/10.1016/j.envsci.2024.103850
Brady, L. (1988). Collaboration in Curriculum Planning. Sydney, Australia: Prentice Hall.
Case, J., Marshall, D. & Grayson, D. 2013. Mind the gap: Science and engineering education at the secondary–tertiary interface. S Afr J Sci., 109(7/8): 0113. https://doi.org/10.1590/sajs.2013/20120113
Centre for Educational Testing for Access and Placement (CETAP). 2016. National Benchmark Tests Project National Report: 2016 Intake Cycle. Cape Town: Centre for Educational Testing for Access and Placement. https://nbt.ac.za/sites/default/files/NBTPReport_2016.pdf
Connell, J. P., & Kubisch, A. C. (1998). Applying a theory of change approach to the evaluation of comprehensive community initiatives: Progress, prospects, and problems. In K. Fulbright-Anderson, A. C. Kubisch, & J. P. Connell (Eds.), New Approaches to Evaluating Community Initiatives: Theory, Measurement, and Analysis (Vol. 2, pp. 15–44). Aspen Institute.
Council on Higher Education (CHE). 2013. A Proposal for Undergraduate Curriculum Reform in South Africa: The Case for a Flexible Curriculum Structure. http://www.che.ac.za/sites/default/files/publications/Full_Report.pdf
Dahle, L.O., Brynhildsen, J., Behrbohm, F.M., Rundquist, I. & Hammar, M. 2002. Pros and cons of vertical integration between clinical medicine and basic science within a problem-based undergraduate medical curriculum: Examples and experiences from Linköping Sweden. Med Teach, 24: 280-285. https://doi.org/10.1080/01421590220134097
Dailey, R. C. (1978). The relationship between cohesiveness and performance in small groups: A review. Small Group Behavior, 9(4): 458–471. https://doi.org/10.1177/104649647800900404
Department of Higher Education and Training (DHET), Republic of South Africa. 2019. 2000 to 2016 First Time Entering Undergraduate Cohort Studies for Public Higher Education Institutions. Pretoria: Department of Higher Education and Training. http://www.dhet.gov.za/HEMIS/2000%20TO%202016%20FIRST%20TIME%20ENTERING%20UNDERGRADUATE%20COHORT%20STUDIES%20FOR%20PUBLIC%20HEIs.pdf
Eaton, J. S. 1951. Freedom and Responsibility in the American Way of Life. New York, NY: Harper & Brothers.
Engstrom, C. & Tinto, V. 2008. Access without support is not opportunity. Change, 40(1): 46-50. http://ezproxy.uct.ac.za/login?url=https://www.proquest.com/scholarly-journals/access-without-support-is-not-opportunity/docview/208048579/se-2. https://doi.org/10.3200/CHNG.40.1.46-50
Fennell, M. L., & Sandefur, G. D. 1983. Structural characteristics of interdisciplinary research centers and the implications for scientific productivity. Social Studies of Science, 13(1): 101–113. https://doi.org/10.1177/030631283013001005
Fox, M. F., & Faver, C. A. 1982. Independence and cooperation in research: The motivations and costs of collaboration. Journal of Higher Education, 53(5): 623–639. https://doi.org/10.2307/1981603
Fuchs, D. & Fuchs, L.S. 2006. Introduction to response to intervention: What, why, and how valid is it? Reading Research Quarterly, 41(1): 93-99. https://doi.org/10.1598/RRQ.41.1.4
Gillespie, D. F., & Birnbaum, M. L. 1980. Effects of status concordance on the effectiveness of interdisciplinary response teams. Journal of Applied Behavioral Science, 16(1): 45–61. https://doi.org/10.1177/002188638001600107
Goos, M., Carreira, S. & Namukasa, I.K. 2023. Mathematics and interdisciplinary STEM education: Recent developments and future directions. ZDM Mathematics Education, 55: 1199-1217. https://doi.org/10.1007/s11858-023-01533-z
Gray, B. (1989). Collaborating: Finding Common Ground for Multiparty Problems. San Francisco, CA: Jossey-Bass.
Griesel, H. 2006. Access and Entry Level Benchmarks, the National Benchmark Tests Project. Pretoria: Higher Education South Africa. http://www.hesa.org.za/sites/hesa.org.za/files/2006_HESA_Access and Entry Level Benchmarks.pdf
Harris, B.A. 2006. The importance of creating a “sense of community”. Journal of College Student Retention: Research, Theory & Practice, 8(1): 83-105. https://doi.org/10.2190/AMNM-2VKP-V6MH-D1GF
Hughes-Halett, D. 2001. Achieving numeracy: The challenge of implementation, in L.A. Steen (ed.), Mathematics and Democracy: The Case for Quantitative Literacy. USA: The National Council on Education and the Disciplines. pp. 93-98.
Isenberg, J., Jalongo, M. R., & Bromley, K. 1987. Writing for Publication: A Guide for Educators. Newark, DE: International Reading Association.
James, C. 2011. Theory of Change Review: A Report Commissioned by Comic Relief. Comic Relief. https://www.theoryofchange.org/wp-content/uploads/toco_library/pdf/James_ToC.pdf
Kanter, R. M. 1983. The Change Masters: Innovations for Productivity in the American Corporation. New York, NY: Simon & Schuster.
Kristensen, M.A., Larsen, D.M., Seidelin, L. & Svabo, C. 2024. The role of mathematics in STEM activities: Syntheses and a framework from a literature review. International Journal of Education in Mathematics, Science, and Technology (IJEMST), 12(2): 418-431. https://doi.org/10.46328/ijemst.3357
Marton, F. 1975. On non-verbatim learning: 1. Level of processing and level of outcome. Scandinavian Journal of Psychology, 16(1): 273-279. https://doi.org/10.1111/j.1467-9450.1975.tb00193.x
Mintzberg, H. 1994. The Rise and Fall of Strategic Planning: Reconceiving Roles for Planning, Plans, Planners. Free Press.
Morrow, W. 2007. Learning to Teach in South Africa. Cape Town: HSRC Press. http://hdl.handle.net/20.500.11910/6104
Nobel, C. 1986. Collaboration in R&D: Strategic and organisational issues. Research Management, 29(6): 4–9. https://doi.org/10.1080/00345334.1986.11757066
Østergaard, E., Dahlin, B. & Hugo, A. 2008. Doing phenomenology in science education: A research review. Studies in Science Education, 44: 93-121. https://doi.org/10.1080/03057260802264081
Parker, G. M. 1990. Team Players and Teamwork: The New Competitive Business Strategy. San Francisco, CA: Jossey-Bass.
Pelz, D. C., & Andrews, F. M. 1966. Scientists in organisations: Productive Climates for Research and Development. New York, NY: Wiley.
Prince, R. & Simpson, Z. 2021. Do higher education entrance exams predict success in engineering study? Proceedings of the 49th Annual European Society of Engineering Education Conference (SEFI 2021), 13 – 16 September 2021, Berlin, Germany. https://www.sefi.be/wp-content/uploads/2021/12/SEFI49th-Proceedings-final.pdf
Prince, R.N. & Simpson, Z.S. 2024. Understanding the support mechanisms available to first-year mathematics students: A case study from South Africa. Proceedings of the IEEE ProComm Conference (IEEE ProComm 2022).
Reinholz, D.L. & Andrews, T.C. 2020. Change theory and theory of change: What’s the difference anyway? IJ STEM Ed, 7: article 2. https://doi.org/10.1186/s40594-020-0202-3
Scott, I. 1986. Tinkering or transforming? The contribution of academic support programmes to “opening the doors of learning and of culture”. Aspects, 7. Pietermaritzburg: University of Natal.
Scott, I., Yeld, N. & Hendry, J. 2007. Higher Education Monitor No. 6: A case for improving teaching and learning in South African higher education. Pretoria: Council on Higher Education. https://www.che.ac.za/sites/default/files/publications/HE_Monitor_6_ITLS_Oct2007_0.pdf
Seaman, D. F. 1981. Faculty Collaboration: A Developmental Perspective. Washington, DC: Association for the Study of Higher Education.
Shenhar, A. J., & Dvir, D. 2007. Project management research: The challenge and opportunity. Project Management Journal, 38(2): 93–99. https://doi.org/10.1177/875697280703800210
South Africa. (2013). Protection of Personal Information Act 4 of 2013. Government Gazette, 581(37067). Pretoria: Government Printer.
Tomlinson, T. M., Semradek, J., & Boyd, C. 1986. Interdisciplinary collaboration in health education: Issues and strategies. Health Education Quarterly, 13(2): 195–207. https://doi.org/10.1177/109019818601300207
Turner, J. R. 1999. The Handbook of Project-Based Management: Improving the Processes for Achieving Strategic Objectives (2nd ed.). McGraw-Hill.
Venkat, H., Adler, J., Rollnick, M., Setati, M. & Vhurumuku, E. 2009. Mathematics and science education research, policy and practice in South Africa: What are the relationships? African Journal of Research in Mathematics, Science and Technology Education, 13 (special issue): 5-27. https://doi.org/10.1080/10288457.2009.10740659
Vogel, I. 2012. Review of the use of ‘Theory of Change’ in international development. UK Department for International Development. https://capacity4dev.europa.eu/library/review-use-theory-change-international-development-dfid-2012_en
Wagenschein, M. (ed.). 1990. Kinder Auf Dem Wege zur Physik [Children on Their Way towards Physics]. Weinheim, Germany and Basel, Switzerland: Beltz Verlag.
Wenger, E. 1998. Communities of Practice: Learning, Meaning and Identity. Cambridge, UK: Cambridge University Press. https://doi.org/10.1017/CBO9780511803932
Wheelwright, S. C., & Clark, K. B. 1992. Revolutionising Product Development: Quantum Leaps in Speed, Efficiency, and Quality. Free Press.
Weiss, C. H. (1995). Nothing as practical as good theory: Exploring theory-based evaluation for comprehensive community initiatives for children and families. In J. P. Connell, A. C. Kubisch, L. B. Schorr, & C. H. Weiss (Eds.), New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts (Vol. 1, pp. 65–92). Aspen Institute.
Published
Issue
Section
License
Copyright (c) 2025 Dr Robert Prince, Emlyn Balarin
This work is licensed under a Creative Commons Attribution 4.0 International License.
