Sustainability assessment on the campus of a higher education institution using the Analytical Hierarchy Process (AHP)
Published 2025-01-30
Keywords
- Sustainability Management, Higher Education Institutions, Evaluation Capacity Buiding, Analytic Hierarchy Process.
How to Cite
Copyright (c) 2025 Maricela Cuellar-Orozco, Valentín Buján Tinoco, Armando Cuellar-Orozco, Julián Patiño-Ortiz, Miguel Patiño-Ortiz

This work is licensed under a Creative Commons Attribution 4.0 International License.
Abstract
Higher Education Institutions (IES) play a fundamental role in implementing sustainable development practices by promoting the development of green campus. This implementation must use a systemic approach that allows the definition of representative dimensions. Different tools that allow evaluation with an integrated vision have been considered and used, as well as incorporating key components in the evaluation through the Evaluation Capacity Building (ECB). The objective of the study is to evaluate and compare the implementation of sustainable development that exists on the campus of a Mexican IES. The framework integrates the Delphi method to collect data and AHP for data analysis, both methods seals effective sustainability criteria.The results indicate the possibility of identifying and analyzing the sustainable activities in each campus to manage them and implement new criteria and indicators, the attributes of the ECB perceived as important were performed conveniently, while those perceived with less importance are identified as deficient in their performance, among the findings was found that the main criterion for developing sustainability is the environmental management factor. The study expects to contribute to the use of sustainability evaluation tools as promoters so that IES improve their sustainable performance and the practice of the ECB as an innovative agent that continuously promotes the use of these evaluations.
Downloads
References
- Abdullah, W. S. (2020). Optimizing social sustainability in walkable university campus: A comparison between the old and new campuses of Sulaimani University. Amazonia Investiga, 9(34), 44–56. https://doi.org/10.34069/AI/2020.34.10.5
- Alghamdi, N., den Heijer, A., & de Jonge, H. (2017). Assessment tools’ indicators for sustainability in universities: an analytical overview. International Journal of Sustainability in Higher Education, 18(1), 84-115. https://doi.org/10.1108/IJSHE-04-2015-0071
- Alshehri, S.A., Rezgui, Y., & Li, H. (2015). Disaster community resilience assessment method: a consensus-based Delphi and AHP approach. Natural Hazards, 78, 395–416. https://doi.org/10.1007/s11069-015-1719-5
- Beynaghi, A., Trencher, G., Moztarzadeh, F., Mozafari, M., Maknoon, R., & Leal Filho, W. (2016). Future sustainability scenarios for universities: moving beyond the United Nations Decade of Education for Sustainable Development. Journal of Cleaner Production, 112(4), 3464-3478. https://doi.org/10.1016/j.jclepro.2015.10.117
- Boyle, R., Lemaire, D., & Rist, R. (1999). Introduction: Building Evaluation Capacity. New Brunswick, NJ, Transaction Publishers
- Caeiro, S., Sandoval Hamón, L.A., Martins, R., & Bayas Aldaz, C.E. (2020). Sustainability Assessment and Benchmarking in Higher Education Institutions - A Critical Reflection. Sustainability, 12(2), 543. https://doi.org/10.3390/su12020543
- Calder, W., & Clugston, R.M. (2005). Editorial: Education for a Sustainable Future. Journal of Geography in Higher Education, 29(1), 7-12. https://doi.org/10.1080/03098260500030231
- Ceulemans, K., Molderez, I., & Van Liedekerke, L. (2015). Sustainability reporting in higher education: A comprehensive review of the recent literature and paths for further research. Journal of Cleaner Production, 106, 127-143. https://doi.org/10.1016/j.jclepro.2014.09.052
- Chen S.Q., Lu M.Y., Tan H.W., Luo, X.Y., & Ge, J. (2019). Assessing sustainability on Chinese university campuses: Development of a campus sustainability evaluation system and its application with a case study. Journal of Building Engineering, 24, 100747. https://doi.org/10.1016/j.jobe.2019.100747
- Chen, K.H.J. (2017). Contextual influence on evaluation capacity building in a rapidly changing environment under new governmental policies. Evaluation and Program Planning, 65, 1-11. https://doi.org/10.1016/j.evalprogplan.2017.06.001
- Clark, I. (2012). Formative Assessment: Assessment Is for Self-regulated Learning. Educational Psychology Review, 24(2), 205-249. https://doi.org/10.1007/s10648-011-9191-6
- Cloquell Ballester, V.A., Cloquell-Ballester, V.A., Monterde-Díaz, R., & Santamarina-Siurana, M.C. (2006). Indicators validation for the improvement of environmental and social impact quantitative assessment. Environmental Impact Assessment Review, 26(1), 79-105. https://doi.org/10.1016/j.eiar.2005.06.002
- Cooper, S.M., & Owen, D.L. (2007). Corporate social reporting and stakeholder accountability: the missing link. Accounting, Organizations and Society, 32(7-8), 649-667. https://doi.org/10.1016/j.aos.2007.02.001
- Cortese, A.D. (2003). The Critical Role of Higher Education in Creating a Sustainable Future. Planning for Higher Education, 31(3), 15–22.
- Daub, C.H. (2007). Assessing the quality of sustainability reporting: an alternative methodological approach. Journal of Cleaner Production, 15(1), 75-85. https://doi.org/10.1016/j.jclepro.2005.08.013
- Disterheft, A., Caeiro, S.S., Ramos, M.R., & Azeiteiro, U.M. (2012). Environmental management systems (EMS) implementation processes and practices in European higher education institutions: top-down versus participatory approaches. Journal of Cleaner Production, 31, 80-90. https://doi.org/10.1016/j.jclepro.2012.02.034
- Donnelly, A., Jones, M., O’Mahony, T., & Byrne, G. (2007). Selecting environmental indicator for use in strategic environmental assessment. Environmental Impact Assessment Review, 27, 161-175. https://doi.org/10.1016/j.eiar.2006.10.006
- Dumay, J. (2016). A critical reflection on the future of intellectual capital: From reporting to disclosure. Journal of Intellectual Capital, 17, 168-184. https://doi.org/10.1108/JIC-08-2015-0072
- Fleming, M.L., & Easton, J. (2010). Building environmental educators’ evaluation capacity through distance education. Evaluation and Program Planning, 33(2), 172-177. https://doi.org/10.1016/j.evalprogplan.2009.07.007
- Gamage, P., & Sciulli, N. (2016). Sustainability Reporting by Australian Universities. Australian Journal of Public Administration, 76(2), 187-203. https://doi.org/10.1111/1467-8500.12215
- Gibson, R.B. (2013). Why Sustainability Assessment? In Sustainability Assessment: Pluralism, Practice and Progress. Routledge: New York, NY, USA.
- Hák, T., Janoušková, S., & Moldan, B. (2016). Sustainable development goals: a need for relevant indicators. Ecological Indicators, 60, 565-573. https://doi.org/10.1016/j.ecolind.2015.08.003
- Hokkaido University (2023). Hokkaido University Sustainability Report 2023. Disponible en: https://www.sustainability.hokudai.ac.jp/wp-content/uploads/2023/12/hokudai_sustaina2023A4fix_en.pdf
- Holdsworth, S., & Thomas, I. (2020). Competencies or capabilities in the Australian higher education landscape and its implications for the development and delivery of sustainability education. Higher Education Research & Development, 40(7), 1466-1481. https://doi.org/10.1080/07294360.2020.1830038
- Howlett, C., Ferreira, J.A., & Blomfield, J. (2016). Teaching sustainable development in higher education: Building critical, reflective thinkers through an interdisciplinary approach. International Journal of Sustainability in Higher Education, 17(3), 305-321. https://doi.org/10.1108/IJSHE-07-2014-0102
- Ivanchuk, S., Kakhiani, Y., Hryboiedova, T., Bilychenko, H., & Huzii, I. (2024). Policy for the formation of social consciousness during students training in educational institutions: pedagogical aspect. Amazonia Investiga, 13(73), 387-400. https://doi.org/10.34069/AI/2024.73.01.32
- Julnes, G. (2019). Evaluating sustainability: Controversies, challenges, and opportunities. In G. Julnes (Ed.), Evaluating Sustainability: Evaluative Support for Managing Processes in the Public Interest. New Directions for Evaluation, 162, 13–28. https://doi.org/10.1002/ev.20361
- Kamijo, T., & Huang, G. (2016). Improving the quality of environmental impacts assessment reports: effectiveness of alternatives analysis and public involvement in JICA supported projects. Impact Assessment and Project Appraisal, 34(2), 143-151. https://doi.org/10.1080/14615517.2016.1176402
- Karam, A., Hussein, M., & Reinau, K.H. (2021). Analysis of the barriers to implementing horizontal collaborative transport using a hybrid fuzzy Delphi-AHP approach. Journal of Cleaner Production, 321, 128943. https://doi.org/10.1016/j.jclepro.2021.128943.
- Kim, M., Jang, Y.C., & Lee, S. (2013). Application of Delphi-AHP methods to select the priorities of WEEE for recycling in a waste management decision-making tool. Journal of Environmental Management, 128, 941-948. https://doi.org/10.1016/j.jenvman.2013.06.049
- Klier, S.D., Nawrotzki, R.J., Salas-Rodríguez, N., Harten, S., Keating, C.B., & Katina, P.F. (2022). Grounding evaluation capacity development in systems theory. Evaluation, 28(2), 231-251. https://doi.org/10.1177/13563890221088871
- Leal Filho, W., & Brandli, L. (2016). Engaging Stakeholders in Education for Sustainable Development at University Level. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-26734-0_21
- Leal Filho, W., Skanavis, C., Kounani, A., Londero L.B., Shiel, C., do Paço, A., Pace, P., Mifsud, M., Beynaghi, A., Price, E., Salvia, A.L., Will, M., & Shula, K. (2019). The role of planning in implementing sustainable development in a higher education context. Journal of Cleaner Production, 235, 678-687. https://doi.org/10.1016/j.jclepro.2019.06.322
- Levine, R., Russ-Eft, D., Burling, A., Stephens, J., & Downey, J. (2013). Evaluating health services research capacity building programs: Implications for health services and human resource development. Evaluation and Program Planning, 37, 1-11. https://doi.org/10.1016/j.evalprogplan.2012.12.002
- Lozano, R. (2006a). Incorporation and institutionalization of SD into universities: breaking through barriers to change. Journal of Cleaner Production, 14(9-11), 787-796. https://doi.org/10.1016/j.jclepro.2005.12.010
- Lozano, R. (2006b). Tool for a Graphical Assessment of Sustainability in Universities (GASU). Journal of Cleaner Production, 14(9-11), 963-972. https://doi.org/10.1016/j.jclepro.2005.11.041
- Lozano, R. (2010). Diffusion of sustainable development in universities' curricula: an empirical example from Cardiff University. Journal of Cleaner Production, 18(7), 637-644. https://doi.org/10.1016/j.jclepro.2009.07.005
- Lozano, R. (2011). The state of sustainability reporting in universities. International Journal for Sustainability in Higher Education, 12(1), 67-78. https://doi.org/10.1108/14676371111098311
- Lozano, R., Lukman, R., Lozano, F.J., Huisingh, D., & Lambrechts, W. (2013). Declarations for sustainability in higher education: becoming better leaders, through addressing the university system. Journal of Cleaner Production, 48, 10-19. https://doi.org/10.1016/j.jclepro.2011.10.006
- Mahato, S., Machtmes, K., & Cohen, B. (2022). Leveraging Mixed Methods Designs for Promoting Evaluation and Evaluation Capacity Building. Canadian Journal of Program Evaluation, 36(3), 365-375. https://doi.org/10.3138/cjpe.71288
- Mascarenhas, A., Nunes, L.M., & Ramos, T.B. (2015). Selection of sustainability indicators for planning: Combining stakeholders’ participation and data reduction techniques. Journal of Cleaner Production, 92, 295–307. https://doi.org/10.1016/j.jclepro.2015.01.005
- Menon S., & Suresh, M. (2022). Development of assessment framework for environmental sustainability in higher education institutions. International Journal of Sustainability in Higher Education, 23(7), 1445-1468. https://doi.org/10.1108/IJSHE-07-2021-0310
- Milstein, B., & Cotton, D. (2000). Defining concepts for the presidential strand on building evaluation capacity. Fairhaven, MA: American Evaluation Association
- Milstein, B., Chapel, T.J., Wetterhall, S.F., & Cotton, D.A. (2002). Building capacity for program evaluation at the Centers for Disease Control and Prevention. New Directions for Evaluation, (93), 27-46. https://doi.org/10.1002/ev.40
- Min, J.C.H. (2016). Guiding the guides: Developing indicators of tour guides’ service quality. Total Quality Management & Business Excellence, 27(910), 1043–1062. https://doi.org/10.1080/ 14783363.2015.1060123
- Mischen, P. A., Homsy, G. C., Lipo, C. P., Holahan, R., Imbruce, V., Pape, A., Zhu, W., Graney, J., Zhang, Z., Holmes, L. M., & Reina, M. (2019). A Foundation for Measuring Community Sustainability. Sustainability, 11(7), 1903. https://doi.org/10.3390/su11071903
- Mokski, E., Leal Filho, W., Sehnem, S., & Andrade Guerra, J.B.S.O.D. (2023). Education for sustainable development in higher education institutions: an approach for effective interdisciplinarity. International Journal of Sustainability in Higher Education, 24(1), 96-117. https://doi.org/10.1108/IJSHE-07-2021-0306
- Montreal University (2020). Sustainable development at l’Université de Montréal, Strategic Plan 2021-2023, transition to sustainable campuses. Disponible en: https://www.umontreal.ca/public/www/images/developpement-durable/ANG_UdeM_Sunstainability_strategy.pdf
- Mori, K., & Christodoulou, A. (2012). Review of sustainability indices and indicators: to- wards a new City Sustainability Index (CSI). Environmental Impact Assessment Review, 32(1), 94-106. https://doi.org/10.1016/j.eiar.2011.06.001
- Naccarella, L., Pirkis, J., Kohn, F., Morley, B., Burgess, P., & Blashki, G. (2007). Building evaluation capacity: Definitional and practical implications for an Australian case study. Evaluation and Program Planning, 30(3), 231–236. https://doi.org/10.1016/j.evalprogplan.2007.05.001
- Niedlich, S., Kummer, B., Bauer, M., Rieckmann, M., & Bormann, I. (2020). Cultures of sustainability governance in higher education institutions: A multi-case study of dimensions and implications. Higher Education Quarterly, 74(4), 373-390. https://doi.org/10.1111/hequ.12237
- Preskill, H., & Boyle, S. (2008). A Multidisciplinary Model of Evaluation Capacity Building. American Journal of Evaluation, 29(4), 443-459. https://doi.org/10.1177/1098214008324182
- Promentillaa, M.A.B., Avisoa, K.B., Lucas, R.I.G., Razona, L.F., & Tana, R.R. (2018). Teaching Analytic Hierarchy Process (AHP) in undergraduate chemical engineering courses. Education for Chemical Engineers, 23, 34-41. https://doi.org/10.1016/j.ece.2018.05.002
- Rossa, T., & Mischen, P. (2022). Measuring the impact of organizational characteristics on the sustainability performance of US institutions of higher education. International Journal of Sustainability in Higher Education, 23(7) 1543-1559. https://doi.org/10.1108/IJSHE-08-2021-0355
- Ruggerio, C.A. (2021). Sustainability and sustainable development: A review of principles and definitions. Science of The Total Environment, 786, 147481. https://doi.org/10.1016/j.scitotenv.2021.147481
- Saaty, T.L. (1977). A Scaling Method for Priorities in Hierarchical Structures. Journal of Mathematical Psychology, 15(3), 234-281.
- Sayed, A., Kamal M.D., & Asmuss, M. (2013). Benchmarking tools for assessing and tracking sustainability in higher educational institutions: Identifying an effective tool for the University of Saskatchewan. International Journal of Sustainability in Higher Education, 4(4), 449-465. https://doi.org/10.1108/IJSHE-08-2011-0052
- SEP (2023). Quinto Informe de Labores. DGPPYEE-SEP, México. Disponible en: https://www.planeacion.sep.gob.mx/Doc/informes/labores/2018-2024/5to_informe_de_labores.pdf
- Shriberg, M. (2002). Institutional assessment tools for sustainability in higher education: strengths, weaknesses, and implications for practice and theory. International Journal of Sustainability in Higher Education, 3(3), 254-270. https://doi.org/10.1108/14676370210434714
- Shuqin, C., Minyan, L., Hongwei, T., Xiaoyu, L., & Jian, G. (2019). Assessing sustainability on Chinese university campuses: Development of a campus sustainability evaluation system and its application with a case study. Journal of Building Engineering, 24, 100747. https://doi.org/10.1016/j.jobe.2019.100747
- Stephens, J.C., Hernandez, M.E., Román, M., Graham, A.C., & Scholz, R.W. (2008). Higher education as a change agent for sustainability in different cultures and contexts. International Journal of Sustainability in Higher Education, 9(3), 317-338. https://doi.org/10.1108/14676370810885916
- Sutter, A., Rondeau, M., Kaminska, K., Desforges, S., Betzer, S., & Tremblay, M. (2024). Developing Evaluation Capacity Building Competencies: Participant Reflections From the Evaluation Capacity Case Challenge. Canadian Journal of Program Evaluation, 38(3), 532–541. https://doi.org/10.3138/cjpe-2024-0004
- Tan, H., Chen, S., Shi, Q., & Wang, L. (2014). Development of green campus in China. Journal of Cleaner Production, 64, 646-653. https://doi.org/10.1016/j.jclepro.2013.10.019
- Turcu, C. (2013). Re-thinking sustainability indicators: local perspectives of urban sustainability. Journal of Environmental Planning and Management, 56(5), 695-719. https://doi.org/10.1080/09640568.2012.698984
- Van Nguyen, T.A., Tucek, D., & Pham, N.T. (2023). Indicators for TQM 4.0 model: Delphi Method and Analytic Hierarchy Process (AHP) analysis. Total Quality Management & Business Excellence, 34, 1-2, 220-234. https://doi.org/10.1080/14783363.2022.2039062
- Verma, P., & Raghubanshi, A.S. (2018). Urban sustainability indicators: Challenges and opportunities. Ecological Indicators, 93, 282-291. https://doi.org/10.1016/j.ecolind.2018.05.007.
- Wade, J., & Kallemeyn, L. (2020). Evaluation capacity building (ECB) interventions and the development of sustainable evaluation practice: An exploratory study. Evaluation and Program Planning, 79, 101777. https://doi.org/10.1016/j.evalprogplan.2019.101777
- Whitaker, R. (2007). Validation examples of the Analytic Hierarchy Process and Analytic Network Process. Mathematical and Computer Modelling, 46(7–8), v840-859. https://doi.org/10.1016/j.mcm.2007.03.018.
- Windt, Y., & Saaty, T.L. (1980). Marketing applicatons of the analytic hierarchy process. Management science, 26(7), 641-648.
- Wu, Y.Y., & Ma, H.W. (2019). Challenges for Integrating Strategic Environmental Assessment to Enhance Environmental Thinking: A Case Study of Taiwan Energy Policy. Sustainability, 11(3), 609. https://doi.org/10.3390/su11030609
- Zhang, X., & Lam, J.S.L. (2019). A fuzzy Delphi-AHP-TOPSIS framework to identify barriers in big data analytics adoption: case of maritime organizations. Maritime Policy & Management, 46(7), 781-801. https://doi.org/10.1080/03088839.2019.1628318