There is a need for accurate climate model simulations to understand climate change and its socioeconomic implications. The main objective of this study was to evaluate the performance of twenty global climate models from Coupled Model Intercomparison Project Phase 6 (CMIP6) over Ethiopia. Enhancing National Climate Services (ENACTS) and Climate models rainfall data from 1981 to 2014 were utilized for model performance evaluation in this study. The performances of the models were evaluated with statistical metrics of Correlation Coefficient (CC), Root Mean Square Error (RMSE), and Percent Bias (PBIAS). The findings of this study indicated that most models had similar trends with the ENACTS. Among twenty climate models, six models such as ACCESS-ESM1-5, CanESM5, CNRM-ESM2-1, MPI-ESM1-2-LR, NorCPM1, and SAM0_UNICON underestimated the rainfall. Based on the statistical metrics values of correlation coefficient (CC), MPI-ESM1-2-LR (0.99), BCC-CSM2-MR (0.98), MIROC-ES2L (0.96), NorESM2-MM (0.96), and EC_Earth3_CC (0.96) are best performing models. For all models but IITM-ESM and MRI-ESM2-0, RMSE values were below 5 mm and PBIAS values were within a desirable range (-3.94 to 4.3). These results underscore the importance of selecting appropriate models for evaluating climate impacts, particularly for extreme rainfall events over Ethiopia.
Published in | International Journal of Atmospheric and Oceanic Sciences (Volume 9, Issue 2) |
DOI | 10.11648/j.ijaos.20250902.13 |
Page(s) | 99-111 |
Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
Copyright |
Copyright © The Author(s), 2025. Published by Science Publishing Group |
Annual and Monthly Rainfall, CMIP6, Model Evaluation, Ethiopia
No | Climate Model | Resolution | Institution | Country |
---|---|---|---|---|
1 | ACCESS-CM2 | 1.875° x 1.25° | CSIRO | Australia |
2 | BCC-CSM2-MR | 1.13° x 1.13° | BBC | China |
3 | CanESM5 | 2.8° x 2.8° | CCCma | Canada |
4 | CESM2_WACCM | 1.3 °x 0.9° | CESM2/WACCM | USA |
5 | CMCC_CM2_SR5 | 1.25° x 0.9° | CMCC | Italy |
6 | CMCC-CM2-HR4 | 1.25° x 0.94° | CMCC | Italy |
7 | CNRM-ESM2-1 | 1.4° x 1.4° | CNRM/CERFACS | France |
8 | EC_Earth3_CC | 0.7° x 0.7° | EC-Earth | Europe |
9 | GFDL-ESM4 | 1.25° x 1.00° | NOAA-GFDL | USA |
10 | HadGEM3-GC31-MM | 0.8° x 0.6° | MOHC | UK |
11 | IITM-ESM | 1.9° x 1.9° | IITM | Indian |
12 | INM_CM4_8 | 2.0° x 1.5° | INM | Russia |
13 | INM-CM5-0 | 2.0° x 1.5° | INM | Russia |
14 | MIROC-ES2L | 2.8 °x 2.8° | MIROC | Japan |
15 | MPI-ESM1-2-LR | 1.9° x 1.9° | MPI-M | Germany |
16 | MRI-ESM2-0 | 1.13° x 1.13° | MRI | Japan |
17 | NorCPM1 | 2.5° x 1.9° | NorCPM | Norway |
18 | NorESM2-MM | 1.25° x 0.94° | NCC | Norway |
19 | SAM0_UNICON | 0.8° x 0.5° | SNU | Korea |
20 | TaiESM1 | 1.25° x 0.94° | CcliCS | Taiwan |
Statistics | Formula | Range | Unit | Perfect Score |
---|---|---|---|---|
Root Mean Square Error |
| 0-∞ | mm | 0 |
Correlation Coefficient |
| -1 to +1 | mm | +1 |
Percent of Bias |
| 0 | % | 0 |
CMIP6 | Monthly Mean | Correl (-) | Rank (Correl (-)) | RMSE | Rank (RMSE) | PBIAS | Rank (PBIAS) |
---|---|---|---|---|---|---|---|
ENACTS | 81.5 | - | - | - | - | - | - |
ACCESS-CM2 | 53.4 | 0.84 | 16 | 2.75 | 7 | 3.76 | 2 |
BCC-CSM2-MR | 101.2 | 0.98 | 2 | 1.89 | 15 | -0.58 | 14 |
CanESM5 | 74.3 | 0.89 | 15 | 3.35 | 5 | 2.98 | 4 |
CESM2_WACCM | 108.0 | 0.90 | 14 | 0.81 | 20 | 0.10 | 13 |
CMCC_CM2_SR5 | 100.2 | 0.81 | 17 | 3.86 | 3 | 1.43 | 9 |
CMCC-CM2-HR4 | 85.0 | 0.76 | 18 | 2.21 | 14 | 3.41 | 3 |
CNRM-ESM2-1 | 48.7 | 0.63 | 19 | 1.41 | 17 | 2.42 | 7 |
EC_Earth3_CC | 89.7 | 0.96 | 5 | 3.01 | 6 | 4.30 | 1 |
GFDL-ESM4 | 95.8 | 0.94 | 6 | 1.13 | 19 | 1.58 | 8 |
HadGEM3-GC31-MM | 93.9 | 0.91 | 10 | 2.67 | 10 | -0.62 | 15 |
IITM-ESM | 90.0 | 0.94 | 7 | 15.51 | 1 | -3.94 | 20 |
INM_CM4_8 | 107.8 | 0.91 | 9 | 1.68 | 16 | -0.74 | 18 |
INM-CM5-0 | 93.9 | 0.91 | 10 | 2.67 | 10 | -0.62 | 15 |
MIROC-ES2L | 98.9 | 0.96 | 3 | 2.75 | 8 | 0.86 | 10 |
MPI-ESM1-2-LR | 61.3 | 0.99 | 1 | 2.40 | 13 | 2.57 | 6 |
MRI-ESM2-0 | 113.3 | 0.93 | 8 | 9.15 | 2 | -3.01 | 19 |
NorCPM1 | 78.6 | 0.62 | 20 | 1.30 | 18 | 0.69 | 12 |
NorESM2-MM | 98.9 | 0.96 | 3 | 2.75 | 8 | 0.86 | 10 |
SAM0_UNICON | 70.6 | 0.90 | 13 | 3.48 | 4 | 2.62 | 5 |
TaiESM1 | 93.9 | 0.91 | 10 | 2.67 | 10 | -0.62 | 15 |
ENACTS | Enhancing National Climate Services |
GCMs | Global Climate Models |
CMIP5/6 | Coupled Model Intercomparison Project Phase Five/Six |
EMI | Ethiopian Meteorology Institute |
CHIRPS | Climate Hazards Group InfraRed Precipitation with Station Data |
GPCC | Global Precipitation Climatology Centre |
[1] | D. Tadesse, “The impact of climate change in Africa,” Inst. Secur. Stud. Ser., vol. 220, no. November, p. 20, 2010, Available: |
[2] | B. Ayugi et al., “Comparison of CMIP6 and CMIP5 models in simulating mean and extreme precipitation over East Africa,” Int. J. Climatol., vol. 41, no. 15, pp. 6474-6496, 2021. |
[3] | V. Ongoma and H. Chen, “Temporal and spatial variability of temperature and precipitation over East Africa from 1951 to 2010,” Meteorol. Atmos. Phys., vol. 129, pp. 131-144, 2017. |
[4] | R. McSweeney and Z. Hausfather, “Q&A: How do climate models work?,” Carbon Br., vol. 15, 2018. |
[5] | R. L. Wilby, “Evaluating climate model outputs for hydrological applications,” Hydrol. Sci. Journal-Journal des Sci. Hydrol., vol. 55, no. 7, pp. 1090-1093, 2010. |
[6] | A. F. Lutz, H. W. ter Maat, H. Biemans, A. B. Shrestha, P. Wester, and W. W. Immerzeel, “Selecting representative climate models for climate change impact studies: an advanced envelope-based selection approach,” Int. J. Climatol., vol. 36, no. 12, pp. 3988-4005, 2016, |
[7] | X. Fan, Q. Duan, C. Shen, Y. Wu, and C. Xing, “Evaluation of historical CMIP6 model simulations and future projections of temperature over the Pan-Third Pole region,” Environ. Sci. Pollut. Res., vol. 29, no. 18, pp. 26214-26229, 2022, |
[8] | T. H. Alemseged and R. Tom, “Evaluation of regional climate model simulations of rainfall over the Upper Blue Nile basin,” Atmos. Res., vol. 161-162, pp. 57-64, 2015, |
[9] | A. E. Amognehegn, A. B. Nigussie, D. W. Ayalew, F. F. Abera, and M. Ayana, “Evaluating climate change impact on the hydrology of Kessie Watershed, Upper Blue Nile Basin, Ethiopia,” Appl. Water Sci., vol. 13, no. 7, pp. 1-20, 2023, |
[10] | B. T. Yersaw, M. B. Chane, and N. A. Yitayew, “Performance evaluation of varies climate models using observed and regional climate models for the Katar Watershed, Ethiopia,” Environ. Syst. Res., vol. 13, no. 1, 2024, |
[11] | S. Illangasingha, T. Koike, M. Rasmy, K. Tamakawa, H. Matsuki, and H. Selvarajah, “A holistic approach for using global climate model (GCM) outputs in decision making,” J. Hydrol., vol. 626, no. PB, p. 130213, 2023, |
[12] | E. K. Siabi et al., “Assessment of Shared Socioeconomic Pathway (SSP) climate scenarios and its impacts on the Greater Accra region,” Urban Clim., vol. 49, 2023, |
[13] | S. Kim et al., “PubChem 2023 update,” Nucleic Acids Res., vol. 51, no. D1, pp. D1373-D1380, 2023, |
[14] | A. Dosio et al., “Projected future daily characteristics of African precipitation based on global (CMIP5, CMIP6) and regional (CORDEX, CORDEX-CORE) climate models,” Clim. Dyn., vol. 57, no. 11-12, pp. 3135-3158, 2021, |
[15] | S. Giorgi, M. Lavagna, K. Wang, M. Osmani, G. Liu, and A. Campioli, “Drivers and barriers towards circular economy in the building sector: Stakeholder interviews and analysis of five european countries policies and practices,” J. Clean. Prod., vol. 336, no. January, 2022, |
[16] | J. Lohmann, D. Castellana, P. D. Ditlevsen, and H. A. Dijkstra, “Abrupt climate change as a rate-dependent cascading tipping point,” Earth Syst. Dyn., vol. 12, no. 3, pp. 819-835, 2021, |
[17] | S. H. Gebrechorkos, M. T. Taye, B. Birhanu, D. Solomon, and T. Demissie, “Future Changes in Climate and Hydroclimate Extremes in East Africa,” Earth’s Futur., vol. 11, no. 2, pp. 1-21, 2023, |
[18] | P. O. Omay, N. J. Muthama, C. Oludhe, J. M. Kinama, G. Artan, and Z. Atheru, “Evaluation of CMIP6 historical simulations over IGAD region of Eastern Africa,” Discov. Environ., vol. 1, no. 1, 2023, |
[19] | S. Pradhananga, A. Lutz, A. Shrestha, I. Kadel, B. Nepal, and S. Nepal, “Selection and downscaling of general circulation model datasets and extreme climate indices analysis,” Int. Cent. Integr. Mt. Dev., 2020. |
[20] | D. Fenta Mekonnen and M. Disse, “Analyzing the future climate change of Upper Blue Nile River basin using statistical downscaling techniques,” Hydrol. Earth Syst. Sci., vol. 22, no. 4, pp. 2391-2408, 2018. |
[21] | Z. T. Segele, M. Leslie, and P. J. Lamb, “Evaluation and adaptation of a regional climate model for the Horn of Africa : rainfall climatology and interannual,” no. August 2024, 2009, |
[22] | C. Funk et al., “The climate hazards infrared precipitation with stations - A new environmental record for monitoring extremes,” Sci. Data, vol. 2, pp. 1-21, 2015, |
[23] | E. Viste, D. Korecha, and A. Sorteberg, “Recent drought and precipitation tendencies in Ethiopia,” Theor. Appl. Climatol., vol. 112, no. 3-4, pp. 535-551, 2013, |
[24] | S. H. Gebrechorkos, S. Hülsmann, and C. Bernhofer, “Regional climate projections for impact assessment studies in East Africa,” Environ. Res. Lett., vol. 14, no. 4, 2019, |
[25] | S. Alemayehu, D. Olago, O. Alfred, T. T. Zeleke, and S. W. Dejene, “Spatiotemporal analysis of rainfall and temperature variability and trends for a mixed crop-livestock production system: its implications for developing adaptation strategies,” Int. J. Clim. Chang. Strateg. Manag., pp. 268-290, 2024, |
APA Style
Mekonnen, E. F., Wasihun, E. W. (2025). Evaluation of Coupled Model Intercomparison Project Phase 6 (CMIP6) Model Capability to Predict Rainfall over Ethiopia. International Journal of Atmospheric and Oceanic Sciences, 9(2), 99-111. https://doi.org/10.11648/j.ijaos.20250902.13
ACS Style
Mekonnen, E. F.; Wasihun, E. W. Evaluation of Coupled Model Intercomparison Project Phase 6 (CMIP6) Model Capability to Predict Rainfall over Ethiopia. Int. J. Atmos. Oceanic Sci. 2025, 9(2), 99-111. doi: 10.11648/j.ijaos.20250902.13
AMA Style
Mekonnen EF, Wasihun EW. Evaluation of Coupled Model Intercomparison Project Phase 6 (CMIP6) Model Capability to Predict Rainfall over Ethiopia. Int J Atmos Oceanic Sci. 2025;9(2):99-111. doi: 10.11648/j.ijaos.20250902.13
@article{10.11648/j.ijaos.20250902.13, author = {Elias Fiseha Mekonnen and Endalamaw Wende Wasihun}, title = {Evaluation of Coupled Model Intercomparison Project Phase 6 (CMIP6) Model Capability to Predict Rainfall over Ethiopia }, journal = {International Journal of Atmospheric and Oceanic Sciences}, volume = {9}, number = {2}, pages = {99-111}, doi = {10.11648/j.ijaos.20250902.13}, url = {https://doi.org/10.11648/j.ijaos.20250902.13}, eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ijaos.20250902.13}, abstract = {There is a need for accurate climate model simulations to understand climate change and its socioeconomic implications. The main objective of this study was to evaluate the performance of twenty global climate models from Coupled Model Intercomparison Project Phase 6 (CMIP6) over Ethiopia. Enhancing National Climate Services (ENACTS) and Climate models rainfall data from 1981 to 2014 were utilized for model performance evaluation in this study. The performances of the models were evaluated with statistical metrics of Correlation Coefficient (CC), Root Mean Square Error (RMSE), and Percent Bias (PBIAS). The findings of this study indicated that most models had similar trends with the ENACTS. Among twenty climate models, six models such as ACCESS-ESM1-5, CanESM5, CNRM-ESM2-1, MPI-ESM1-2-LR, NorCPM1, and SAM0_UNICON underestimated the rainfall. Based on the statistical metrics values of correlation coefficient (CC), MPI-ESM1-2-LR (0.99), BCC-CSM2-MR (0.98), MIROC-ES2L (0.96), NorESM2-MM (0.96), and EC_Earth3_CC (0.96) are best performing models. For all models but IITM-ESM and MRI-ESM2-0, RMSE values were below 5 mm and PBIAS values were within a desirable range (-3.94 to 4.3). These results underscore the importance of selecting appropriate models for evaluating climate impacts, particularly for extreme rainfall events over Ethiopia.}, year = {2025} }
TY - JOUR T1 - Evaluation of Coupled Model Intercomparison Project Phase 6 (CMIP6) Model Capability to Predict Rainfall over Ethiopia AU - Elias Fiseha Mekonnen AU - Endalamaw Wende Wasihun Y1 - 2025/08/13 PY - 2025 N1 - https://doi.org/10.11648/j.ijaos.20250902.13 DO - 10.11648/j.ijaos.20250902.13 T2 - International Journal of Atmospheric and Oceanic Sciences JF - International Journal of Atmospheric and Oceanic Sciences JO - International Journal of Atmospheric and Oceanic Sciences SP - 99 EP - 111 PB - Science Publishing Group SN - 2640-1150 UR - https://doi.org/10.11648/j.ijaos.20250902.13 AB - There is a need for accurate climate model simulations to understand climate change and its socioeconomic implications. The main objective of this study was to evaluate the performance of twenty global climate models from Coupled Model Intercomparison Project Phase 6 (CMIP6) over Ethiopia. Enhancing National Climate Services (ENACTS) and Climate models rainfall data from 1981 to 2014 were utilized for model performance evaluation in this study. The performances of the models were evaluated with statistical metrics of Correlation Coefficient (CC), Root Mean Square Error (RMSE), and Percent Bias (PBIAS). The findings of this study indicated that most models had similar trends with the ENACTS. Among twenty climate models, six models such as ACCESS-ESM1-5, CanESM5, CNRM-ESM2-1, MPI-ESM1-2-LR, NorCPM1, and SAM0_UNICON underestimated the rainfall. Based on the statistical metrics values of correlation coefficient (CC), MPI-ESM1-2-LR (0.99), BCC-CSM2-MR (0.98), MIROC-ES2L (0.96), NorESM2-MM (0.96), and EC_Earth3_CC (0.96) are best performing models. For all models but IITM-ESM and MRI-ESM2-0, RMSE values were below 5 mm and PBIAS values were within a desirable range (-3.94 to 4.3). These results underscore the importance of selecting appropriate models for evaluating climate impacts, particularly for extreme rainfall events over Ethiopia. VL - 9 IS - 2 ER -