Volume 31, Issue 1 (Winter 2024)
Intern Med Today 2024, 31(1): 0-0 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Shabani M, darabi F, Nejad-Dadgar N. Development and Evaluation of a Web-Based Monitoring and Evaluation System for a Public Oral Health Program: A Mixed-Methods Study. Intern Med Today 2024; 31 (1)
URL: http://imtj.gmu.ac.ir/article-1-4090-en.html
URL: http://imtj.gmu.ac.ir/article-1-4090-en.html
1- Ph.D. DDS, MSc, Department of Community Dentistry, School of Dentistry, Ardabil University of Medical Sciences, Ardabil, Iran
2- Ph.D., Department of Public Health, Asadabad School of Medical Sciences, Asadabad, Iran
3- Ph.D., Department of Health Education and Health Promotion, School of Health, Ardabil University of Medical Sciences, Ardabil, Iran ,naziladadgar60@gmail.com
2- Ph.D., Department of Public Health, Asadabad School of Medical Sciences, Asadabad, Iran
3- Ph.D., Department of Health Education and Health Promotion, School of Health, Ardabil University of Medical Sciences, Ardabil, Iran ,
Abstract: (4 Views)
Aims: Monitoring and evaluation (M&E) systems are essential for assessing the effectiveness of health programs, yet a comprehensive digital tool based on the chain model is lacking in Iran. The present study aimed to develop and evaluate a web-based M&E system for a public oral health program using a mixed-methods development-and-evaluation approach.
Materials & Methods: The current research employed a mixed-methods development-and-evaluation design. In the first phase, the software was developed based on the Software Development Life Cycle (SDLC), including requirements analysis, system design, development, testing, and deployment. In the second phase, the system was evaluated among 340 users selected from the 1,500 total software users involved in program implementation. Thus, 1,500 is the eligible user population, and 340 is the final analytical sample. Reliability and validity of the satisfaction questionnaire were assessed using Content Validity Ratio, Content Validity Index, Cronbach’s alpha, and Intraclass Correlation Coefficient. Moreover, descriptive statistics and multiple regression analysis were applied.
Results: Findings revealed that high user satisfaction across the evaluated domains, with mean scores of 4.52 ± 0.38 for ease of use, 4.48 ± 0.41 for problem detection efficiency, 4.43 ± 0.40 for utilization of data for program improvement, and 4.56 ± 0.35 for overall satisfaction. Multiple regression analysis indicated that problem detection efficiency had the strongest predictive effect on overall usability (β=0.975, p<0.001), while utilization of data for program improvement also showed a statistically significant yet smaller effect (β=0.028, p=0.009).
Conclusion: The developed digital M&E software demonstrated high perceived usability and user-reported functional value in supporting monitoring activities. This system is intended to complement existing routine health information systems, including dashboards and District Health Information System (DHIS2), by adding a structured evaluation-oriented layer based on the WHO chain model. However, given that the evaluation relied on user-reported perceptions, future longitudinal studies using objective program indicators are necessary to assess its impact on program performance and health outcomes.
Materials & Methods: The current research employed a mixed-methods development-and-evaluation design. In the first phase, the software was developed based on the Software Development Life Cycle (SDLC), including requirements analysis, system design, development, testing, and deployment. In the second phase, the system was evaluated among 340 users selected from the 1,500 total software users involved in program implementation. Thus, 1,500 is the eligible user population, and 340 is the final analytical sample. Reliability and validity of the satisfaction questionnaire were assessed using Content Validity Ratio, Content Validity Index, Cronbach’s alpha, and Intraclass Correlation Coefficient. Moreover, descriptive statistics and multiple regression analysis were applied.
Results: Findings revealed that high user satisfaction across the evaluated domains, with mean scores of 4.52 ± 0.38 for ease of use, 4.48 ± 0.41 for problem detection efficiency, 4.43 ± 0.40 for utilization of data for program improvement, and 4.56 ± 0.35 for overall satisfaction. Multiple regression analysis indicated that problem detection efficiency had the strongest predictive effect on overall usability (β=0.975, p<0.001), while utilization of data for program improvement also showed a statistically significant yet smaller effect (β=0.028, p=0.009).
Conclusion: The developed digital M&E software demonstrated high perceived usability and user-reported functional value in supporting monitoring activities. This system is intended to complement existing routine health information systems, including dashboards and District Health Information System (DHIS2), by adding a structured evaluation-oriented layer based on the WHO chain model. However, given that the evaluation relied on user-reported perceptions, future longitudinal studies using objective program indicators are necessary to assess its impact on program performance and health outcomes.
Keywords: Chain Model, Digital Health, Health Programs, Monitoring and Evaluation, Software Development, WHO
Type of Study: Editorial |
Subject:
Diseases
Received: 2025/06/26 | Accepted: 2024/07/1 | Published: 2024/12/8
Received: 2025/06/26 | Accepted: 2024/07/1 | Published: 2024/12/8
| Rights and permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |