Table showing INPUTS, ACTIVITIES, OUTPUTS, OUTCOMES, Tools and reports to use for monitoring & Where to feedback findings to for each of the S, A, F&E components
Logic framework for monitoring SAFE interventions in Tanzania

How to monitor and evaluate trachoma programmes

Dr Jeremiah Ngondi, Senior Epidemiologist with the Tanzania Vector Control Scale-up Project explains how the Tanzania National Trachoma Programme uses core indicators to plan SAFE interventions and a logic framework to monitor their implementation. He shares guidance on using impact surveys to decide when to stop SAFE interventions and surveillance surveys to obtain pre-elimination validation.

Deciding whether to start SAFE interventions

Baseline surveys must be undertaken before any SAFE interventions are started. Population based surveys are commended using WHO methods.

The key indicators which guide the decision on beginning SAFE interventions are:

  • Prevalence of trachomatous inflammation-follicular (TF) ≥ 5% in children aged 1-9 years

  • Prevalence of trachomatous trichiasis (TT) ≥ 0.2% in people aged 15 years and above

Detailed guidance on how to plan the implementation of SAFE is given in the Trachoma Action Planning guide

Monitoring SAFE interventions

To ensure that SAFE interventions are implemented effectively, periodic monitoring is needed. The range of SAFE activities undertaken are context specific and therefore the monitoring indicators used may vary from place to place. The table below illustrates the logic framework used to monitor SAFE interventions in Tanzania. The framework summarises the inputs, activities, output indicators and outcome indicators.

For instance, in Tanzania, monitoring of mass drug administration (MDA) with azithromycin involves tracking of training activities, doses of azithromycin distributed and calculation of MDA programme coverage.

The results of MDA programme coverage are shared at the district, regional and national levels. Data on coverage is also reported externally to the WHO, International Trachoma initiative and other programme partners. Further monitoring - through population-based coverage surveys - is used to estimates the proportion of population reached by MDA.

Logic framework for monitoring SAFE interventions in Tanzania

1. Surgery

Event Type of information
Inputs Budgets, personnel, training materials, TT surgery supplies, data capture tools
Activities Training of TT case finders and TT surgeons
Community sensitisation for TT surgery
TT case search and referral
TT surgery campaigns
Data collection, compilation and reporting
Outputs (Process indicators) - Collected and reported at the end of each activity Number of TT surgeons trained
Number of people received TT surgery (proportion of targeted patients who have received TT surgery)
Number of post-surgical complications per surgeon
Outcomes (annual reporting) Proportion of TT backlog received surgery
Proportion of TT surgery cases with recurrence
How to monitor Geographic coverage reports from outreach teams
3-6 month quality assessment
TT recurrence assessment
Feedback of findings to.. Health workers in the team
Community leaders
District councils
Regional and national levels

2. Antibiotics

Event Type of information
Inputs Budgets, personnel, training materials, azithromycin, tetracycline eye ointment, dose poles, data capture tools
Activities Training of CDDs, FLHWs and community sensitisation MDA
MDA campaigns
Data collection, compilation and reporting
Outputs (Process indicators) - Collected and reported at the end of each activity Number of FHLW, Supervisors, CDDs trained
Number of MDA doses distributed
MDA geographic coverage
MDA programme coverage
MDA epidemiological coverage
Outcomes (annual reporting) MDA population coverage - based on coverage survey
How to monitor Routine supportive supervision
Data quality assessment
MDA coverage surveys
Feedback of findings Health workers and volunteers
Community leaders
District councils
Regional and national levels

3. Facial cleanliness & Environmental improvement

Event Type of information
Inputs Budgets, personnel, training materials, supplies, data capture tools
Activities Community behaviour change communication on facial cleanliness and sanitation
Hand and face washing containers
Promotion of pit latrine construction through community led total sanitation
Data collection, compilation and reporting
Outputs (Process indicators) - Collected and reported at the end of each activity Number of sanitation registers developed
Number of households with face washing points
Number of households with improved latrines
Number of schools with latrines and hand washing facilities
Number of schools with permanent face washing points
Number of schools with active wash clubs
Number of villages with ODF status
Outcomes (annual reporting) Proportion of households with access to improved sanitation
Proportion of households with hand washing points
Proportion of villages or schools received supportive supervision
How to monitor Through updated sanitation registers
Through verification of ODF status
Population based surveys
Feedback of findings Community and community leaders
District councils
Regional and national levels
CDDs = Community drug distributors
FLHWs = Front line health workers
MDA = Mass drug administration
ODF = Open defecation free
TT = Trachomatous trichiasis

Evaluation of SAFE interventions

Impact surveys are carried out to decide when to stop:

  • SAFE interventions, and

  • Periodic surveillance after stopping SAFE interventions.

The key impact indicators which determine whether trachoma is a public health problem are: prevalence of TF of <5% in children aged 1-9 and prevalence of TT of <0.2% in people aged 15+ years.

Trachoma surveys are undertaken by the country programs using the WHO-led initiative, Tropical Data.

Impact surveys

Population-based impact surveys are carried out 6 months after the final MDA round to assess the prevalences of TF and TT. Surveys are recommended as follows:

  • after 1 MDA annual round if baseline TF prevalence = 5-9.9%

  • after 3 years of MDA if baseline TF prevalence = 10-29.9%

  • after 5 years of MDA if baseline TF prevalence = 30-49.9%

  • after 7 years of MDA if baseline TF prevalence ≥ 50%

Once the impact indicators for TF and TT appear to reach the elimination targets, MDA and surgery for TT are stopped. However, F&E interventions should be continued.

Surveillance for trachoma

Trachoma surveillance is the monitoring and evaluation activities which are carried out to assess the outcome of a trachoma elimination programme.

Surveillance begins after elimination prevalence targets appear to have been achieved in a defined trachoma endemic area and S and A interventions have been stopped.

Current guidelines recommend that population-based surveillance surveys should be undertaken at least 24 months after stopping MDA. If a surveillance survey shows that the elimination targets for TF and TT prevalence have been maintained, then trachoma can be considered to have been eliminated as a public health problem from the district. When all endemic districts have achieved elimination, the country is eligible for elimination validation.

Following validation of elimination of trachoma, further routine surveillance is needed to monitor if elimination of trachoma a public health problem is being sustained. this is known as post-validation trachoma surveillance.
A number of approaches have been used in trachoma endemic countries for routine surveillance, including:

  • Annual survey of trachoma endemic communities (Australia)
  • Sentinel surveillance for active trachoma in a communities (Ghana)
  • Routine surveillance for trachoma through health facilities and schools (Oman)
  • Active case search for trichiasis in the community (Ghana and Morocco).

Recently, research on the use of antibody-based multiplex assay has showed promising results as an additional tool for evaluating the transmission of trachoma. An indicator for ongoing infection within a community may be useful for additional tracking where elimination of trachoma has been achieved.

Share this article:

This article is from the free online course:

Eliminating Trachoma

London School of Hygiene & Tropical Medicine

Get a taste of this course

Find out what this course is like by previewing some of the course steps before you join: