Home | Volume 35 | Article number 54

Research

Evaluation of the national tuberculosis surveillance and response systems, 2018 to 2019: National Tuberculosis, Leprosy Buruli Ulcer Control Programme, Abuja, Nigeria

Evaluation of the national tuberculosis surveillance and response systems, 2018 to 2019: National Tuberculosis, Leprosy and Buruli Ulcer Control Programme, Abuja, Nigeria

Ayi Vandi Kwaghe1,2,3,&, Chukwuma David Umeokonkwo1,4, Mabel Kamweli Aworh1,3

 

1Nigeria Field Epidemiology and Laboratory Training Programme, Abuja, Nigeria, 2National Tuberculosis, Leprosy and Buruli Ulcer Control Programme, Abuja, Nigeria, 3Department of Veterinary and Pest Control Services, Federal Ministry of Agriculture and Rural Development, Abuja, Nigeria, 4Department of Community Medicine, Alex Ekwueme Federal University Teaching Hospital Abakaliki, Ebonyi State, Nigeria

 

 

&Corresponding author
Ayi Vandi Kwaghe, Nigeria Field Epidemiology and Laboratory Training Programme, Abuja, Nigeria

 

 

Abstract

Introduction: Nigeria is among the countries with high Tuberculosis (TB) burden by global rating signifying the relevance of TB surveillance system evaluation in improving performance and capacity of the existing system. Hence, this evaluation was conducted in order to determine the gaps and proffer solution to enhance the TB surveillance system performance.

 

Methods: questionnaires were administered to eight key informants using face-to-face interview method; data obtained was analyzed. Total number of TB cases and estimated number of cases for year 2018 was obtained. Percentage of positive cases using the GeneXpert test for 6 months (January to June 2019) was obtained. Available documents and publications on the National Tuberculosis, Leprosy and Buruli Ulcer Control Programme (NTBLCP) were also sought for information.

 

Results: the NTBLCP has over 5,300 TB service points and 1,602 microscopy Centre's distributed across the country. Acceptance for the standard TB case definition was 100%, forms used are easy to fill and diagnosis is laboratory-based requiring specialized trainings for laboratory personnel. The system had 25% sensitivity, high data quality with 100% timeliness. The TB surveillance system is representative of all ages. The system was first designed as TB and leprosy control programme but later buruli ulcer was incorporated into the programme. First quarter supervisory visits are skipped due to late funding and delayed budget approval. Major share of the funding comes from donor partners.

 

Conclusion: the system is useful, representative, acceptable, has good data quality, timely, and sensitive. The system is stable but needs to be funded more by the government. There is need for early funding and budget approval to avoid skipping of the first quarter supervisory visits due to funding challenges. The system is not simple due the various test that need to be conducted before, during and after treatment to detect and verify that the patient is cured. We recommend continuous training of health workers, routine monitoring and evaluation, integration of TB care and prevention into other health services programmes like HIV/AIDS and active case search at all levels to increase the sensitivity of the system. Speed up the process of integration of NTBLCP surveillance system with IDSR for data harmonization in the country.

 

 

Introduction    Down

Tuberculosis is a global treat and Nigeria is among the high TB, TB/HIV and DR-TB countries globally. The country ranks 7th among the 30 high TB burden countries globally and 2nd in Africa, accounting for 4% of the estimated incidence cases globally [1]. In 2015, the global estimate for new (incident) TB cases was estimated at 10.4 million. People living with HIV accounted for 1.2 million (11%) of the incident cases [2]. An estimated 460,000 cases of tuberculosis occur in Nigeria annually [1]. TB prevalence among HIV/AIDS patients rose up to 27% due to increased association of TB with HIV/AIDS [3]. The TB incidence and mortality rates for the country is 219/100,000 and 39/100,000 population respectively. The treatment coverage for the country in 2016 was 24% making it the lowest TB treatment coverage rate globally [1]. Nigeria ranks 8th among the 30 high Multidrug Resistance (MDR) TB burden countries with a drug resistance TB prevalence of 4.3% among new cases and 25% among previously treated cases. A recent national survey by the National Tuberculosis, Leprosy and Bruli-ulcer Control Programme on catastrophic cost experienced by TB patients in Nigeria in 2017 reports that 51% of TB patients experienced catastrophic cost with a higher proportion (93%) among drug resistance TB patients by the human capital catastrophic cost estimation threshold of 20% [1] indicating the severity of TB in the country.

 

Public health surveillance systems are instituted for data collection, analysis, interpretation and dissemination of information to relevant authorities for action to improve public health [4, 5]. Currently, the human, animal and environmental health have instituted surveillance systems which are progressively being integrated into the One Health (OH) approach component [4]. Surveillance system evaluation enhances efficient utilization of data collection resources and optimizes the systems operation. It defines the usefulness of a specific system for a particular public health initiative based on the goals of the public health program and the data collection objectives [6]. The aim of surveillance system evaluation is to assess whether the system achieves the purpose and objectives of the programme [6]. The variation of public health surveillance systems in their methods, scope, purpose and objectives brings about the disparity of what is important in the system being evaluated [7]. The need for effective surveillance systems has long been recognized with increasing international pressure to improve the effectiveness of these systems [8]. The capacity of surveillance systems to accurately describe patterns of diseases is of public health importance. Therefore, regular and relevant evaluations of these systems are critical in order to improve their performance and efficiency [9]. This study aimed at assessing the national tuberculosis surveillance and response systems to determine if the system meets its goals and objectives and to recommend ways of improving the system capacities.

 

 

Methods Up    Down

Study setting: Nigeria established the National Tuberculosis and Leprosy Control Program (NTBLCP) in 1989 with the mandate of reducing the prevalence of TB to a level it no longer constitutes public health problem in the country [10]. The NTBLCP is a division under the department of Public Health situated in the Federal Ministry of Health responsible for policy development, tertiary care, mobilization and development of human and material resource and provision of technical support to State programmes. The programme is in charge of coordination relating to the control of TB, Leprosy and buruli ulcer. Currently, the operating guideline for the programme is the Sixth Edition (2015) of the “National Tuberculosis, Leprosy and buruli ulcer Management and Control Guidelines [11]. At the national level, NTBLCP has national coordinator, the programme manager and the Monitoring and Evaluation (M&E) unit for data management [11]. The NTBLCP comprises of 12 units responsible for conducting various functions. They include; TB/HIV, Public Private Mixed Directly Observed Treatment-Short course (PPM DOTS), M&E, Laboratory, Logistics, Programmatic Management of Drug Resistant Tuberculosis (PMDT), Community Tuberculosis Care (CTBC), Childhood TB, Leprosy/buruli ulcer, Advocacy Communication and Social Mobilization (ACSM), Finance and Administrative Units [12].

 

The program has three levels of its operation; federal, state and local governments. The State offices at each of the 36 State Ministries of Health across the country coordinate the activities of Local Government offices which in turn supervises the activities in the primary health facilities offering diagnostic and or treatment services. The health facility focal person known as the DOTS (Directly Observed Treatment Short course) Officer captures each presumptive patient in the TB presumptive register, after the preliminary test have been conducted, and the patient is confirmed TB positive, the patient details is now registered in the TB facility register. At the end of each quarter, the Local Government TB Supervisor goes round all the facilities under the LGA to aggregate the LGA summaries and harmonizes all the reports into the central register. This report is submitted to the State Officer during the state quarterly review meeting and subsequently to the national office. Electronic reporting of data starts at the state level (Figure 1). There exists a total of 774 LGA Supervisors in the country that report to the State Officers (37 State Officers which includes the FCT State Officer) and from the state to the national level [12]. The Zonal quarterly review meetings are held at the Zonal Headquarters with the State Officers based on the six geopolitical zones (Figure 1). The Zonal Headquarters are; Kaduna for North West, Nasarawa (North Central), Bauchi (North East), Enugu (South East), Ibadan (South West) and Port Harcourt (South South). Reports from the six zones are collected and collated at the national level for the production of quarterly report and presentations. The NTBLCP operates with the aid of stakeholders providing technical and financial support (details indicated in Figure 2 and Table 1).

 

Case definition: a suspected pulmonary TB case is defined as any person coughing for 2 weeks or more, with or without symptoms of weight loss, tiredness, fever, night sweats, chest pain, shortness of breath, loss of appetite and coughing up blood while a suspected extra-pulmonary TB case is a person with symptoms depending on the affected organ, vertebral spine (back pain, swelling on spine); bone (long standing pain and swelling of the bone); Joints (painful joint swelling, usually affecting one joint); kidney and urinary tract (painful urination, blood in urine, frequent urination, lower back pain/loin pain); upper respiratory tract (hoarseness of voice, pain on swallowing); pleural membrane of lungs (chest pain, difficulty in breathing, fever); meninges of the brain (headache, persistent fever, neck stiffness, vomiting, irritability, convulsions, loss of consciousness); lymph node (painless swelling of the node, may drain pus); skin (longstanding ulcer despite antibiotic treatment, draining pus) and some general symptoms (weight loss, persistent fever, night sweats). In children, a suspect case is defined as any or combination of the following symptoms: low grade fever not responding to malaria treatment, night sweats, loss of weight, loss of appetite, failure to thrive, lymph node swellings, joint or bone swellings, angle deformity of the spine, listlessness and neck stiffness, headache, vomiting (TB meningitis) [13]. A confirmed TB case must be laboratory diagnosed. Case detection is done through screening of TB symptoms, along with sputum microscopy for AFB. Two positive smears out of three define positivity for TB. For sputum smear-negative cases, diagnosis is made after three negatives, along with X-ray and confirmation by medical officer. Extra-pulmonary TB cases in children are diagnosed by medical officers using clinical examination, X-ray, and/or any other investigation deemed necessary to establish a diagnosis [10].

 

Study design and data collation: we conducted a descriptive evaluation of the national TB surveillance system using Centers for Disease Control and Prevention (CDC) updated guidelines for evaluating public health surveillance systems [14] and the CDC Overview of Evaluating Surveillance Systems [6]. Questionnaire used for this study was adapted from the WHO generic questionnaire for central level (national), protocol for the assessment of national communicable disease surveillance and response [15] with minor modifications to suit the surveillance system being evaluated. The questionnaire had 9 sections, namely; socio-demographic characteristics; general questions; case definition, registration and sensitivity; representativeness; data reporting; data analysis; feedback; training; and surveillance. Questionnaires were administered to key informants from the PMDT, ACSM, TB/HIV, PPM DOTS, childhood TB, Leprosy/buruli ulcer and M&E units of the NTBLCP, Abuja. A total number of 8 questionnaires were interviewed-administered. Selection was based on the roles that each key informant performs in the unit; directly linked with supervision, data collation and feedback.

 

Data source and study duration: we obtained national data for the 36 states and the Federal Capital Territory (FCT) from the M&E unit of the NTBLCP; total cases of drug susceptible TB in the country for the year 2018 and the estimated projected number of cases for the same year; data from January to June 2019 for the GeneXpert test (total number of cases that were tested using the GeneXpert test and the total number of positive cases). Data obtained was collated. This study was conducted at the national level Abuja, from 16th September to 25th October, 2019.

 

Data analysis: data obtained from questionnaires and key informant interviews were cleaned and analyzed. We presented the descriptive statistic and also determined the sensitivity and predictive value positive as well as the other attributes of the surveillance system.

 

Ethical issues: this study was conducted based on approval by the national coordinator of the NTBLCP after a letter for the release of data was sent. Secondary data was used for this study and no ethical clearance was required. Verbal consent of the key informants was obtained before the face-to-face interview was conducted.

 

 

Results Up    Down

Usefulness of the system: at the end of 2014, there were over 5,300 TB service points and 1,602 microscopy Centre's distributed across the entire country [11]. The system detects TB in health facilities from the 774 local government areas of the federation nationwide. Gene Expert machines are used in the detection of drug resistant tuberculosis nationwide. For new cases where there are no GeneXpert machines, AFB test are used to diagnose TB. It is mandatory for re-occurring cases to use GeneXpert test to detect DR-TB cases. Data obtained from the surveillance are used to measure performance of the system, determine the health indicators for needs assessments and accountability of the system. Aside TB detection, other diseases detected by the system are leprosy and buruli ulcer. Data is also shared with WHO (Table 2).

 

System attributes

 

Simplicity: forms used are easy to fill and diagnosis is strictly laboratory-based. Some of the test carried out are expensive and require specialized and trained personnel to carry out the diagnosis. A confirmed case definition includes a TB positive result from one of the test procedures. The tests conducted are AFB microscopy (Ziehl-Neelsen technique), culture, GeneXpert® MTB/RIF assay, liquid culture using the Mycobacterium Growth Indicator Tube (MGIT), which allows rapid growth and detection of M. tuberculosis and polymerase chain reaction (PCR) using strip technology in line probe assay (LPA) for drug susceptibility testing (DST). Others include, quantiferon test used for latent diagnosis of TB, Lateral Flow Urine Lipoarabinomannan Assay (LF-LAM) for the diagnosis and screening of active TB in people living with HIV, Loop-Mediated Isothermal Amplification (TB-LAMP) for the diagnosis of pulmonary tuberculosis and in follow-up cases. Data is evaluated in terms of person, place and time. Demographic data obtained from WHO and the National Population Commission which is used in the calculation of rates and surveillance data from the NTBLCP (Table 3). The system of reporting at the central level is computerized, has a central data based server, data storage and analysis. The system is linked with the electronic TB (E-TB) manager for alerting of new TB cases and the GXalert messages for detected DR-TB cases from GeneXpert® MTB/RIF assay machine (Table 3).

 

Representativeness: the TB surveillance system is representative of all ages. Children below and above the age of 15 years are covered nationwide (Table 2). There is regimen for the treatment of children that are diagnosed with TB. Nationwide all age group and every district is under surveillance. Therefore, data obtained from the surveillance is representative of the entire national population. Data obtained is described in terms of person (sex and age), place (distribution using tables, charts and maps) and time (trend analysis and period of occurrence), (Table 3).

 

Acceptability: there exist TB manual which includes other diseases; leprosy and buruli ulcer. The standard TB case definition is well accepted (100%) by the staff (Table 1). There was full participation of all stakeholders in the programme and a good public-private partnership with the programme.

 

Flexibility: the system was first designed for TB and Leprosy programme but later on buruli ulcer was incorporated into the programme. Presently, the system surveillance constitutes TB, Leprosy and BU supervisors (TBLS) in all the LGAs and State TB programme Managers in all the States of the country. Currently, discussions between the NTBLCP and the Integrated Disease Surveillance and Response (IDSR) for integrating TB data from NTBLCP into the IDSR for harmonization of the national TB data is ongoing.

 

Data quality: case definition is consistent with WHO guidelines. The TB surveillance system was designed to capture a minimum set of variables for reported TB cases which was met by evaluation (core variables are captured; age, sex, case type, distribution) (Table 3). All scheduled periodic data submissions received and processed at the national level. Data are currently captured in an appropriate aggregated database for further analysis. At the central level, data is analyzed and interpreted collectivity to evaluate the national state of TB and TB trend in various states. The central level provides feedback to the states on quarterly basis at the zonal review meetings in the zonal office of each geopolitical zone in the country (Table 3). Power point presentations are delivered and information is shared with the state epidemiologist who in turn disseminate the information to LGA supervisors and subsequently to the health facilities concerned (Table 3).

 

Timeliness:timeliness was not assessed on weekly or monthly basis because at the central level, reports are compiled on quarterly basis for quarterly zonal meetings presentations. Timeliness was scored at 100% because all the reports are always made available at the stipulated time before the quarterly review meetings.

 

Sensitivity and predictive value positive (PVP): the projected number of cases for NTBLCP for the year 2018 was 419,000 out of which 104, 904 cases (25%) were detected by the system. A total of 285, 717 patients were tested using the GeneXpert test to detect DR-TB from January to June 2019, out of this number 36, 223 (12.7%) were positive. Hence, the sensitivity of the system was 25% while the PVP for DR-TB using the GeneXpert test was 12.7%. There were no frequent cases of misdiagnosis (Table 2).

 

Sensitivity = (Total number of positive cases in year 2018 (104,904))/(The projected number of cases by NTBLCP for the year 2018

 

(419,000))× 100 = 25.0%

 

PVP =(Total number of confirmed cases using GeneXpert test (36,223))/(Total number of cases submitted to the laboratory for GeneXpert test

 

(285,717))×100 = 12.7%

 

Stability: The NTBLCP has dedicated staff handling various thematic areas and an operational structure but limited funding from the government (budget from FMoH) that makes the programme mainly donor driven. The system has existed for 3 decades.

 

 

Discussion Up    Down

The TB surveillance system was found useful in the detection of drug susceptible and DR-TB cases as well as in evaluating the TB health indicators. This was based on the CDC assessment of usefulness of a surveillance system by its ability to determine adverse health event that contributes to performance measures such as health indicators that are used for need assessment and system accountability [16]. Data obtained has signified that the case definition is simple and easy to use but a confirmed case has to do with laboratory test which may be fairly easy or complex to conduct. This require specialized and trained personnel making the system a bit complex to operate. Test also need to conducted at the end of treatment to verify if the patient is cured or not. The simplicity of a public health surveillance system refers to both its structure and ease of operation. Surveillance systems should be as simple as possible while still meeting their objectives [14]. In 2018, 25% of the projected number of cases was detected by the surveillance system, indicating the need for improved active case search at all levels for early case detection to meet the objective and goal of the surveillance system in reducing the prevalence of TB to a level that no longer constitute public health problems in the country which will significantly diminish the socioeconomic impact and rate of transmission. The system is not yet integrated with other systems. Discussion on data integration and harmonization with IDSR is ongoing.

 

Integration and harmonization of data from NTBLCP and IDSR through collaboration will increase the validity of TB data obtained and distributed across the country and at international level. Differences in data obtained indicates a missing link between the two organizations. Hence, the dare need to harmonize data obtained. Data obtained has indicated that the TB surveillance system is representative of the TB cases in the country based on the CDC guideline that was used to evaluate the credibility of the system which states that a public health surveillance system is representative when it accurately describes the occurrence of a health-related event over time and its distribution in the population by place and person [16]. In 2016, at least one million children were estimated to have acquired tuberculosis annually, representing about 10% of all tuberculosis (TB) cases globally, while 250,000 children died of TB (including those co-infected with HIV) [17]. During the same period, there were an estimated 56,000 cases of TB in children in Nigeria [18] indicating that children are well captured in the TB surveillance system in the country. When cases notified to a surveillance system are not representative of the events in the general population, there is poor reflection of national and global situation of the disease [14].

 

Over time, the representativeness of surveillance data may change due to changes in legislation, surveillance infrastructure, clinical practice and reimbursement policies leading to wrong conclusions. For example, when trends in surveillance data are compared between countries. Hence the need for stability in the representativeness on the national surveillance level needs to be monitored, and the quantitative effect of changes on representativeness assessed [14]. There are 32 supervisory visits to be made in a year at the central level, 8 visits in each quarter but the visit in the first quarter is usually skipped due to late funding of the budget. Thus, the need for early funding to avoid the skipping of the first quarter supervisory visits. The system demonstrated stability based on reliability; signifying the systems´ ability to collect, manage, and provide data properly without failure and availability; ability to be operational when needed. However, the funding of the programme is mainly by the donor partners. This indicates that the Nigerian government needs be the major funder of the programme for sustained stability in the future because funding plays a major role in the performance and sustenance of a system. Peradventure there is withdrawal from any of the major donors in the future, this may lead to a major setback in the programme. Studies have indicated prospects for TB control in Nigeria with the existence of a 30 year old TB control programme and the willingness of development partners to assist [19].

 

Limitation of the study: evaluation of validity and available resources in terms of funding was not done.

 

 

Conclusion Up    Down

The system was found to be useful, representative, acceptable, good data quality, timely, and sensitive. The system is also stable but needs to be funded more by the government. The stability of the programme largely depends on the funding from donor partners which needs to be corrected. There is need for early funding to avoid the skipping of the first quarter supervisory visits. The system is not simple due the various test that need to be conducted before, during and after treatment to verify that the patient is cured. Recommendations include training and re-training of health workers, constant monitoring and evaluation of the TB surveillance system, integration of TB care and prevention into other health services and programmes like HIV/AIDS and active case search at all levels. Speed up the process of integration of NTBLCP surveillance system with IDSR for data harmonization and better output in case detection. Findings will be communicated to partners and stakeholders in order to improve on the existing TB surveillance system and response.

What is known about this topic

  • Surveillance system evaluation is conducted to improve public health;
  • Evaluation is done based on the type of system instituted;
  • The instituted system for surveillance should be able to meet its set goals and objectives.

What this study adds

  • The TB surveillance system was found to be useful, representative, acceptable, has good data quality, timely and sensitive. Nevertheless, 25% sensitivity of the surveillance system indicates the need for improved active case search at all levels for early case detection to meet the objective and goal of the surveillance system;
  • There is need for government to increase funding of the TB surveillance system because majority of the funds is from donor partners;
  • There is need for early funding and budget approval to avoid the skipping of the first quarter supervisory visits.

 

 

Competing interests Up    Down

The authors declare no competing interests.

 

 

Authors' contributions Up    Down

Ayi Vandi Kwaghe drafted the evaluation design, modified the adapted questionnaire used for the study, administered and analyzed the questionnaire and drafted the manuscript. Chukwuma David Umeokonkwo and Mabel Kamweli Aworh revised the manuscript for intellectual content. All authors read and approved to the final version of the manuscript.

 

 

Acknowledgments Up    Down

Our gratitude goes to the National Coordinator and staff of the NTBLCP in their willingness to share the system data and participated as respondents for the questionnaires administered.

 

 

Tables and figures Up    Down

Table 1: major Technical and Financial Partners of the National Tuberculosis, Leprosy and Buruli Ulcer Control Programme

Table 2: demographic characteristics, case definition, case registration, sensitivity and representativeness, N = 8

Table 3: data reporting, data analysis, feedback, training and surveillance, N = 8

Figure 1: current transmission path of TB data in Nigeria [12]

Figure 2: stakeholders of NTBLCP, Nigeria [10, 20, 21, 22]

 

 

References Up    Down

  1. Federal Ministry of Health Nigeria (FMoH). National Tuberculosis Catastrophic Cost Survey: Report of the National Survey to Determine the Proportion of TB Patients and their Households Experiencing Catastrophic Cost due to TB. 2017.

  2. World Health Organization (WHO). Tuberculosis (TB), Policy statements. Accessed on 6th November 2017.

  3. Onyebuchi OB. Tuberculosis and Leprosy Control Policy in Nigeria, 1985-2015. Elixir Pharmacy. 2015;88(2015):36313-36315. Google Scholar

  4. Corley CD, Lancaster MJ, Brigantic RT, Chung JS, Walters RA, Arthur RR et al. Assessing the continuum of event-based biosurveillance through an operational lens. Biosecur Bioterror. 2012 Mar;10(1):131-41. PubMed | Google Scholar

  5. Groseclose SL, Buckeridge DL. Public Health Surveillance Systems: Recent Advances in Their Use and Evaluation. Annu Rev Public Health. 2017 Mar 20;38:57-79. PubMed | Google Scholar

  6. Centre for Disease Control and Prevention (CDC). Overview of Evaluating Surveillance Systems. 2013.

  7. Waziri NE, Nguku P, Olayinka A, Ajayi I, Kabir J, Okolocha E et al. Evaluating a surveillance system: live-bird market surveillance for highly pathogenic avian influenza, a case study. Pan African Medical Journal. 2014; 18(Supp 1):11. PubMed | Google Scholar

  8. Drewe J, Hoinville L, Cook A, Floyd T, Stärk K. Evaluation of animal and public health surveillance systems: a systematic review. Epidemiol Infect. 2012 Apr;140(4):575-90. PubMed | Google Scholar

  9. Shahab S. Finding value in the evaluation of public health syndromic surveillance systems from a policy perspective. In: Finding value in the evaluation of public health syndromic surveillance systems from a policy perspective. Alberta, Canada: Alberta Health Services. 2009; 1-24.

  10. Federal Ministry of Health of Nigeria. February. The National Strategic Plan for Tuberculosis and Leprosy Control (2010-2015). Bethesda, MD: Health Systems 20/20 project, Abt Associates Inc. 2011;1-78.

  11. Federal Ministry of Health. National Tuberculosis, Leprosy and Buruli ulcer Management and control Guidelines. Sixth Edition. Department of Public Health National Tuberculosis and Leprosy Control Programme. 2015; 1-167.

  12. National Tuberculosis and Leprosy Control Programme, Department of Public Health, Federal Ministry of Health, Nigeria. The National Strategic Plan for Tuberculosis Control (NSP-TB 2015 - 2020): Towards Universal Access to Prevention, Diagnosis and Treatment. 2014; 1-2.

  13. Federal Ministry of Health Nigeria (FMOH). National Tuberculosis and Leprosy Control Programme Workers' Manual. 5th ed. Abuja: FMOH; 2010.

  14. Centre for Disease Control and Prevention (CDC). Updated Guidelines for Evaluating Public Health Surveillance Systems; Recommendations from the Guidelines Working Group. MMWR. 2001; 50(RR13): 1-35. Google Scholar

  15. World Health Organization (WHO). Protocol for the Assessment of National Communicable Disease Surveillance and Response Systems. 2001; WHO/CDS/CSR/ISR/2001.2. Google Scholar

  16. Centre for Disease Control and Prevention (CDC). Guidelines for Evaluating Surveillance Systems. MMWR Supplement. 1988; 37(S-5): 1-18.

  17. World Health Organization (WHO). Tuberculosis factsheet. 2017. Accessed on 6th November 2017.

  18. World Health Organization. Global Tuberculosis Report. Accessed on 6th November 2017.

  19. Onyeonoro UU, Chukwu JN, Nwafor CC, Meka AO, Omotowo BI, Ogbudebe C et al. Assessment of the quality of tuberculosis surveillance data in six selected states in Southern Nigeria. Ann Trop Med Public Health. 2015; 8:94-100. Google Scholar

  20. Federal Republic of Nigeria (FRN), Revised National Health Policy; Federal Ministry of Health Abuja. September 2004.

  21. Federal Ministry of Health Nigeria (FMOH), Annual Report - 2008. National Tuberculosis & Leprosy Control Programme Nigeria. June 2009; 1-51.

  22. Federal Ministry of Health of Nigeria (FMoH); Nation Tuberculosis and Leprosy Control programme. Workers' Manual - Revised 5th Edition. 2010; 1-140.