Improving Nigerian health policymakers’ capacity to access and utilize policy relevant evidence: outcome of information and communication technology training workshop
Improving Nigerian health policymakers’ capacity to access and utilize policy relevant evidence: outcome of information and communication technology training workshop
Chigozie Jesse Uneke1,2,&, Abel Ebeh Ezeoha2,3, Henry Uro-Chukwu2,4, Chinonyelum Thecla Ezeonu2,5, Ogbonnaya Ogbu1,6, Friday Onwe2,7, Chima Edoga2,8
1Department of Medical Microbiology/Parasitology, Faculty of Clinical Medicine, Ebonyi State University Abakaliki, Nigeria, 2Health Policy & systems Research Project (Knowledge Translation Platform), Ebonyi State University Abakaliki, Nigeria, 3Department of Banking & Finance, Ebonyi State University Abakaliki, Nigeria, 4National Obstetrics Fistula Centre, Abakaliki, Nigeria, 5Department of Paediatrics, Ebonyi State University Abakaliki, Nigeria, 6Department of Applied Microbiology, Ebonyi State University Abakaliki, Nigeria, 7Department of Sociology/Anthropology, Ebonyi State University Abakaliki, Nigeria, 8Catholic Relief Services (Nigeria Program), Abakaliki, Nigeria
Chigozie Jesse Uneke, Health Policy & Systems Research Project (Knowledge Translation Platform), Ebonyi State University, Abakaliki, Nigeria
Information and communication technology (ICT) tools are known to facilitate communication and processing of information and sharing of knowledge by electronic means. In Nigeria, the lack of adequate capacity on the use of ICT by health sector policymakers constitutes a major impediment to the uptake of research evidence into the policymaking process. The objective of this study was to improve the knowledge and capacity of policymakers to access and utilize policy relevant evidence. A modified "before and after" intervention study design was used in which outcomes were measured on the target participants both before the intervention is implemented and after. A 4-point likert scale according to the degree of adequacy; 1 = grossly inadequate, 4 = very adequate was employed. This study was conducted in Ebonyi State, south-eastern Nigeria and the participants were career health policy makers. A two-day intensive ICT training workshop was organized for policymakers who had 52 participants in attendance. Topics covered included: (i). intersectoral partnership/collaboration; (ii). Engaging ICT in evidence-informed policy making; use of ICT for evidence synthesis; (iv) capacity development on the use of computer, internet and other ICT. The pre-workshop mean of knowledge and capacity for use of ICT ranged from 2.19-3.05, while the post-workshop mean ranged from 2.67-3.67 on 4-point scale. The percentage increase in mean of knowledge and capacity at the end of the workshop ranged from 8.3%-39.1%. Findings of this study suggest that policymakers' ICT competence relevant to evidence-informed policymaking can be enhanced through training workshop.
All over the world, there is increasing recognition of importance of making health policies with best available evidence. The process which is known as evidence-informed health policymaking is characterized by the systematic and transparent access to, and appraisal of, evidence as an input into policymaking . According to Bowen and Zwi , evidence encompasses research, opinion and views of individuals or groups, results of consultative processes and published reports and documents; facts which may be actual or asserted which may be known through experience or observation. However, numerous reports have consistently indicated that evidence from research is among the most reliable category of evidence and can greatly enhance health policy development [3-6]. One of the most challenging aspects of evidence-to-policy link especially in developing countries is the capacity constraints of policymakers to access, synthesize, adapt and utilize available research evidence [7,8]. Studies have shown that one of the major areas of policymakers' capacity constraints in developing world is in the use information and communication technology (ICT) . ICTs have been defined as "tools that facilitate communication and the processing and transmission of information and the sharing of knowledge by electronic means encompassing the full range of electronic digital and analogue ICTs" (9). ICTs have been reported to have greatly improved access to health information, research, literature and training materials, thereby supporting the health research enterprise and enabling comprehensive, evidence-based policymaking . In Nigeria, the lack of adequate knowledge and capacity on the use of ICT by health sector policymakers constitute a major impediment to the uptake of research evidence into the policymaking process [11-13]. Gething and colleagues , had observed in their report that in most African setting, there is a paucity of ICT-related knowledge and skills limiting capacities of national health management information systems (HMIS) to generate, analyze and disseminate information for use in decision-making. The United Nations Economic commission for Africa (UNECA) recognized the importance of ICT in the improvement of the health sector in the African region. According to the UNECA report, ICTs have a crucial role to play in improving the effectiveness of the health sector by maximizing the use of scarce knowledge and limited resources as well as bringing life-enhancing knowledge to people in ways they can use, when and where they need it . A number of previous published works have suggested that a relationship exists between effective job performance of a health sector stakeholder (policymaker or service provider) and ICT use [9,10,15]. Therefore to address the competency problem in ICT use by health sector policymakers, there is a dire need for a capacity enhancement training activity for policymakers. This is supported by Peizer  who in a paper on strategies to bridge the digital divide, made a case for a significant time and resource commitment to invest in training to enhance ICT competence of those involved in making health policy.
Aim of the Workshop
The aim of this study is to improve the knowledge and capacity of Nigerian policymakers to access and utilize policy relevant evidence via an ICT training workshop. In this workshop, a modified "before and after" intervention study design was used in which outcomes were measured on the eligible population (target participants) both before the programme (intervention) is implemented and after . The difference between the before and after measurements was taken to be the impact of the intervention. (In this instance, the "before"- or "baseline"- measurements served as the control measurements).
Study area and participants
This research was a sub-national study and participants consisted of individuals whose geographical area of operation is south-eastern Nigeria, with emphasis on Ebonyi State. The target participants were the career health policy makers, this category of policymakers included: health professionals in charge of the health systems; regional, state and local government directors of the health ministry; directors of primary health care at the local government level; health professionals working with specific programmes in the health ministry; staff and consultants involved in public health issues within the health ministry; programme/project managers under the health ministry; chief executive officers of civil society groups, including non-governmental organizations; leaders of national health-based associations (for example, Nigerian Medical Association; National Association of Nigeria Nurses and Midwives; and Pharmaceutical Association of Nigeria). This category of policymakers were selected as key participants in this study because findings from our previous studies [7,18,19] clearly indicate that at the State and Local Government levels, they play the most vital role in "evidence-to-policy" making process. They are the principal actors involved in the generation, collection and assembling of policy relevant information, and processing of data and reports on health-related issues from the different sectors of the health system. They also prepare these into forms that can be submitted for the drafting of policy documents.
Approval for this study was obtained from the Directorate of Research, Innovation & Commercialization (DRIC), Ebonyi State University, Abakaliki Nigeria. The approval was based on the agreement that participation in the research was voluntary following informed consent; that participants' anonymity would be maintained; and that every finding would be treated with utmost confidentiality and for the purpose of this research. These were adhered to in this study.
A total of five facilitators were engaged in the workshop based on their expertise in the training contents. The facilitators included four senior academics from Ebonyi State University Abakaliki Nigeria and a senior director from the Ministry of Health. The academics included a Professor of infectious diseases and epidemiology with vast experience in intersectoral partnership/ collaboration in health policymaking; the remaining three senior academics have vast experience in evidence-informed policy making and knowledge translation in the Nigeria context. The only policymaker facilitator has vast experience working with the government in the formulation of policy in the south eastern Nigeria.
A total of 70 policymakers were mapped out for this study. The mapped out participants were divided into two batches of 35 persons each. We organized a two-day intensive health-policy based ICT training workshop at the Ebonyi State University, Information and Communication Technology (ICT) (E-Library) Centre Abakaliki Nigeria, for the policymakers. All the policymakers were invited to the workshop by invitation letters which were sent 2 weeks before the event and was followed-up with a text message reminder to their mobile phones a day before the programme.
The first batch of policymakers had their workshop in April 2014, while the second batch had theirs in May 2014. The duration of the workshop each day was five hours from 10am-3pm (with a break between 12:30pm-1pm). A pre-workshop assessment questionnaire (developed in a 4-point likert scale according to the degree of adequacy; 1 = grossly inadequate, 4 = very adequate), was administered prior to actual training to assess the level of knowledge and capacity of the participants on the specific topics to be covered within the theme of the workshop. After the administration of the pre-workshop questionnaire the training commenced and was facilitated by four resource persons (three senior researchers from Ebonyi State University and one senior director from the health ministry). The workshop covered the following topics: (i). Need for intersectoral partnership/ collaboration in health policymaking in Ebonyi State; (ii). Benefits of engaging ICT in evidence-informed policy making for control of infectious diseases of poverty and running the health sector; (iii). Introduction to use of ICT for evidence synthesis;(iv) Development of the capacity of the policymakers on the use of computer, internet and other ICT the following: (a). The search protocol for health information and policy relevant research evidence; (b). Identification of and search strategies for evidence of a wide range of electronic resources, in addition to the traditional scientific and clinical databases (eg., MEDLINE, EMBASE, Cochrane Database, Allied and Complementary Medicine, British Nursing Index, Social Policy and Practice etc); (c). Information/evidence audit to accompany search strategies.
All teaching sessions were done using power-point presentation and handouts on each topic were produced and distributed to all participants. It was made mandatory for all lectures to be delivered in simplified, practical and easily comprehensible patterns, with little or no emphasis on complex mathematical or scientific computations/models for the benefit of non-specialists who constituted the majority of the participants. Practical sessions were held during the workshop in which each participant was able to use an internet connected computer to practice the acquisition of research evidence from relevant electronic databases. At the end of the workshop, a post-workshop assessment questionnaire was administered to the participants to evaluate the impact of the workshop.
The data collected via the questionnaire (developed in a likert scale format) was analyzed using the methods developed at McMaster University Canada by Johnson and Lavis . The analysis is based on mean rating (MNR), median rating (MDR) and range. For instance the figures represent Likert rating scale of 1-4 points, where 1 point=grossly inadequate; 2 points=inadequate; 3 points=fairly adequate; and 4 points=very adequate. In terms of analysis, values ranging from 1.00-2.49 points are considered low, whereas values ranging from 2.50-4.00 points considered high. The Pre-ICT means was compared to the Post-ICT means. The EPi-info software was used for the performance of the data analysis.
Out of the 70 policymakers and stakeholders invited for the workshop, a total of 52 individuals attended. The official designation attributes as indicated in Table 1 included the following: Programme Officer/Project Secretaries (28.8%); Managers/Heads of Departments (30.8%); Directors/Presidents/Chairpersons (40.4%). A total of 34.6% of the participants have direct influence on the policymaking process, with 51.9% and 30.8% possessing Bachelors and Masters Degrees as highest academic qualifications respectively. The outcome of PRE-ICT knowledge and skill assessment is presented in Table 2, while the POST-ICT knowledge and skill assessment is presented in Table 3. The outcome of the assessment of the impact of the training workshop with the comparison of the PRE-ICT mean and POST-ICT mean is presented in Table 4.
Result showed a progressive increase in the POST-ICT mean over the PRE-ICT mean. In terms of the "intersectoral partnership/ collaboration in health policymaking", the PRE-ICT mean ranged from 2.99-3.05, while the POST-ICT mean ranged from 3.37-3.67, with the percentage increase ranging from 14.3%-22.6%. In terms of "engaging ICT in evidence-informed policy making for control of infectious diseases of poverty and in running the health", the PRE-ICT mean ranged from 2.26-2.55, while the POST-ICT mean ranged from 3.14-3.41, with the percentage increase ranging from 25.1%-39.1%. In terms of "knowledge & application of information/communication technology for Internet use", the PRE-ICT mean ranged from 2.21-3.03, while the POST-ICT mean ranged from 2.69-3.51, with the percentage increase ranging from 8.3%-24.1%. Concerning the "use of ICT for evidence synthesis", the PRE-ICT mean ranged from 2.19-2.49, while the POST-ICT mean ranged from 2.67-3.08, with the percentage increase ranging from 16.6%-32.8% (Table 4).
Discussion and conclusion
The result of this study clearly showed a notable improvement in the knowledge and capacity of the participants regarding the use of ICT to access, synthesize and apply relevant evidence in policymaking. This notable improvement is demonstrated by the tremendous increase in the POST-ICT mean of knowledge/skill over that of the PRE-ICT mean in all the subject areas covered at the training workshop. This outcome suggests that the training workshop strategy we employed in the study, appeared to produce the desired capacity enhancement among the participating policymakers. Evidence that emerged from this study suggests that an ICT training workshop can serve as an intervention mechanism towards improving the ability of policymakers and other stakeholders to use ICT. We observed a similar trend in our previous study . The report of HIFA  highlighted the many strategic benefits of training workshops (when used as in-service training) to include: presenting new information to groups of people, practicing new skills and allowing health workers to share experiences and insights. Furthermore HIFA  noted that teaching delivered to groups is often thought to be economical and another advantage is that it is thought that adults learn best by sharing of experience, discussion and doing. Gates  had earlier indicated that using training workshop a significant impact on skill difference was gained on providers' skills in assessing and managing HIV/AIDS patients. Methods used in the workshops such as the administration of pre-workshop questionnaire and post-workshop questionnaire; general discussions; group works and short presentations have been shown to be very effective in capacity enhancement . The ICT capacity enhancement training workshop was conducted as part of the strategies designed to improve the ability of the policymakers to be able to acquire and assess policy relevant information. The result of our study indicated that "Knowledge about the use of ICT for accessing information for policy making" and "Knowledge about how to address challenges and improve the use of ICT in the health sector" were among the capacity issues that recorded the highest percentage improvement (32.8% and 38.9% respectively) (Table 4). We focused on the improvement of the capacity and skill to use ICT in the health policymaking process because ICTs have been noted to have the potential to make a major contribution to improving access and quality of services while containing costs , and could provide fast, efficient and relatively cheap access to information leading to dramatic improvements in access to advice and care . Reports by UNESCO  and WHO  noted that we are living in what are increasingly referred to as "knowledge societies" which are able to harness the huge amount of information that modern technology such as computers and the Internet allow us to manipulate, store, transmit and share. According to Green and Bennett , the skill, therefore, lies in turning all this information into knowledge; and the great challenge is to then use that knowledge-to put it into practice. We designed the ICT training workshop content as a comprehensive capacity enhancement mechanism based on topics that we are convinced have potential to improve the evidence-to-policy link. The topics including engaging ICT in evidence-informed policy making and in running the health sector; knowledge & application of ICT for Internet use, information literacy; defining information problem; searching for information online; and evaluating information have been described as areas requiring capacity strengthening for policy makers in low-income settings .
In the present study, it is worthy of note that the knowledge of the use of ICT for evidence synthesis improved considerably among the policymakers after the training workshop. The percentage increase ranged from 16.6% to as high as 32.8%. The implication of this is that the policymakers have acquired some abilities to use of ICT for accessing policy relevant information; know the sources of evidence and electronic databases relevant for evidence in policy making; and to search and identify existing research evidence in policy making context; as well as assess the authenticity, validity, reliability, high quality of research evidence. There are numerous reports including randomized controlled trials that have demonstrated considerable improvement in the capacity of health professionals to use ICT effectively to improve healthcare capacity following training/instructional programme/workshops [27-31]. It is based on this premise that a number of international agencies including the United Nations Asian and Pacific Training Centre for Information and Communication Technology for Development's (UN-APCICT) are promoting capacity enhancement on ICT among policymakers . The UN-APCICT has undertaken training workshops for policymakers in a number of countries in Asia and noted that such training programmes can equip government officials with the knowledge and skills they need to fully utilize the potential of ICTs to achieve national development goals and bridge the digital divide [32-35]. Our expectation from this study therefore, is that the enhanced capacity that policymakers have acquired from the training workshop will enable them to seek, advocate for and use available research evidence in the policymaking process. In an earlier report Daly , had argued that with enhanced ICT capacity and given the right policies, organization, resources and institutions, ICTs can be powerful tools in the hands of those who make health policy and those working to improve health.
It is pertinent to state that although notable improvement in knowledge and skill was witnessed in this study among the participants, the study was not without a number of limitations. First, the ICT training workshop lasted only two days. This could be considered rather too short a time duration to assess the real impact of the training. Furthermore the post-workshop assessment that was conducted may not have been very adequate to evaluate the impact of the training skills acquired. A follow-up of participants to see how far they are able to use the skill acquired in the policymaking process would have provided a more excellent evaluation as we observed in our previous study . The findings of this study notwithstanding these limitations have demonstrated that policymakers' ICT competence can be enhanced through training workshops as demonstrated in this study in Ebonyi State Nigeria.
Authors declare no competing interests.
CJU & AEE conceived the idea; all authors participated in the development of the idea, project implementation/execution, data collection and analysis. CJU drafted the manuscript; all authors approved the manuscript for publication.
This investigation received financial support from the UNCICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases (WHO/TDR), (Reference 2014/397653-0).
Table 1: attributes of the participants during the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria
Table 2: the Pre-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria
Table 3: the POST-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria
Table 4: comparison of the Pre-ICT and Post-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria
|The Pan African Medical Journal articles are archived on Pubmed Central. Access PAMJ archives on PMC here|
Volume 26 (Jan - Apr 2017)
This article authors
|On Google Scholar|
Navigate this article
Tables and figures
|Table 1: attributes of the participants during the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria|
|Table 2: the Pre-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria|
|Table 3: the POST-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria|
|Table 4: comparison of the Pre-ICT and Post-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria|
Rate this article
Popular articles in Workshop report
|1||Improving Nigerian health policymakers’ capacity to access and utilize policy relevant evidence: outcome of information and communication technology training workshop|
|2||Setting research priorities for HIV/AIDS-related research in a post-graduate training programme: lessons learnt from the Nigeria Field Epidemiology and Laboratory Training Programme scientific workshop|
|3||An introduction to systematic reviews and meta-analysis: A workshop report on promoting evidence based medical practice through capacity building in research synthesis|
|4||A workshop report on HIV mHealth synergy and strategy meeting to review emerging evidence-based mHealth interventions and develop a framework for scale-up of these interventions|
|5||Setting research priorities to reduce malaria burden in a post graduate training programme: lessons learnt from the Nigeria field epidemiology and laboratory training programme scientific workshop|
|6||Setting the stage for randomized controlled trials in Cameroon: a workshop report|
|7||Pan African Medical Journal (Pamj) and African Field Epidemiology Network (AFENET): A partnership for the future of medical publishing in Africa|