Skip to main content

Improving possible serious bacterial infection (PSBI) management in young infants when referral is not feasible: lessons from embedded implementation research in Ethiopia and Kenya

Abstract

Background

Sepsis is a leading cause of neonatal mortality, despite the availability of effective treatment of possible serious bacterial illness (PSBI), including when referral to a hospital is not feasible. Gaps in access and delivery worsened during COVID-19. We conducted embedded implementation research in Ethiopia and Kenya aimed at mitigating the impact of COVID-19 and addressing various implementation challenges to improve PSBI management.

Methods

The implementation research projects were implemented at the subnational level in Ethiopia and Kenya between November 2020-June 2022 (Ethiopia) and December 2020-August 2022 (Kenya). Guided by the implementation research frameworks, both projects conducted mixed formative quantitative and exploratory research from April to May 2021, followed by summative evaluations conducted between June and July 2022. Frameworks encompassed Consolidated Framework for Implementation Research (CFIR), Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), as well as health systems framework that incorporates cascades of care and World Health Organization Health Systems Building Blocks. Results were synthesized across the projects through document review and sharing cross-project measures and strategies through a project community of practice.

Results

Despite differences in settings across the projects, cross-cutting facilitators included community health worker program and support, and existence of guidelines for PSBI management at primary care levels. Barriers included community attitudes towards seeking care for sick newborns, COVID-19 risks and fear, and lack of health care worker competence. Country-specific contextual barriers included supply chain issues, civil conflict (Ethiopia), and labor strikes (Kenya). Strategies chosen to mitigate barriers and support implementation and sustainability in both settings included leveraging community health workers to address resistance to care-seeking, health workers’ training, COVID-19 infection prevention measures, stakeholder engagement, and advocacy to integrate PSBI management into existing programs, policies, and training. Other strategies addressing emerging project-specific barriers, included improving follow-up through a community health desk and PSBI mobile app (Kenya) and supply chain strengthening (Ethiopia). Both projects improved PSBI management coverage, increased adoption and uptake, and informed national policy changes supporting potential for sustainability.

Conclusions

Pragmatic embedded implementation research effectively supports the identification of barriers and mapping to strategies designed to increase effective coverage of PSBI management when referral is not feasible during the COVID-19 pandemic. Despite differences in context, cross-cutting strategies identified could inform broader scale-up in the region, including during future health system shocks.

Peer Review reports

Background

While there has been considerable success in reducing under-5 mortality globally, similar success in reducing neonatal mortality remains a challenge [1]. A leading cause of preventable morbidity and mortality in this age group is possible serious bacterial infection (PSBI). The World Health Organization (WHO) and other partners have developed standards of care for diagnosis and treatment of PSBI, including care at primary care facilities when referral to higher levels of care is not feasible [2,3,4]. While the effectiveness of this approach is strong, implementation challenges across the cascade from diagnosis through full treatment have been recognized which threaten the potential impact on reducing neonatal mortality in many settings [5]. These barriers include both access and acceptability of PSBI management, the fidelity of diagnosis and care delivery, and adherence to recommended follow-up care by families [6,7,8]. Understanding the strategies needed to implement this revised strategy for PSBI management remains an important area for researchers and implementers. Never has this been more important than during the COVID-19 pandemic, where interruption of care in general, including for sick newborns, has been well documented across global settings.

Implementation Research (IR) evaluates the use of strategies to integrate evidence-based interventions into real-world settings to improve patient outcomes. There is a growing application of these methods to better evaluate, design, and iterate on work to implement evidence-based interventions into practice, including management of PSBI and in pandemics such as COVID-19 [9]. There is also a growing use of embedded IR, where researchers are part of the implementation team, recognized as important for supporting the transfer of research findings into practice [9,10,11]. Recent studies of PSBI management, when referral is not feasible, resulted in important insights into factors associated with gaps and success in implementation [5,6,7,8, 12]. Common barriers included unreliable supply chains of medicines, which threatened the provision of effective outpatient treatment; health information systems not designed to capture the key steps in diagnosis and treatment of sick newborns; weak referral systems; and limited human resource capacity [11, 13, 14] In contrast, facilitators included: the existing Integrated Management of Childhood and Neonatal Illness (IMNCI) program into which PSBI management could be integrated, trained community healthcare workers, and national leadership recognizing the importance of expanding PSBI management [5, 14]. These studies also identified the need for implementation strategies at multiple levels, including the national, health system, facility, health care worker, and community, recognizing that the integration of strategies into the care pathway for PSBI management requires multiple, sequential steps [5, 10, 15].

In 2020, implementing partners in Ethiopia, Kenya, and India were funded by the Bill & Melinda Gates Foundation to conduct embedded implementation research to identify and test strategies to address barriers and strengthen implementation of PSBI management when referral was not possible during the COVID-19 pandemic. All projects used implementation science frameworks, such as the Consolidated Framework for Implementation Research (CFIR), Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), and health systems frameworks, which encompass cascades of care and the WHO Health Systems Building Blocks in the formative evaluation phases of their work. The organizations had a long track record of supporting maternal and child health implementation in collaboration with their country’s Ministry of Health. Ethiopia and Kenya completed the project, while India’s work is ongoing. The sub-Saharan African projects offered the opportunity to understand contextual factors between and across the two settings and to compare strategies implemented along the PSBI care treatment cascade throughout the projects’ implementation phases. The emerging knowledge from these two projects is valuable to support work to achieve the goal of reduction of neonatal mortality rates globally, an important Sustainable Development Goal, and needed for effective universal health coverage for the youngest members of any community.

Methods

Study settings

Ethiopia’s health system comprises primary, secondary, and tertiary care levels, with primary care emphasizing preventive and promotive services through the Health Extension Program. Health posts, staffed by two female Health Extension Workers (HEWs), are key in delivering frontline health services.

Kenya’s health system is organized into five tiers, including national referral hospitals, county hospitals, health centers, dispensaries, and community health structures. At the community level, Community Health Volunteers (CHVs) play a vital role in delivering preventive and promotive health services, supervised by Community Health Assistants or Officers, and overseen by Community Health Committees.

In Ethiopia, the project was implemented by JSI Research & Training Institute, Inc. (JSI) between November 2020 and June 2022, in the Dembecha and Lume woredas (i.e., district) of the Amhara and Oromia regions, respectively. Dembecha woreda comprises 31 rural kebeles (i.e., the lowest administrative unit) with limited electricity and road accessibility, with the majority of residents living in rural areas. Lume, situated near Addis Ababa, the country’s capital, and Adama, the zonal capital, has approximately two-thirds of its population residing in rural settings. In contrast, the woreda boasts 35 rural kebeles with better access to health facilities, electricity, and road infrastructure. Community-based newborn care, including PSBI diagnosis and treatment when referral is not feasible, was integrated into Ethiopia’s Health Extension Program (HEP) in 2012. However, coverage of PSBI treatment remained low [16], with HEWs treating only 8% of expected pneumonia cases [17], and an average of 16 sick children per month were brought to HEWs for treatment [18]. This is due to multiple challenges, including inadequate HEP knowledge, supply chain constraints, and conflicting community beliefs around newborn care [19].

In Kenya, Living Goods and Lwala Community Alliance implemented the study in Busia and Migori counties, respectively, in collaboration with the county and sub-county health management teams and Population Council-Kenya as an evaluation partner. Busia and Migori counties are located in western Kenya, sharing borders with Uganda to the west and Tanzania to the south. These are predominantly rural areas that face challenges in healthcare and infrastructure. The management of PSBI, when referral is not feasible, was adopted in Kenya as part of an integrated approach to the IMNCI in 2018. At the community level, a simplified version of IMNCI is incorporated into integrated community case management (iCCM) module that includes the following strategies: postnatal home visits by CHVs within 48 h to assess for danger signs for the newborn and the mother, and if any, refer them to a nearby health facility; CHVs visits on days one, three and seven following birth; and for newborns referred to the health facility, upon their return home CHVs make follow-up visits for PSBI-confirmed cases. Initial implementation of the PSBI guidelines in Kenya experienced challenges, including weak linkages/referrals between community and primary health facilities, lack of awareness about PSBI service availability, and providers’ inadequate skills [19].

The emergence of COVID-19 exacerbated these challenges by straining the healthcare systems further. This strain was manifested through resource diversion, decreased client demand for maternal and child health services, and other constraints, contributing to the ongoing struggle to effectively address PSBI and other healthcare needs in these countries.

Study design

Pragmatic embedded implementation research was conducted in both the Ethiopia and Kenya projects. We defined pragmatic embedded implementation research (PEIR), as an approach of embedded IR using implementation research methods to drive local change and create generalizable knowledge, building on the literature for embedded implementation research and our experience in other projects [20,21,22,23]. In these projects, PEIR is done with and by teams involved in implementation, is designed to identify barriers, and to develop new or adapt existing strategies to overcome gaps in the delivery and uptake of effective interventions, such as treatment for PSBI when referral is not feasible.

Guided by the CFIR, RE-AIM, and health system frameworks that incorporate cascades of care and World Health Organization Health Systems Building Blocks, both projects conducted mixed formative quantitative and exploratory research from April to May 2021, followed by summative evaluations conducted between June and July 2022 to address contextual challenges and improve PSBI management during the COVID-19 pandemic. These evaluations included facility assessments and interviews with community health providers and program managers. Furthermore, in Ethiopia, before-after cross-sectional household surveys were conducted in April 2021 and June 2022 interviewing women who had given birth 2–14 months before data collection. Details of the study design are found elsewhere [24, 25].

Implementation research frameworks and models

A community of practice (CoP) was developed to support the IR, including monthly calls and an in-person meeting in October 2022 in Addis Ababa, Ethiopia. IR frameworks and models were chosen that had been used in low- and middle-income countries (LMICs), including the CFIR 1.0; and the RE-AIM framework to explore implementation challenges and guide measurement and evaluation of implementation outcomes [26, 27]. The group also developed a care cascade for PSBI management when referral is not feasible (Fig. 1) to map the implementation of strategies across the steps from case identification through treatment completion.

Fig. 1
figure 1

Cascade of care for diagnosis and management of PSBI when referral is not possible

Reflecting on the importance of the strategies targeting health system strengthening, the WHO Health Systems Building Blocks framework for grouping strategies was also leveraged to develop effective implementation strategies [28]. In addition, the group developed an adapted version of the Implementation Research Logic Model (IRLM) [29] to map cross-cutting contextual factors through the strategies, and proposed mechanisms to achieve targeted implementation outcomes. The IRLM is a compilation of IR frameworks, which supports mapping from contextual factors to strategies through proposed mechanisms to implementation, system, and clinical outcomes.

Data

Both projects developed and implemented a range of activities to capture contextual factors at baseline, including household surveys, facility surveys, and key informant interviews. End-line results were also captured by these two completed projects from project records and surveys conducted by each (Ethiopia November 2020-June 2022; Kenya June-July 2022). Notably, the end-line health facility assessment covered 65 health posts in Ethiopia and 38 primary healthcare facilities in Kenya. The facility surveys were crafted to assess the availability of drugs, equipment, and the implementation fidelity of strategies, including ongoing implementation challenges and adaptations. In Ethiopia, we interviewed 4,262 and 4,082 women who gave live birth 2–14 months before data collection and identified 374 and 264 PSBI cases in April 2021 and June 2022, respectively, to assess changes in implementation outcomes related to care-seeking practices for sick infants [24].

Project teams included an implementation researcher who led work to identify contextual factors, document strategies, and identify targeted implementation outcomes. In addition, the Northwestern University team reviewed protocols, emerging reports, and publications from the two country programs, as well as through a review of emerging results during CoP calls and ad hoc meetings.

Analysis

Results from the formative and end-line data, as well as initial and adapted strategies, targeted implementation outcomes, and results were synthesized from project reports, presentations, and during CoP calls and an in-person meeting in 2022, with follow-up calls held for clarification. The teams collaborated to map strategies across the cascade of PSBI management to review the synthesis of results within and across projects during virtual calls with each project and the in-person meeting. An IRLM was then developed as a method to summarize shared and differing factors, strategies, and outcomes. Results are reported using the Standards for Reporting Implementation Studies (STARI).

Results

Contextual factors

During the formative phase of the projects and throughout, barriers and facilitators were identified across the outer domain (global, including the COVID-19 pandemic, national, community, and individual), the inner domain (health system and facilities), actors including care providers and managers, the intervention (PSBI management when referral was not possible), and systems (i.e., supply chain, transport). Many contextual barriers and facilitators were shared across the two countries (and two sites within each country), although some unique factors were also identified. For example, in Ethiopia, conflict-affected one of the two sites, with supply chain challenges seen at the national level. In Kenya, industrial actions by health care workers (HCWs) were a barrier to implementation not seen in Ethiopia. The barriers and facilitators identified across both projects are summarized in Table 1. These include the existence of global recommendations for PSBI management when referral is not possible, as well as the degree of leadership at the global, funder, and national levels to reduce neonatal mortality rate (NMR).

Table 1 Contextual factors identified by the Ethiopia and Kenya projects for PSBI management when referral is not feasible during the COVID-19 pandemic, mapped based on the CFIR framework

Both projects identified existing programs for community-based care as key facilitators, although the design and scope differed between Ethiopia’s HEP (able to provide diagnosis and treatment) and the Women Development Army (outreach) compared to Kenya’s community health worker (CHW) program (outreach and referrals to primary health care (PHC) facilities). Kenya also has an existing electronic community-based information system, while in Ethiopia, this was newly implemented during the project through a separate initiative in one of the two project areas. At the individual and community levels, both projects had to address a lack of understanding and belief in the treatment of sick newborns and address transport barriers to accessing care. While the COVID-19 pandemic was an initial barrier, strategies to reduce risk as well as reduced rates of disease over time, made this less of a threat to implementation outcomes.

Strategies

Despite differences in settings, the projects identified many of the same strategies, although design and implementation sometimes differed to accommodate unique contextual factors (e.g., the war in Ethiopia, CHW scope of practice, health system structure, and COVID-19 rates). These strategies were mapped across the PSBI diagnosis and treatment care cascade and covered many of the WHO Health System Strengthening Building Blocks (Table 2) and across the care pathway for management of PSBI when referral is not feasible.

Table 2 Strategies mapped across the care pathway for management of PSBI when referral is not possible -

Strategies across multiple steps of the PSBI management care cascade

Some strategies were developed to address barriers and leverage facilitators mapped across the cascade, including leveraging existing CHWs (Ethiopia and Kenya) to integrate the work into existing primary care. Program monitoring and data use to improve quality across steps was also supported through health care worker audits and feedback, and the spread of learning (learning visits and a local community of practice).

Strategies targeting specific care cascade steps

Identification and screening

All projects implemented strategies to identify newborns, screen for, and diagnose PSBI cases. The Ethiopia and Kenya projects incorporated home visits to identify neonates requiring additional screening and follow-up. Digital health was also used to support data collection by CHWs in Kenya to improve identification and screening of newborns and tracking of care in Ethiopia. In both projects, strategies were developed to overcome barriers in cultural beliefs to accessing care for sick newborns. These included outreach through CHWs and engagement of key stakeholders and opinion leaders, such as in Kenya increasing CHVs involvement in their communities to improve caregiver confidence in treating sick young infants. A state-level sensitization workshop and a technical support unit were established in Ethiopia.

Diagnosis and treatment

Ethiopia and Kenya both implemented training for the healthcare workforce to identify and confirm PSBI diagnosis and to provide treatment according to national guidelines. These were further strengthened through job aids and supportive supervision. While some strategies were successful, challenges remained. For example, in Ethiopia, national gentamicin supply chain gaps were explored at the formative stage and persisted over time, resulting in significant barriers to treatment, which was not the case for Kenya’s project. In response, in Ethiopia, the team implemented local and national supply chain strengthening strategies, including engaging HCWs to adapt medication use, supply sharing through redistribution among woreda-level facilities, and national advocacy to address the gap, resulting in improvement in overall essential supplies across 98% of health posts.

Correct treatment and follow-up care

Both projects in Ethiopia and Kenya implemented a range of strategies, including home visits conducted by CHWs, community education initiatives, the utilization of digital health technologies, integration of PSBI into maternal and child health (MCH) and IMNCI programs, training sessions for healthcare workers, and supportive supervision to reinforce skills and knowledge among health workers and encourage adherence to treatment protocols and follow-up care. In addition, in Ethiopia, peer-learning sessions and primary health care unit (PHCU)--level performance reviews were conducted, accompanied by clinical mentoring meetings. These initiatives aimed to facilitate knowledge sharing among healthcare providers and improve clinical practices.

The IRLM (Fig. 2) was able to show how the strategies targeted many of the contextual factors, providing an understanding of the mechanism by which they were thought to facilitate the targeted outcomes.

Fig. 2
figure 2

Implementation Research Logic Model for Ethiopia and Kenya projects designed to increase PSBI access and delivery during COVID-19 and when referral is not feasible

Strategy adaptations

Initial developed strategies were sometimes adapted in response to changing contextual factors (e.g., COVID-19 infection risk levels) or outcomes which were falling short of expectations. For example, to improve CHW-delivered PSBI case identification, referral, and follow-up in Ethiopia, a community health volunteer desk was introduced nationally for monitoring at facility level once it became clear that the community-to-facility linkage needed to be strengthened. This was also supported by the adaptation of data collection mechanisms, for more effective real-time data collection on PSBI by community health volunteers, which was used to provide alerts for follow-up care.

Sustainability and scale

From the start, the projects implemented several strategies to support scale and sustainability locally and nationally. In Ethiopia and Kenya, both groups worked at the national level to strengthen the integration of PSBI management into national MCH/IMNCI strategies rather than treating PSBI programming as a vertical initiative. Both projects implemented deep stakeholder engagement across multiple levels, starting at the planning stage and continuing throughout the project. For example, the team in Ethiopia included a national and district strategy co-design workshop, the introduction of regular kebele-level multisector meetings, a national community of practice, and an assigned facility-level focal person to champion iCCM/PSBI integration. Similar work in the Kenya team included working with county and sub-county stakeholders to sensitize and gain buy-in, and advocacy work at the national level to ensure alignment and agreement as the project was implemented with the integration of emerging lessons into national policy.

Projects recognized that sustainment of the improvement in PSBI management reach and delivery, as well as national scale-up, will require ongoing work, including continued investment to strengthen the following areas: (1) the health workforce to improve capacity, training, knowledge, skills, and decrease workloads; (2) ongoing support of the supply chain to ensure availability of essential drugs and supplies; (3) ongoing strengthening of a network of care from the community-level, primary care, and higher levels across all providers; and (4) community education and engagement to continue to address cultural barriers to accessing PSBI care.

Implementation outcomes

Implementation outcomes were measured according to the RE-AIM and treatment cascade frameworks. Many of the strategies chosen through PEIR were effectively implemented, and implementation outcomes for PSBI management when referral is not feasible were emerging. The strategies were associated with improvement in several steps in the PSBI cascade (Table 3). For example, the Ethiopia site results of household survey showed a significant increase in the proportion of severely ill young infants (i.e., mothers report severe illness signs including infants with difficulty breathing, chest in-drawing, ceasing to feed well, unusually hot or cold, less active than usual, and/or convulsions) that took appropriate antibiotics (gentamicin injection and/or amoxicillin) from 32.6% [95% confidence interval (CI): 25.5–40.7] in April 2021 to 61.8% [95% CI: 51.0-71.6] in June 2022.

Table 3 RE-AIM implementation outcomes from baseline to end-line

Despite successful outcomes attributed to implemented strategies, barriers remain that hinder PSBI management, including perceived low quality of service and lack of trust in providers by communities; shortage of health extension workers (Ethiopia) and heavy workloads across health workforce; inadequate knowledge/skills of CHWs; persistent stockouts of essential supplies; and a lack of transport for referrals.

National policy and program impact

The policy impact of the work conducted in both Ethiopia and Kenya is significant and reflects, in part, the strategies and resulting outcomes enabled through the pragmatic embedded implementation research. For example, in Ethiopia, strategies were incorporated into community-level healthcare worker workstreams, weekly and monthly woreda reports, and their annual work plan. At the national level, the IR work informed the MoH’s 2023 and 2024 annual planning and forecasting of iCCM/PSBI commodities.

In Kenya, implementation strategies informed discussions on integrating PSBI indicators into the national health management information system. Based on the Kenya project’s findings, Kenya’s MoH adapted their national tools, including health management information systems (HMIS) and other reporting tools, as well as IMNCI and iCCM protocols, to incorporate PSBI management strategies from this work. In Kenya, PSBI management is now integrated into the community-level healthcare worker curriculum.

Finally, while critical barriers remain, the findings from both projects are already guiding sustainability and national scale-up efforts of PSBI management within each country and may offer important lessons for other LMICs seeking to improve neonatal care.

Discussion

The pragmatic embedded implementation research (PEIR) conducted in Ethiopia and Kenya demonstrated significant achievements in improving access to and quality of treatment for PSBI across the care cascade in neonates during the COVID-19 pandemic. Through a systematic analysis of common factors across settings and the tailored mapping of strategies to address barriers and leverage facilitators, these projects have achieved noteworthy progress in optimizing the integration of PSBI treatment in routine health system functions.

This PEIR drew upon previous PSBI treatment implementation research conducted in resource-constrained settings, leveraging insights gained from past experiences [11, 13, 14, 30,31,32,33,34]. Through this approach, the study identified both similarities and differences in implementation strategies and outcomes compared to previous research efforts. By building upon existing knowledge and adapting approaches to suit the specific contexts of Ethiopia and Kenya, the PEIR was able to identify and capitalize on previously successful strategies while also addressing unique challenges and opportunities present in each setting. This iterative process of learning from previous research ensured a more nuanced and contextually relevant approach to PSBI management in resource-constrained settings, Ethiopia and Kenya. The common barriers identified across projects included fear of COVID-19 infection, poor health referral systems, transport, and communication between higher-level care and PHC, low knowledge, and self-efficacy for treating PSBI among HCWs, weak community engagement, and a sub-optimal support system. While many factors were shared between the two countries, some unique challenges were also observed, such as conflict and shortage of drugs in Ethiopia and industrial actions by healthcare workers in Kenya. Both projects implemented a comprehensive array of strategies to identify newborns, screen for, and diagnose PSBI. Identification and registration of newborns and screening for infection; community engagement and education about newborn infections and COVID-19 preventive measures; stakeholder and opinion leaders engagement throughout the design and implementation phases; training of health workers and community volunteers, coupled with supportive supervision to reinforce motivation and skills; home visitation for identification, screening, and follow-up care; and strengthening referral and communication system were instrumental in overcoming barriers and facilitating the successful implementation of PSBI management interventions across the treatment cascade.

By employing implementation research models and frameworks, the projects were able to map out implementation strategies to address identified barriers and leverage facilitators effectively. Furthermore, they examined causal linkages with outcomes across the cascade and adapted strategies to suit the specific local resources and systems of each setting, ensuring the interventions were contextually relevant and impactful [15, 29]. The Community of Practice (CoP) helped partners coordinate implementation science frameworks, learn from others’ hands-on experience, and gain competencies in implementation science research design, implementation, and monitoring. The teams were actively involved in and shared adaptations of programs and strategies to respond to challenges, which helped them respond effectively to ongoing contextual challenges, including national conflicts and strikes. In addition, the CoP helped implement cross-country teams to identify shared strategies and metrics to support the potential for scale-up.

Evidence from this PEIR suggests increased access to and delivery of PSBI treatment across the care pathway and an improvement in neonatal outcomes attributable to the implemented interventions and strategies. A previous article from the same project also highlights the association of the PEIR approach on enhancing access to and delivery of PSBI treatment [24, 25, 35]. The study conducted an interrupted time series analysis of service statistics data from Ethiopia, revealing a significant increase in the monthly rate of PSBI cases treated by HEWs, thus underscoring the effectiveness of implemented strategies, which exceeded anticipated outcomes if these strategies were not in place. Concurrently, in Kenya, data from service statistics depicted an upward trend in the number of sick young infants receiving treatment at PHC facilities over time, indicating a growing demand for services catering to this demographic within the community during the intervention period [25]. Previous studies have also reported that such implementation strategies improved the treatment of PSBI [36,37,38]. Moreover, the process and results from the PEIR has yielded significant policy impacts in shaping healthcare policies and practices related to PSBI management in both countries, reflecting the integration of implementers into the research and relatively rapid results to inform policy changes. In Ethiopia, the integration of implementation strategies into community-level healthcare worker workflows and national planning processes, such as the Ministry of Health’s annual planning and forecasting, demonstrates the tangible incorporation of research findings into policy decisions. Similarly, in Kenya, the adaptation of national tools and guidelines to incorporate PSBI management strategies, including the integration of PSBI into community-level healthcare worker training curricula, underscores the influence on policy development and implementation.

Our study had several strengths. We were able to compare similarities and variations in the design, implementation, and evaluation processes using the same frameworks. This collaboration across countries helped us to better understand what works in which context and associated implementation outcomes. The use of the IRLM also helped to link the factors to strategies chosen to leverage facilitators or address barriers, which can support the work to generate evidence on strategies to improve PSBI treatment in LMICs. We did, however, have several limitations. The household surveys and facility assessments were structured as pre-post studies, limiting our ability to definitively attribute the observed outcomes solely to the implemented strategies. Also while the projects used the same frameworks, the definitions used for the outcomes differed, so we were not able to combine results. Finally, like many implementation research projects, the timeline was short for measuring sustainment as well as scale.

In conclusion, these methodologies effectively identified weaknesses in the PSBI management cascade of care, understood the underlying factors, and provided a process to select and test mitigating strategies through identified mechanisms and adaptations throughout the project period. The frameworks and methodologies provided an advantage over more traditional baseline and end-line evaluation. In addition, a community of practice strengthened rapid learning and sharing of cross-cutting strategies across different contexts needing to increase reach and delivery and can be scaled up in the respective countries and scaled out to similar settings in the region.

Data availability

The quantitative data used for this study are available as supplementary information from previously published articles [1017, 18]. Program reports used for this study would be available at request from the corresponding author.

Abbreviations

CFIR:

Consolidated Framework for Implementation Research

CHV:

Community health volunteer

CHW:

Community health worker

CoP:

Community of practice

EPHA:

Ethiopian Public Health Association

HEW:

Health Extension Program

HEW:

Health Extension Worker

iCCM:

Integrated community case management of common childhood illnesses

IMNCI:

Integrated management of common childhood and neonatal Illnesses

IR:

Implementation Research

IRLM:

Implementation Research Logic Model

JSI:

JSI Research & Training Institute, Inc.

LMICs:

Low-and middle-income countries

NMR:

Neonatal mortality rate

PEIR:

Pragmatic Embedded Implementation Research

PHCU:

Primary health care unit

PPE:

Personal protective equipment

PSBI:

Possible serious bacterial infection

RE-AIM:

Reach, Effectiveness, Adoption, Implementation, and Maintenance

WDA:

Women’s Development Army

WHO:

World Health Organization

References

  1. United Nations Inter-agency Group for Child Mortality Estimation (UN IGME). Levels and trends in Child Mortality: Report 2022. New York: United Nations Children’s Fund; 2023.

    Google Scholar 

  2. World Health Organization. Integrated Management of Childhood Illness: management of the sick young infant aged up to 2 months. IMCI chart booklet. Geneva, Switzerland: WHO; 2019.

    Google Scholar 

  3. World Health Organization. Pocket book of hospital care for children: guidelines for the management of common childhood illnesses. 2 ed. Geneva, Switzerland: WHO; 2013.

    Google Scholar 

  4. World Health Organization. Guideline: managing possible serious bacterial infection in young infants when referral is not feasible. Switzerland, Geneva: World Health Organization; 2015.

    Google Scholar 

  5. Nisar YB, Aboubaker S, Arifeen SE, Ariff S, Arora N, Awasthi S, et al. A multi-country implementation research initiative to jump-start scale-up of outpatient management of possible serious bacterial infections (PSBI) when a referral is not feasible: Summary findings and implications for programs. PLoS ONE. 2022;17(6):e0269524.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  6. Wammanda RD, Adamu SA, Joshua HD, Nisar YB, Qazi SA, Aboubaker S, et al. Implementation of the WHO guideline on treatment of young infants with signs of possible serious bacterial infection when hospital referral is not feasible in rural Zaria, Nigeria: challenges and solutions. PLoS ONE. 2020;15(3):e0228718.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  7. Roy S, Patil R, Apte A, Thibe K, Dhongade A, Pawar B, et al. Feasibility of implementation of simplified management of young infants with possible serious bacterial infection when referral is not feasible in tribal areas of Pune district, Maharashtra, India. PLoS ONE. 2020;15(8):e0236355.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  8. Bhura M, Ariff S, Qazi SA, Qazi Z, Ahmed I, Nisar Yb, et al. Evaluating implementation of management of possible serious bacterial infection (PSBI) when referral is not feasible in primary health care facilities in Sindh province, Pakistan. PLoS ONE. 2020;15(10):e0240688.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  9. Hirschhorn L, Smith JD, Frisch MF, Binagwaho A. Integrating implementation science into covid-19 response and recovery. British Medical Journal Publishing Group; 2020.

  10. Ariff S, Soofi SB, Suhag Z, Chanar S, Bhura M, Dahar Z, et al. Implementation research to increase treatment coverage of possible serious bacterial infections in young infants when a referral is not feasible: lessons learnt. J Public Health. 2022. https://doi.org/10.1093/pubmed/fdab409

    Article  Google Scholar 

  11. Gebretsadik A, Melaku N, Haji Y. Community Acceptance and Utilization of Maternal and Community-Based Neonatal Care Services Provided by Health Extension Workers in Rural Sidama Zone: Barriers and Enablers: A Qualitative Study. Pediatric health, medicine and therapeutics. 2020;11:203 – 17. https://doi.org/10.2147/phmt.S254409

  12. Awasthi S, Kesarwani N, Verma RK, Agarwal GG, Tewari LS, Mishra RK, et al. Identification and management of young infants with possible serious bacterial infection where referral was not feasible in rural Lucknow district of Uttar Pradesh, India: an implementation research. PLoS ONE. 2020;15(6):e0234212.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  13. Tareke KG, Lemu YK, Feyissa GT. Exploration of facilitators of and barriers to the community-based service utilization for newborn possible serious bacterial infection management in Debre Libanos District, Ethiopia: descriptive qualitative study. BMC Pediatr. 2020;20(1):1–14.

    Article  Google Scholar 

  14. Leul A, Hailu T, Abraham L, Bayray A, Terefe W, Godefay H, et al. Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when a referral is not feasible: findings from implementation research. PLoS ONE. 2021;16(2):e0244192.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  15. Tiruneh GT, Nigatu TG, Magge H, Hirschhorn LR. Using the Implementation Research Logic Model to design and implement community-based management of possible serious bacterial infection during COVID-19 pandemic in Ethiopia. BMC Health Serv Res. 2022;22(1):1515. https://doi.org/10.1186/s12913-022-08945-9

    Article  PubMed  PubMed Central  Google Scholar 

  16. Tiruneh GT, Hirschhorn LR, Fesseha N, Emaway D, Eifler K, Betemariam W. Care-seeking behaviours of mothers and associated factors for possible serious bacterial infection in young infants during COVID-19 pandemic in Ethiopia: mixed-methods formative research. BMJ Open. 2023;13(7):e073118. https://doi.org/10.1136/bmjopen-2023-073118

    Article  PubMed  PubMed Central  Google Scholar 

  17. Tadesse Y, Eniyew A, Mengistu B, Eniyew A, Marsh D. Utilization of integrated community case management services in three regions of Ethiopia after two years of implementation. Ethiop Med J. 2014;52(Suppl 3):47–55.

    PubMed  Google Scholar 

  18. Amouzou A, Hazel E, Shaw B, Miller NP, Tafesse M, Mekonnen Y, et al. Effects of the integrated community case management of childhood illness strategy on child mortality in Ethiopia: a cluster randomized trial. Am J Trop Med Hyg. 2016;94(3):596.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Liambila W, Were F, Abuya T, Odwe G, Natecho A, Mungai S, et al. Institutionalizing the Management of Sick Young Infants: Kenya’s Experience in Revising National Guidelines on Integrated Management of Newborn and Childhood Illnesses. Global health. Sci Pract. 2023;11(2). https://doi.org/10.9745/ghsp-d-22-00482

  20. Marten R, Reveiz L, Aslanyan G, Perez F, Ghaffar A. The value and impact of embedded implementation research: insights from Latin America and the Caribbean. Revista Panam De Salud Pública. 2021;45:e110.

    Google Scholar 

  21. Churruca K, Ludlow K, Taylor N, Long JC, Best S, Braithwaite J. The time has come: embedded implementation research for health care improvement. J Eval Clin Pract. 2019;25(3):373–80.

    Article  PubMed  Google Scholar 

  22. Binagwaho A, Hirschhorn LR. Using implementation research to understand lessons in reducing child mortality. BMC Pediatr. 2024;23(Suppl 1):654.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Peters MA, Cloete K, Odwe G, Tadele G, Hirschhorn LR, Magge H, et al. Embedding implementation research to cross the quality of care chasm during the covid-19 pandemic and beyond. BMJ. 2023;383:e076331. https://doi.org/10.1136/bmj-2023-076331

    Article  PubMed  PubMed Central  Google Scholar 

  24. Tiruneh GT, Fesseha N, Emaway D, Betemariam W, Nigatu TG, Magge H, et al. Effect of community-based newborn care implementation strategies on access to and effective coverage of possible serious bacterial infection (PSBI) treatment for sick young infants during COVID-19 pandemic. PLoS ONE. 2024;19(3):e0300880. https://doi.org/10.1371/journal.pone.0300880

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  25. Tiruneh GT, Odwe G, Kamberos AH, K’Oduol K, Fesseha N, Moraa Z, et al. Optimizing integration of community-based management of possible serious bacterial infection (PSBI) in young infants into primary healthcare systems in Ethiopia and Kenya: successes and challenges. BMC Health Serv Res. 2024;24(1):280. https://doi.org/10.1186/s12913-024-10679-9

    Article  PubMed  PubMed Central  Google Scholar 

  26. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health. 2019;7:64.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50

    Article  PubMed  PubMed Central  Google Scholar 

  28. World Health Organization. Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. World Health Organization; 2010.

  29. Smith JD, Li DH, Rafferty MR. The implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement Science: IS. 2020;15(1):84. https://doi.org/10.1186/s13012-020-01041-8

    Article  PubMed  PubMed Central  Google Scholar 

  30. Tareke KG, Lemu YK, Yidenekal SA, Feyissa GT. Community’s perception, experiences and health seeking behavior towards newborn illnesses in Debre Libanos District, North Shoa, Oromia, Ethiopia: qualitative study. PLoS ONE. 2020;15(1):e0227542. https://doi.org/10.1371/journal.pone.0227542

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  31. Asfaha MD, Comeau DL, Spangler SA, Spratt BL, Alamineh L, Gobezayehu AG, et al. Neonatal care and community-level treatment seeking for possible severe bacterial infection (PSBI) in Amhara, Ethiopia. BMC Health Serv Res. 2020;20:1–12.

    Article  Google Scholar 

  32. Onarheim KH, Moland KM, Molla M, Miljeteig I. I wanted to go, but they said wait’: mothers’ bargaining power and strategies in care-seeking for ill newborns in Ethiopia. PLoS ONE. 2020;15(6):e0233594. https://doi.org/10.1371/journal.pone.0233594

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  33. Estifanos AS, Kazmi K, Morris SK. Could COVID-19 Reverse the Modest gains made in Newborn Health in Ethiopia? Matern Child Health J. 2021;25(6):849–54.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Gebreegziabher SB, Marrye SS, Kumssa TH, Merga KH, Feleke AK, Dare DJ, et al. Assessment of maternal and child health care services performance in the context of COVID-19 pandemic in Addis Ababa, Ethiopia: evidence from routine service data. Reproductive Health. 2022;19(1):42. https://doi.org/10.1186/s12978-022-01353-6

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  35. Odwe G, Liambila W, K’Oduol K, Nyangacha Z, Gwaro H, Kamberos AH, et al. Factors influencing community-facility linkage for case management of possible serious bacterial infections among young infants in Kenya. Health Policy Plann. 2024;39(1):56–65.

    Article  Google Scholar 

  36. Avan BI, Berhanu D, Mekonnen Y, Beaumont E, Tomlin K, Allen E, et al. Embedding Community-based Newborn Care in the Ethiopian health system: lessons from a 4-year programme evaluation. Health Policy Plann. 2021;36(Supplement1):i22–32. https://doi.org/10.1093/heapol/czab085

    Article  Google Scholar 

  37. Mukhopadhyay R, Arora NK, Sharma PK, Dalpath S, Limbu P, Kataria G, et al. Lessons from implementation research on community management of possible serious bacterial infection (PSBI) in young infants (0–59 days), when the referral is not feasible in Palwal district of Haryana, India. PLoS ONE. 2021;16(7):e0252700. https://doi.org/10.1371/journal.pone.0252700

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  38. Berhane M, Girma T, Tesfaye W, Jibat N, Abera M, Abrahim S, et al. Implementation research on management of sick young infants with possible serious bacterial infection when referral is not possible in Jimma Zone, Ethiopia: challenges and solutions. PLoS ONE. 2021;16(8):e0255210. https://doi.org/10.1371/journal.pone.0255210

    Article  PubMed  PubMed Central  CAS  Google Scholar 

Download references

Acknowledgements

We thank the Bill & Melinda Gates Foundation for funding these implementation research projects. The implementation of this survey would not have been possible without the support of Ethiopia’s and Kenya’s Ministry of Health, district/county health offices, and other development partners. The authors would like to acknowledge the PSBI treatment PEIR community of practice participants from Ethiopia, Kenya, India, WHO, and UNICEF for collaborative learning. We acknowledge the interviewers and the supervisors for accomplishing the fieldwork on schedule. Finally, we extend our gratitude to all study participants who provided us with invaluable information.

Funding

These implementation research projects were funded by the Bill & Melinda Gates Foundation, Investment Number INV-024241. However, the funder did not play a role in the study design, data collection, or analysis.

Author information

Authors and Affiliations

Authors

Contributions

LRH: drafted the manuscript and supervised the PEIR projects. LRH, GT, and GO curated the data. All authors contributed to the study conception and design; synthesized, interpreted, and provided critical review. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lisa R Hirschhorn.

Ethics declarations

Ethics approval and consent to participate

For the Ethiopia project, ethical clearance was obtained from the Ethiopian Public Health Association (EPHA) Research Ethics Review Committee (Reference #: EPHA/OG/166/21 dated April 16, 2021) and renewed for the end-line survey (Reference #: EPHA/OG/781/22 dated April 18, 2022). In Kenya, the study was approved by the Amref Ethics and Scientific Review Committee (as ESRC P949/2021) and the Population Council’s Institutional Review Board (as Protocol 968), while the National Commission for Science, Technology and Innovation (NACOSTI) granted the research permit. Northwestern University determined the project involved non-human subjects as no identifiable data was shared and the analyses involving the Northwestern University team leveraged existing, aggregate de-identified data. All study participants gave informed consent in both country projects.

Consent for publication

Not applicable as all figures were developed as part of the work.

Competing interests

The authors declare no competing interests. YBN is staff member of the World Health Organization. The authors alone are responsible for the views expressed in this article and they do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated. 

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tiruneh, G.T., Odwe, G., K’Oduol, K. et al. Improving possible serious bacterial infection (PSBI) management in young infants when referral is not feasible: lessons from embedded implementation research in Ethiopia and Kenya. BMC Pediatr 24, 599 (2024). https://doi.org/10.1186/s12887-024-05070-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12887-024-05070-w

Keywords