Skip to main content
  • Research article
  • Open access
  • Published:

The risk of acute events among patients with sickle cell disease in relation to early or late initiation of care at a specialist center: evidence from a retrospective cohort study

Abstract

Background

The greatest disease burden of sickle cell disease occurs early in life. Understanding factors that reduce disease related events in this period is therefore important. Hence, we assessed the impact of early care at a specialist center on the incidence of acute events during the first five years.

Methods

This was a retrospective cohort study among Jamaican children with sickle cell disease. Medical records of patients born January, 2004 to December, 2009, who were registered at the Sickle Cell Unit, a specialist care facility, were abstracted for dates of initiation to care, first occurrence and frequency of the outcomes of interest (vaso-occlusive crises, acute splenic sequestration, acute chest syndrome, and infection). Patients were classified according to whether initiation of care was before (early) or after 5 months of age (late). Using standardized t-tests, χ2 tests, and a multiple-failure survival analysis the rates of acute events between groups were compared.

Results

Of the total study group (n= 290), homozygous sickle cell disease accounted for 97% and 95% of the early (n=113) and late groups (n=177) respectively. The mean age of presentation in the early and late group was 0.2 and 2.3 years (p<0.01), with a mean length of follow-up of 5.2 and 3.2 years respectively (p<0.01). Vaso-occlusive crisis (n=880) and acute chest syndrome (n= 571) together accounted for 91.6% of the total number of events (n=1584). The risk of vaso-occlusive crisis and acute chest syndrome (among patients who presented with these acute events) was significantly higher in the “late” group, by 43% (Incidence rate ratio, (IRR) = 1.43, p<0.001); 95% CI (1.18-1.72) and 40% (IRR=1.40. p=0.002), 95% CI (1.12-1.75) respectively compared to “early” group. There was no difference in risk between groups for acute splenic sequestration and infection among persons presenting with these events.

Conclusion

The risk of acute events in children with sickle cell disease exposed to early care at a specialist care is significantly less. Therefore, widespread screening with rapid referral to a specialist center stands to reduce substantial morbidity in Jamaica and other regions with high prevalence of sickle cell disease.

Peer Review reports

Background

Sickle cell disease (SCD) is associated with multiple acute events. These events include vaso-occlusive crisis (VOC), acute chest syndrome (ACS), acute splenic sequestration (ASS) and infection [1, 2]. Patients with the haemoglobin (Hb) genotypes homozygous sickle cell disease, (HbSS), sickle βeta thalasaemia0, (HbSβ0) and haemoglobin SOArab, (HbSOA) are known to have more severe disease compared to those with milder genotypes such as haemoglobin SC, (Hb SC), and sickle βeta thalassemia+, (HbSβ+) [3]. Among affected populations, the greatest disease burden occurs early in life and can be reduced by interventions that aim to reduce the frequency and severity of early events in persons with sickle cell disease [4].

The implementation of interventions such as disease education and penicillin prophylaxis among children with homozygous sickle cell disease in the 1980 s and newborn screening (NBS) has led to significant improvements in mortality when past and present cohorts have been compared in Jamaica [5]. These interventions are well established at the Sickle Cell Unit (SCU) in Kingston, Jamaica [6, 7].

Parental education encourages early recognition of symptoms associated with VOC, ACS, ASS and infection. Results from the Jamaica Sickle Cell Cohort study show that training parents to detect splenomegaly reduced fatalities of ASS from 28–3% of reported ASS episodes [5].

Prevention of invasive pneumococcal disease (IPD) includes penicillin prophylaxis and pneumococcal immunization [8,9,10,11,12]. Pneumococcal immunization includes both a conjugated pneumococcal vaccine and a polyvalent pneumococcal vaccine. While the latter has been available very early in Jamaica the former became available at the SCU in 2010 hence this cohort of children (who were born between 2005 and 2009) did not have had access to it as infants, however they would have benefitted from a catch-up schedule when it became available. Penicillin prophylaxis is commenced from the age of four months of age [6]. In Jamaica, “specialist” care for SCD falls under the purview of the SCU throughout most of the island. Haematologists have limited involvement in the care of persons with SCD.

Survival estimates for children with SCD have improved over recent years, [13, 14] as evidenced by the fact that, mortality in children < 5 years of age with SCD diagnosed at birth and managed at a comprehensive care clinic in Jamaica is no worse than that of the general population [15]. The impact of early compared to late care on the incidence acute events in persons with sickle cell disease largely unexposed to disease modifying therapies such as hydroxyurea or chronic blood transfusion therapy, is unclear. There are very few studies that examine the incidence of acute events in patients with sickle cell disease in relation to age at treatment initiation.Thus, our study was undertaken to determine the difference in the incidence of acute events before 5.5 years of age between patients with early and late treatment initiation.

Methods

Study design and population

We assessed the impact of early interventions on the incidence of acute events in a retrospective cohort of Jamaican children diagnosed with sickle cell disease. The study population was restricted to patients registered at the SCU. The database was queried between January 2015 and May 2016 to identify all children with date of birth between January 2005 and December 2009. Each patient’s clinical history from birth to 5.5 years was ascertained from the SCU chart, discharge summaries, and hospital notes when discharge summaries were unavailable or inadequate. Other morbidity indicators examined were proportion of patients who were: splenectomised, admitted to hospital and ICU in particular, and who experienced episodes of VOC requiring strong opioids, ACS requiring oxygen and ASS requiring transfusion. Patient visits which occurred less than 2 weeks apart due to the same event were counted as the same event.

Patient classification

Patients were categorized into two groups for comparison of rates of acute events and other morbidity indicators. Those whose age at first visit was before 5 months were classified as “early presenters” and those whose age at first visit was 5 months or older were classified as “late presenters”. The first visit represents the date of registration to the clinic. If the patient was sick at this time, this was also documented as the date of the first presentation of an acute event. The age of five months was chosen as the cut-point as patients are rarely symptomatic prior to this time [6]. Only patients with haemoglobin (Hb) genotypes with similar disease severity were included, homozygous sickle cell disease, (HbSS), sickle βeta thalassemia0 (HbSβ0) and haemoglobin SOArab (HbSOA).

Acute events

The incidence of four potentially severe acute events was compared. These included: VOC, ACS, ASS and infection. VOC was defined as a painful event attributed to SCD, and required medical attention either in an emergency department, or at the SCU, whether or not a hospital admission was required. An episode of ACS was defined as a history of fever and or respiratory symptoms with supporting radiological findings; those diagnosed as ACS without a supporting chest radiograph were excluded. An episode of ASS was defined as an enlargement of the spleen with a fall in haemoglobin concentration of greater than or equal to two grams/dL from baseline. All cases of infection had to be supported by a positive culture report.

Interventions

A standard set of interventions were offered to all patients at registration at the first visit. These were parent/caregiver disease education, splenic palpation to identify splenic enlargement, as well as pain and fever management. Genotype confirmation at nine to twelve months of age was important especially for those with HbSS pattern in order to rule out HbSβthal. Infection prevention strategies implemented, included the administration of conjugated pneumococcal vaccines for all genotypes from age six to eight weeks, and penicillin prophylaxis beginning at four months of age for severe genotypes [6].

Statistical analysis

Standardized t-tests (for continuous variables) and χ2 tests (for categorical variables) were used to determine if there were any differences in the distribution of the early and late groups. A multi-failure survival analysis was carried out on data from all patients in both groups. The event time was defined as the period between registration (time of first visit) and the event in years and the analysis time defined as the period from age of first visit to age 5.5 years. A multi-failure survival analysis was necessary as some patients had more than one episode of each event.

Stata Version 12 was used for the statistical analyses [16].

Ethics approval

The study protocol was reviewed and approved by the Ethics Committee of The University of the West Indies and the Ministry of Health through the four Regional Health Authorities in Jamaica.

Results

Figure 1 provides details on the 290 patients identified from records. The early group had 113 patients compared to 177 in the late group In the early group 92% (103) of patients were diagnosed by NBS compared to 64% (n = 114) of the late group (p < 0.010).

Fig. 1
figure 1

Flow diagram showing the proportion of early or late presenters diagnosed by newborn screening. N represents the number of patients

Table 1 shows further details of patients by genotype, mean age, follow up time and percentage uptake of targeted interventions in children. HbSS was the most common severe genotype. Two persons with HbSO presented late (1%). There were six (6) deaths, one in the early group and five (5) in the late group. The mean age of first visit for early presenters was 0.2 years (2.4 months) while that of late presenters was 2.3 years (27.6 months) (p < 0.01) with 5.2 years follow-up for the early group compared with 3.2 years for the late group (p < 0.010).

Table 1 Description of study patients by genotype, mean age, follow up time and percentage uptake of targeted interventions by early or late presentation to the Sickle Cell Unit in Jamaica (N = 290)

Ninety-eight percent (n = 111) of the early group received penicillin prophylaxis compared with only 76% (134) in the late group (p < 0.010).

However, the percentage of patients receiving pneumococcal polyvalent vaccine (p = 0.11) and at least two doses of conjugated pneumococcal vaccine (PCV) (p = 0.6190) was similar across both groups.

Table 2 shows the incidence rates of acute events and measures of morbidity in the retrospective cohort. Vaso-occlusive crisis (n = 880) and ACS (n = 571) were the most common acute events diagnosed. Vaso-occlusive crisis (n = 880) and ACS (n = 571) together accounted for 91.6% of the total number of events (n = 1584). There were significantly lower incidences of ACS and VOC for the early initiation of intervention group. Specifically, incidence rates for the late group for both ACS and VOC were 800/1000 person -years and 1000/1000 person-years, respectively compared to 570/ 1000 person-years and 700/ 1000 person-years for the early group (p-values < 0.010). Acute splenic sequestration (n = 112) and infection (n = 21) were relatively rare events. The differences in incidence rates for ASS and infection between the early and late groups of patients were not statistically different. We found no significant differences by early vs. late presenters in any of the other indicators of morbidity listed in Table 2.

We examined time to event for our four key outcomes with a multi-failure analysis (see Kaplan Meier survival curves, Fig. 2). The highest risk period for all events except infection was in the first 2years of life (Fig. 1). The risk of presenting with VOC and ACS, was 43% (p < 0.001); 95% CI (1.18–1.72), and 40% (p = 0.002), 95% CI (1.12–1.75) higher in “late” patients among patients presenting with these events. In patients presenting with ASS and infection the difference in risk between groups was not significant.

Fig. 2
figure 2

Kaplan-Meier survival curves showing incidences of acute events. Kaplan-Meier survival curves showing incidences of Acute Chest Syndrome (a); Vaso-occlusive crisis (b); Acute Splenic Sequestration (c) and Infection (d) in patients born between January 1, 2005 and December 31, 2009 who presented early or late to the Sickle Cell Unit in Jamaica and were followed from time of imitation of care at a specialist center to age 5.5years (N = 290)

Table 2 Comparison of incidence rates of acute events and morbidity indicators in patients who presented before (early) or after 5 months of age (late) to the Sickle Cell Unit in Jamaica (N = 290)

Discussion

Our aim was to determine the risk of specific acute events in patients with sickle cell disease based on early or late initiation of intervention. We found that the risk of ACS and VOC were substantially and significantly lower among children for whom care was initiated prior to age five months. However, the risk of ASS and infection did not differ significantly between groups. A comparison of morbidity in children with early and late treatment initiation was only found in one previous study by Vichinsky, carried out in Oakland, California, United States of America. [17] The findings of this study differed to ours; in the former study no differences were found in in the number of life-threatening events in patients who were identified in the NBS program compared to those diagnosed after three months. Differences in the method between studies included the fact that the time chosen as the cut point between groups was earlier than that selected in our study. Additionally, while in our study the milder genotype of haemoglobin SC was not included, this genotype was included in the group identified by newborn screening in the study being compared. Patients with Haemoglobin SC were not considered to have the same baseline risk as patients with HbSS of developing the outcomes of interest and therefore would make comparison between early and late groups difficult.

We also found that VOC and ACS accounted for the vast majority of events and occurred with high rates in our study. The incidence rate of VOC in both early and late presenters in event per person- years that was found in our study was very similar to that found in a larger study, where the incidence rates of VOC was 0.8 episode per patient-year in HBSS and 1.0 episode per patient-year in sickle beta 0-thalassemia in a group of patients ranging from newborn to 66 years of age [18]. This study found additionally, that the number of pain episodes per year was associated with early deaths in patients over 20 years of age who have sickle cell disease. This suggests that a high degree of morbidity can be averted with early initiation of care. These rates concur with VOC being the most common event experienced by children with SCD in other settings [19, 20].

Acute chest syndrome was the second most common event in both groups. The longitudinal Jamaican Cohort Study found ACS to be a major cause of death in persons with sickle cell disease in all age groups [7]. Reducing the incidence of both of these events by early interventions offered at a specialist center may therefore reduce substantial morbidity and mortality in Jamaica and other regions of the world with high prevalence of SCD even in populations without access to chronic transfusion therapy or hydroxyurea.

There was no difference in the severity of these events as evidenced by morbidity indicators such as frequency of admissions, ACS requiring oxygen, number of events that require strong opioids and the proportion of ASS requiring transfusion. This could indicate that while the incidence of events were significantly different between groups the severity were similar.

The number of episodes of ASS, though relatively less frequent was far more frequent in our study compared to a previous study in California where there was only 10 episodes over a longer study period [17]. Even though there was no significant reduction in the incidence of ASS in the early group, previous studies have shown that educating parents to palpate for the spleen daily has reduced mortality [5].

The number of confirmed cases of infections in both groups was small and similar to that seen in the study referred to previously [17]. Specifically, there were no cases of haemophilus influenza type B and the only case of Pneumococcus was not from the early group. It was possible that some patients may have received antibiotics before presentation to hospital which may have led to negative cultures being obtained.

Our study also highlights the finding that nearly two-thirds of the patients who presented late were actually screened for sickle cell disease (SCD) as newborns. Of 290 patients included in the study most were screened for SCD at birth including 64% of the “late” group. This indicates that even though children were identified as having SCD at birth via NBS and referred to SCU, they did not report for the first visit. This may have been due to challenges with contact tracing which reduced early enrolment of infants for example incorrect or indecipherable addresses and telephone numbers, or the family’s reluctance to follow-up when contacted, hence the reason for “late” entry into care at a specialist center. Despite resource constraints during the study period, the SCU attempted to trace infants who had a positive screening result. However, there is now a robust national newborn screening programme in Jamaica since 2015 of all births. Additionally the ability to trace patients has increased considerably through a national network. Newborn screening coverage in Jamaica increased to 98% of births after 2015, but it is reportedly as low as 45% in other Caribbean countries [21] and still non-existent in others.

There is need for more aggressive efforts to trace infants diagnosed with SCD and enroll them into care in a timely manner. The study demonstrates that early enrolment and subsequent early initiation of care may be an additional benefit and can only be successful if affected newborn babies are identified and parents present to and remain under the care of medical facilities with the capacity to offer lifesaving interventions. Implementation and expansion of NBS therefore needs to be accompanied by stronger linkage and retention programs for parents and their children if the demonstrated benefits of NBS [5] are to be fully realized. There is on-going work to improve linkage and retention programs for parents and their children such as training of health care workers across the island to assist in early enrolment of infants who are positive at NBS screening. Additionally, a status card will be added shortly to the health passport that is given to each infant at birth.

In spite of these challenges, survival estimates with SCD have improved over recent years [5]. In fact, mortality in children less than 5 years of age with SCD diagnosed at birth and managed at specialist care center in Jamaica is no worse than that of the general population [15]. Our retrospective cohort data provide part of the evidence for how this has been achieved, and how incremental improvements can be made and monitored. The risk of acute events in children with sickle cell disease exposed to early intervention was found to be significantly less. Therefore, widespread screening with rapid referral to a specialist center stands to reduce substantial morbidity in Jamaica and other regions with high prevalence of sickle cell disease. The authors suggest that this may be because physicians at specialist centers are able to monitor patients regularly and intervene with preventive and management options early and also because the physician can communicate with the parents/family on a regular basis and is able to encourage them to monitor the child and to seek care immediately.

Limitations

Of note, approximately, 20% of hospital notes were not accessed for reasons which included unavailability at the time of data entry and lack of resources to retrieve further data. These omissions would more likely under count incidences of events, thus the results presented here are conservative. In some settings radiographical support was not easily accessed and microbial culture reports were not available to confirm ACS or infections. The number of ASS events and infection cases were low which may have impacted the power of the statistical analyses.

Conclusions

The incidences of VOC and ACS were lower among children for whom care was initiated early. Our data strengthens the evidence that NBS with early intervention are essential to reduce the morbidity of sickle cell disease, even in the most resource-constrained settings.

Availability of data and materials

Data generated or analysed during this study are included in this manuscript and are not publicly available.

Abbreviations

VOC:

Vaso-occlusive crisis.

ASS:

Acute splenic sequestration.

ACS:

Acute chest syndrome.

NBS:

Newborn Screening.

SCD:

Sickle cell disease.

Hb:

Haemoglobin.

HbSS:

Homozygous sickle cell disease.

HbSβ0:

Sickle βeta thalasaemia0.

HbSOA:

Haemoglobin SOArab.

Hb SC:

Haemoglobin SC.

HbSβ+:

Sickle βeta thalassemia+.

IPD:

Invasive pneumococcal disease.

SCU:

Sickle Cell Unit.

PCV:

Conjugated pneumococcal vaccine.

IRR:

Incidence rate ratio.

CI:

Confidence interval.

Prot:

Protocol

References

  1. Gill FM, Sleeper LA, Weiner SJ, Brown AK, Bellevue R, Grover R, et al. Clinical events in the first decade in a cohort of infants with sickle cell disease. Cooperative Study of Sickle Cell Disease. Blood. 1995;86(2):776–83. .

    Article  CAS  Google Scholar 

  2. Serjeant GR, Ghosh K, Patel J. Sickle cell disease in India: A perspective. Indian J Med Res. 2016;143(1):21–4. .

    Article  Google Scholar 

  3. Saraf SL, Molokie RE, Nouraie M, Sable CA, Luchtman-Jones L, Ensing GJ, et al. Differences in the clinical and genotypic presentation of sickle cell disease around the world. Paediatr Respir Rev. 2014;15(1):4–12. .

    PubMed  Google Scholar 

  4. Serjeant GR. Sickle-cell disease. Lancet. 1997;350(9079):725–30. .

    Article  CAS  Google Scholar 

  5. King L, Fraser R, Forbes M, Grindley M, Ali S, Reid M. Newborn sickle cell disease screening: the Jamaican experience (1995–2006). J Med Screen. 2007;14(3):117–22. .

    Article  CAS  Google Scholar 

  6. Aldred KA, Beckford M, et al. Sickle Cell Disease: The Clinical Care Guidelines of the Sickle Cell Unit. 2nd ed. Sickle Cell Unit, Tropical Medicine Research Institute; 2015. .

  7. Serjeant GR, Chin N, Asnani MR, Serjeant BE, Mason KP, Hambleton IR, et al. Causes of death and early life determinants of survival in homozygous sickle cell disease: The Jamaican cohort study from birth. PLoS ONE. 2018;13(3):e0192710.

  8. Evidence-Based Management of Sickle Cell Disease Expert Panel Report. Database. 2014. https://www.nhlbi.nih.gov/sites/default/files/media/docs/sickle-cell-disease-report%20020816_0.pdf. Accessed 6 Aug 2020.

  9. Cober MP, Phelps SJ. Penicillin Prophylaxis in Children with Sickle Cell Disease. J Pediatr Pharmacol Ther. 2010;15(3):152–9. .

    PubMed  PubMed Central  Google Scholar 

  10. Gaston MH, Verter JI, Woods G, Pegelow C, Kelleher J, Presbury G, et al. Prophylaxis with oral penicillin in children with sickle cell anemia. A randomized trial. N Engl J Med. 1986;314(25):1593–9.

    Article  CAS  Google Scholar 

  11. Rankine-Mullings AE, Owusu-Ofori S. Prophylactic antibiotics for preventing pneumococcal infection in children with sickle cell disease. Cochrane Database Syst Rev. 2017;10(10).

  12. John AB, Ramlal A, Jackson H, Maude GH, Sharma AW, Serjeant GR. Prevention of pneumococcal infection in children with homozygous sickle cell disease. Br Med J (Clin Res Ed). 1984;288(6430):1567–70. .

    Article  CAS  Google Scholar 

  13. Lee A, Thomas P, Cupidore L, Serjeant B, Serjeant G. Improved survival in homozygous sickle cell disease: lessons from a cohort study. BMJ. 1995;311(7020):1600–2. .

    Article  CAS  Google Scholar 

  14. Powars DR, Chan LS, Hiti A, Ramicone E, Johnson C. Outcome of sickle cell anemia: a 4-decade observational study of 1056 patients. Medicine. 2005;84(6):363–76. .

    Article  Google Scholar 

  15. King LGC, Bortolusso-Ali S, Cunningham-Myrie CA, Reid MEG. Impact of a Comprehensive Sickle Cell Center on Early Childhood Mortality in a Developing Country: The Jamaican Experience. J Pediatr. 2015;167(3):702–5 (e1).

    Article  Google Scholar 

  16. StataCorp. Stata Statistical Software: Release 12. College Station. TX: StataCorp LP; 2011.

  17. Vichinsky E, Hurst D, Earles A, Kleman K, Lubin B. Newborn screening for sickle cell disease: effect on mortality. Pediatrics. 1988;81(6):749–55. .

    PubMed  CAS  Google Scholar 

  18. Platt OS, Thorington BD, Brambilla DJ, Milner PF, Rosse WF, Vichinsky E, et al. Pain in sickle cell disease. Rates and risk factors. N Engl J Med. 1991;325(1):11–6.

    Article  CAS  Google Scholar 

  19. Grannum D, Lashley PM. The morbidity pattern of children with sickle cell disorders admitted to the Queen Elizabeth Hospital, Barbados (2009–2013). Trop Doct. 2017;48(1):11–6.

    Article  Google Scholar 

  20. Quimby KR, Moe S, Sealy I, Nicholls C, Hambleton IR, Landis RC. Clinical findings associated with homozygous sickle cell disease in the Barbadian population – do we need a national SCD registry? BMC Res Notes. 2014;7(1):102.

    Article  Google Scholar 

  21. Knight-Madden J, Lee K, Elana G, Elenga N, Marcheco-Teruel B, Keshi N, et al. Newborn Screening for Sickle Cell Disease in the Caribbean: An Update of the Present Situation and of the Disease Prevalence. Int J Neonatal Screen. 2019;5(1):5.

    Article  Google Scholar 

Download references

Acknowledgements

We wish to acknowledge the work of Jerron Spence who assisted with data collection.

Funding

This study was funded by a New Initiative Grant, University of the West Indies, Mona, Kingston 7. The funding body had no role in the design of the study and collection, analysis, and interpretation of data or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

AERM conceived the study, AERM, TL, LK, CCM, CS and JKM contributed to the design of the study and development of the study protocol. AERM, TL and LK were responsible for overseeing data collection. TL completed the data analysis. AERM and TL drafted the manuscript, with all authors providing critical revisions to the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Angela Edna Rankine-Mullings.

Ethics declarations

Ethics approval and consent to participate

The study was reviewed and approved by the Mona Campus Research Committee, University of the West Indies Kingston, Jamaica and all Health Authorities from the Ministry of Health. The need for patient consent was waived as this was a retrospective cohort study which involved chart reviews and there was no recorded information that would render patients personally identifiable.

Consent for publication

This manuscript displays no individual person’s data.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rankine-Mullings, A.E., Logan, T.M., King, LG. et al. The risk of acute events among patients with sickle cell disease in relation to early or late initiation of care at a specialist center: evidence from a retrospective cohort study. BMC Pediatr 20, 373 (2020). https://doi.org/10.1186/s12887-020-02270-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12887-020-02270-y

Keywords