Skip to main content

Diagnostic test accuracy of point-of-care procalcitonin to diagnose serious bacterial infections in children

Abstract

Background

The National Institute for Health and Care Excellence (NICE) have called for research into the role of biomarkers, and specifically procalcitonin (PCT), for the early diagnosis of serious bacterial infections (SBI) in children. The aim of this study was to compare the diagnostic test accuracy of C-reactive protein (CRP) and PCT for the diagnosis of SBI in children.

Methods

Data was collected prospectively from four UK emergency departments (ED) between November 2017 and June 2019. Consecutive children under 18 years of age with fever and features of possible sepsis and/or meningitis were eligible for inclusion. The index tests were PCT and CRP and the reference standard was the confirmation of SBI.

Results

213 children were included in the final analysis. 116 participants (54.5%) were male, and the median age was 2 years, 9 months. Parenteral antibiotics were given to 100 (46.9%), three (1.4%) were admitted to a paediatric intensive care unit and there were no deaths. There were ten (4.7%) confirmed SBI. The area under the curve for PCT and CRP for the detection of SBI was identical at 0.70.

Conclusions

There was no difference in the performance of PCT and CRP for the recognition of SBI in this cohort.

Trial registration

Registered at https://www.clinicaltrials.gov (trial registration: NCT03378258) on the 19th of December 2017.

Peer Review reports

Background

Serious bacterial infections (SBI) can be difficult to distinguish from many self-limiting benign viral infections affecting children, especially during the prodrome. When the diagnosis is unclear, clinicians may use biomarkers, such as C-reactive protein (CRP) and procalcitonin (PCT), to aid clinical decision-making [1]. Procalcitonin is the precursor for calcitonin and is produced by parafollicular cells [2, 3]. It is a 116-amino acid protein that has roles in calcium metabolism [4]. PCT is elevated during infection and typically rises within two hours of the onset of a bacterial infection reaching a peak at 24 to 36 hours [4]. Procalcitonin levels are attenuated by the presence of interferon gamma that is typically released during viral infections leading to suggestions that PCT may have uses in distinguishing viral from bacterial infections [4].

The existing literature regarding the test accuracy of PCT in children is favourable with at least five meta-analyses demonstrating that PCT is accurate when used to diagnosis SBI across a range of paediatric settings [5,6,7,8,9]. The two most commonly used PCT cut-offs are 0.5 ng/ml and 2.0 ng/ml [5,6,7,8,9]. The lower cut-off of 0.5 ng/ml typically provides an approximate 80% sensitivity for the identification of SBI whereas the higher cut-off of 2.0 ng/ml typically provides a specificity of around 90% [5,6,7,8,9]. Two of the five meta-analyses compared PCT to CRP with both studies reporting that PCT was more accurate than CRP for the diagnosis of SBI in children [8, 9]. PCT has also been shown to be particularly useful in the assessment of febrile young infants under 90 days of age [10,11,12].

As technology evolves, there is increasing interest in the use of point-of-care (POC) biomarkers for the early recognition of SBI. There have been a number of studies exploring the use of POC CRP testing to identify SBI at presentation to healthcare [13, 14]. These studies have reported that the use of POC CRP can help to risk stratify children at triage/initial assessment [13]. Procalcitonin testing may however, represent the ideal POC test for detecting SBI in children due to its greater test accuracy.

The purpose of this sub-analysis of the Petechiae in Children (PiC) study was to report the diagnostic test accuracy of POC PCT for the diagnosis of SBI in children presenting to the Emergency Department (ED).

Methods

The PiC study was a mixed method prospective, multicentre cohort study, for which the full protocol is available as an open access publication [15]. The PiC study was designed and reported in line with the Standards for Reporting Diagnostic accuracy studies (STARD) statement [16].

Participants

Consecutive children under 18 years of age (initially limited to 14 years but extended to 18 years following an amendment) attending Emergency Departments (ED) with reported or recorded fever (≥ 38 °C) and features of meningococcal infection, sepsis, or meningitis with blood available for PCT testing were eligible for inclusion. Features of meningococcal infection included a non-blanching rash or a global assessment of likely sepsis/meningitis based on National Institute for Health and Care Excellence (NICE) guidance CG120 [17].

Children with pre-existing conditions predisposing to non-blanching rashes were excluded as were participants who were screened after admission when reference tests had already been performed. Participants for this sub-analysis were enrolled between the 9th of November 2017 and the 30th of June 2019 at four EDs in the UK (recruitment by site can be found in Table 1).

 

Table 1 Summary for the 213 study participants (n and (%) unless otherwise stated)

Test methods

The PCT index test was performed using the commercially available BRAHMS IB10 PCT test, on 0.5 ml of whole blood collected in Lithium Heparin paediatric blood bottles during routine phlebotomy. Samples were tested as soon as possible after collection using the Samsung LABEGO IB10 analyser, housed in the ED. The stepwise procedure involved pipetting 0.5 ml of the sample into the test disc before loading this onto the analyser and pressing run. The total run time for each sample was 20 minutes. In all instances the index test was performed prior to the reference standard results being available. The PCT result was not made available for use in the child’s clinical care. The CRP testing was performed in accredited NHS laboratories as part of the child’s routine investigations.

Reference standard

The reference standard was the diagnosis of a serious bacterial infection (SBI), the criteria for which are detailed below based on previously published definitions [5,6,7,8,9,10]. The reference standard tests were performed blinded to the result of the index tests except for clinical diagnoses such as cellulitis where an independent reference test does not exist.

  • Septicaemia (including bacteraemia): pathogenic bacteria isolated from blood culture or polymerase chain reaction (PCR).

  • Bacterial Meningitis: Identification of bacteria in cerebrospinal fluid using culture or PCR.

  • Appendicitis: confirmed on histology.

  • Pneumonia: infiltrate on chest X-ray confirmed by consultant radiologist.

  • Osteomyelitis: pathogens from bone aspirate, or MRI or bone scan suggestive of osteomyelitis.

  • Cellulitis: acute suppurative inflammation of subcutaneous tissues.

  • Bacterial gastroenteritis: pathogen isolated from stool culture.

  • Complicated urinary tract infection: >105/mL pathogens of a single species isolated from urine culture and systemic effects such as fever.

Follow up

Researchers at each site checked attendance records seven days after enrolment to monitor for any unplanned re-attendances by study participants. Where this occurred it was logged along with any change of diagnosis.

Analysis

The study population was described in terms of demographic characteristics. Simple descriptive statistics (total number and proportion) were used to describe vaccination status, parenteral antibiotic use, admission to intensive care units, and survival. The diagnostic accuracy of PCT and CRP at a range of cut-points was reported as sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and negative/positive likelihood ratios (LHR), with 95% confidence intervals (CI). The area under the curve (AUC) was calculated for both PCT and CRP. Patients where the index test PCT was not performed were excluded from analysis.

Consent Model

Due to the potentially life-threatening nature of SBI a research without prior consent (RWPC) model was used as described in detail elsewhere [18]. All participants were invited to provide written consent at the earliest appropriate opportunity once the child’s clinical condition had stabilised (typically within 24 hours of enrolment). All participants were free to decline consent without suffering any detriment.

Data Management

Study data were collected and managed using REDCap (Research Electronic Data Capture) [19]. Copies of the case report forms are available in the supplementary material.

Public and patient involvement (PPI)

PPI was integral within the PiC study from its outset. The PPI group assisted in its design including the protocol, study information, and RWPC methodology.

Office for Research Ethics Committees (OREC) and local Research Governance

The study was approved by both the Northern Ireland OREC (Project ID 224,660, OREC ID 17/NI/0169) and by the Belfast Health and Social Care Trust Research Governance.

Study Registration

The PiC study was registered at https://www.clinicaltrials.gov (trial registration: NCT03378258) on the 19th of December 2017.

Results

A total of 327 consecutive children were screened for eligibility across the four sites, of which 25 were ineligible and 89 did not have sufficient blood available for PCT testing (Fig. 1). Amongst the 89 with insufficient blood available for PCT testing there were four serious bacterial infections (4.5%). The SBI comprised of one case of septicaemia, one urinary tract infection and two children with pneumonia.

Fig. 1
figure1

Flow of participants through the study

A total of 213 children were included in the final analysis. Reference standard testing was performed in all but four participants; all four were diagnosed with a viral illness, were discharged, and did not re-attend. 116 participants (54.5%) were male, and the median age was 2 years, 9 months (range 1 month − 13 years, 11 months), with 166 (77.9%) aged five years or younger. A total of 208 (97.8%) were appropriately vaccinated for age according to the UK vaccination schedule. Parenteral antibiotics were given to 100 (46.9%), three (1.4%) were admitted to a paediatric intensive care unit (PICU), and there were no deaths. There were ten (4.7%) confirmed SBI (Table 1). The AUC for PCT and CRP for the detection of SBI were identical at 0.70 (p = 1.00). The sensitivity, specificity, predictive values and LHR of CRP and PCT over a range of values are presented in Tables 2 and 3. There were no adverse events reported in association with the index testing.

Table 2 Diagnostic test accuracy of procalcitonin for diagnosing serious infection
Table 3 Diagnostic test accuracy of C-reactive protein for diagnosing serious infection

Discussion

In this study there was no difference in the performance of PCT and CRP for the recognition of SBI amongst febrile children attending the ED. In this cohort both CRP and PCT demonstrated an AUC of 0.70 (p = 1.00). The findings presented here are strikingly similar to those of Verbakel et al. who reported on over 5000 children from Belgium using a similar study design [13]. In that study the rate of SBI was 4.9% and the AUC for CRP was 0.76, though they did not examine PCT [13]. These data suggest that in low prevalence settings, such as the ED, that the indiscriminate use of PCT/CRP in febrile children is of limited value.

PCT may however be useful in other settings. Specifically for use in the assessment of febrile infants under 90 days of age and in the assessment of suspected sepsis [8, 10, 12]. In these settings PCT has been shown to consistently outperform CRP as the biomarker of choice (8.10,12). Further studies to explore the use of POC PCT in these settings would be welcome.

Although the presented data are from a small cohort of patients, the study was well designed and adherent to STARD standards with prospective data collection and blinding with regards to reference standard testing. The data reflect the real-world performance of PCT and CRP when used widely in febrile children attending the ED.

This study has a number of limitations however, the study was small with a low numbers of children with SBI. Within the SBIs there was an over representation of septicaemia (four) and cellulitis (three) with an under representation of pneumonia (zero). This likely reflects the study population and that most presented with a fever and rash or other symptoms of possible meningococcal infection.

The study was also limited by the high proportion of children without sufficient blood for PCT testing (n = 89). The population without sufficient blood for testing was similar to that of the overall study population with four SBIs (4.5%). This suggests that the reasons for not testing were due to the challenges of paediatric phlebotomy rather than any bias based on illness severity. In addition, the majority of recruited patients were from a single site and that most were under five years of age.

The findings should be cautiously interpreted, as they are not applicable to higher SBI prevalence settings such as inpatients or intensive care and are not applicable in cases of pneumonia or in infants under three months of age.

Conclusions

Serious bacterial infections are often difficult to differentiate from viral infections during the prodrome. It has been suggested that PCT may be superior to CRP for the diagnosis of SBIs in children [8,9,10]. The data presented here suggests that PCT and CRP both have only a moderate accuracy for detecting serious bacterial infections when use indiscriminately in febrile children attending the emergency department.

Availability of data and materials

All of the individual participant data collected during this study will be available (including data dictionaries) on the Queen’s University Belfast data repository. The full study protocol is available as an open access publication.

Abbreviations

CRP:

C-reactive protein

ED:

Emergency department

LHR:

Likelihood ratio

NICE:

National Institute for Health and Care Excellence

NPV:

Negative predictive value

OREC:

Office for Research Ethics Committees

PCR:

Polymerase chain reaction

PCT:

Procalcitonin

PPI:

Patient and public involvement

PPV:

Positive predictive value

REDCAP:

Research Electronic Data Capture

RWPC:

Research without prior consent

SI:

Serious infection

STARD:

Standards for Reporting Diagnostic accuracy studies

References

  1. 1.

    Fever in under 5s: assessment and initial management NICE guideline [NG143] Published date: November 2019. Available fromhttps://www.nice.org.uk/guidance/ng143.

  2. 2.

    Josko Markic. Biomarkers of sepsis in neonates and children. Signa Vitae. 2015. 10(2);1–9. https://doi.org/10.22514/SV102.122015.1.

  3. 3.

    Samraj RS, Zingarelli B, Wong HR. Role of biomarkers in sepsis care. Shock. 2013;40(5):358–65. https://doi.org/10.1097/SHK.0b013e3182a66bd6.

  4. 4.

    Soares LV, Pedro P, Márcio S. Silva José Roberto Lapa e, Barbosa Arnaldo Prata, Salluh Jorge Ibrain Figueira. Use of biomarkers in pediatric sepsis: literature review. Rev. bras. ter. intensiva [Internet]. 2016 Dec [cited 2020 Aug 31]; 28(4): 472–82. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-507X2016000400472&lng=en. https://doi.org/10.5935/0103-507x.20160080.

  5. 5.

    Van Den Bruel A, Haj-Hassan T, Thompson M, et al. Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. 2010;375:834–45.

    Article  Google Scholar 

  6. 6.

    England JT, Del Vecchio MT, Aronoff SC. Use of serum procalcitonin in evaluation of febrile infants: a meta-analysis of 2317 patients. J Emerg Med. 2014;47:682–8.

    Article  Google Scholar 

  7. 7.

    Giulia Trippella L, Galli M, De Martino CL, Elena Chiappini. Procalcitonin performance in detecting serious and invasive bacterial infections in children with fever without apparent source: a systematic review and meta-analysis. Expert Review of Anti-infective Therapy. 2017;15(11):1041–57. https://doi.org/10.1080/14787210.2017.1400907.

    CAS  Article  PubMed  Google Scholar 

  8. 8.

    Bell JM, Shields MD, Agus A, Dunlop K, Bourke T, Kee F, et al. Clinical and Cost-Effectiveness of Procalcitonin Test for Prodromal Meningococcal Disease-A Meta-Analysis. 2015. https://doi.org/10.1371/journal.pone.0128993.

  9. 9.

    Yo CH, Hsieh PS, Lee SH, et al. Comparison of the test characteristics of procalcitonin to C-reactive protein and leukocytosis for the detection of serious bacterial infections in children presenting with fever without source: a systematic review and meta-analysis. Ann Emerg Med. 2012;60:591–600.

    Article  Google Scholar 

  10. 10.

    Gomez B, Mintegi S, Bressan S, et al. Validation of the “step-by-step” approach in the Management of Young Febrile Infants. Pediatrics. https://doi.org/10.1542/peds.2015-4381.

  11. 11.

    Waterfield T, Maney J, Hanna M, et al. Point-of-care testing for procalcitonin in identifying bacterial infections in young infants: a diagnostic accuracy study. BMC Pediatr. 2018;18:387. https://doi.org/10.1186/s12887-018-1349-7.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  12. 12.

    Milcent K, Faesch S, Gras-Le Guen C, et al. Use of Procalcitonin assays to predict serious bacterial infection in young febrile infants. JAMA Pediatr. 2016;170:62.

    Article  Google Scholar 

  13. 13.

    Verbakel JY, Lemiengre MB, De Burghgraeve T, et al. Point-of-care C reactive protein to identify serious infection in acutely ill children presenting to hospital: prospective cohort study. Arch Dis Child. 2017. https://doi.org/10.1136/archdischild-2016-312384.

    Article  PubMed  Google Scholar 

  14. 14.

    Marieke B, Lemiengre JY, Verbakel R, Colman K, Van Roy T, De Burghgraeve. Frank Buntinx, Bert Aertgeerts, Frans De Baets & An De Sutter (2018) Point-of-care CRP matters: normal CRP levels reduce immediate antibiotic prescribing for acutely ill children in primary care: a cluster randomized controlled trial, Scandinavian Journal of Primary Health Care, 36:4, 423–436. https://doi.org/10.1080/02813432.2018.1529900.

  15. 15.

    Waterfield T, Lyttle MD, Fairley D, Mckenna J, Woolfall K, Lynn F, et al. The “Petechiae in children” (PiC) study: evaluating potential clinical decision rules for the management of feverish children with non-blanching rashes, including the role of point of care testing for Procalcitonin & Neisseria meningitidis DNA – a study protocol. BMC Pediatr [Internet]. 2018 Dec 30 [cited 2018 Sep 25];18(1):246. Available from: http://www.ncbi.nlm.nih.gov/pubmed/30060751.

  16. 16.

    Bossuyt PM. Reitsma JB, Bruns DE. Gatsonis CA, Glasziou PP. Irwig L, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ [Internet]. 2015 Oct 28 [cited 2018 Sep 25];h5527. Available from: http://www.bmj.com/lookup/doi/10.1136/bmj.h5527.

  17. 17.

    NICE. Meningitis (bacterial) and meningococcal septicaemia in under 16s: recognition, diagnosis and management | Guidance and guidelines | NICE. 2015. Available from: https://www.nice.org.uk/guidance/cg102.

  18. 18.

    Waterfield T. Lyttle MD, Shields M. Fairley D, Roland D. McKenna J, et al. Parents’ and clinicians’ views on conducting paediatric diagnostic test accuracy studies without prior informed consent: qualitative insight from the Petechiae in Children study (PiC). Arch Dis Child [Internet]. 2019 Oct 1 [cited 2019 Oct 17];104(10):979–83. Available from: http://www.ncbi.nlm.nih.gov/pubmed/31175126.

  19. 19.

    Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform [Internet]. 2009 Apr [cited 2019 Oct 17];42(2):377–81. Available from: http://www.ncbi.nlm.nih.gov/pubmed/18929686.

Download references

Acknowledgements

We would like to thank all of the children and their families who participated in this study. We would also like to thank all of the people involved with screening and recruiting patients to the PiC study. Including the Site leads Dr Julie-Ann Maney (Royal Belfast Hospital for Sick Children), Ms Kathryn Allison (Royal Lancaster Infirmary and Furness General Hospital) and Sarah Diment (Salisbury District Hospital). All authors have read and approved the manuscript.

Funding

This study was primarily funded by the Public Health Agency of Northern Ireland (EAT/5313/16). The Royal College of Emergency Medicine provided additional funding. The funders had no involvement in the design or conduct of the study.

Author information

Affiliations

Authors

Consortia

Contributions

TW, ML, DR, JAM, DF, JMcK and MDS conceived and designed the study. TW co-ordinated the running of the study including data management and site training. MC and BP were involved with the conduct of the study including data collection. KW provided study design expertise and designed the approach to consent. The author(s) have read and approved the final manuscript.

Corresponding author

Correspondence to Thomas Waterfield.

Ethics declarations

Ethics approval and consent to participate

The Northern Ireland Research Ethics Committee (REC Reference − 17/NI/0169) and the Belfast Health & Social Care Trust Research Governance (Reference 16201MS-SW) approved the protocol. All participants were invited to provide written consent to take part, consent was obtained from a parent or guardian on behalf of any participants under the age of 16.

Consent for publication

Not applicable

Competing interests

JMcK Holds share options in HiberGene Diagnostics Ltd. TW has received an honorarium for speaking at educational events for Thermofisher.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Waterfield, T., Maney, JA., Lyttle, M.D. et al. Diagnostic test accuracy of point-of-care procalcitonin to diagnose serious bacterial infections in children. BMC Pediatr 20, 487 (2020). https://doi.org/10.1186/s12887-020-02385-2

Download citation

Keywords

  • Procalcitonin
  • infection
  • paediatrics
  • bacterial infection
  • biomarkers