- Research article
- Open Access
Establishment of a pediatric trigger tool based on Global Trigger Tool to identify adverse drug events of children: experience in a Chinese hospital
BMC Pediatrics volume 20, Article number: 454 (2020)
The Global Trigger Tool (GTT),which is a method using “triggers” to review medical record retrospectively to identify possible adverse events. Several studies showed that the GTT was effective. However, there were only a few localized trigger tools that had been established to detect pediatric adverse drug events (ADEs) in China. This study aimed to establish a pediatric trigger tool based on GTT, to examine the performance by detecting pediatric inpatients ADEs in a Chinese hospital (a retrospective review), and to investigate the factors associating with the occurrence of ADEs.
The triggers were established by three steps including literature search, triggers extraction and revision, and experts investigation. A retrospective cohort study was conducted to detect ADEs by using 200 pediatric inpatient records of Sichuan Provincial People’s Hospital.
Thirty-three preliminary triggers were established, and 2 rounds of experts investigation were conducted. Finally, 33 triggers were established. In the retrospective review, the positive trigger rate was 64.0%, while the positive predictive value (PPV) was 24.9%. The occurrence of inpatients with ADEs was 20.5%. ADEs/100 admissions were 49.0. ADEs/1000 patient days were 46.89. The most common ADE categories were leukocyte disorders, skin disorders and platelet disorders. The severity of 39 ADEs was grade 1, 55 ADEs was grade 2, 4 ADEs was grade 3. The highest frequency of ADE-related drugs was antineoplastic, followed by antibacterial. The length of stay and the leukemia in the diagnosed diseases were positively correlated with ADEs.
The 33 pediatric triggers may detect ADEs effectively, but still need to be optimized. This study may provide some references for further research in order to improve the rationality and safety of medication.
A study of Institute for Safe Medication Practice (ISMP) showed that the incidence of potential adverse drug events (ADEs) in pediatric inpatients was about three times more than adult inpatients . Chinese Adverse Drug Reaction/Event Monitoring Report in 2016 showed that children’s adverse drug reaction(ADR)/ADE reports accounted for 9.9% of all ADR/ADE reports , indicated that Chinese children’s ADR/ADE needs more attention. In 2003, the American Institute for Health Promotion (IHI) introduced the Global Trigger Tool (GTT), and revised in 2009 . GTT is an ADE detecting method which developed on medical record review. Compared with the most widely used Voluntary Reporting Notification in China, GTT has obvious initiative. In recent ten years, several studies in domestic and overseas had shown the effectiveness of GTT in detecting ADE. IHI recommends that medical institutions should make appropriate revisions based on their own characteristics . At present, there are only a few localized trigger tools for detecting pediatric ADE in China. This study would like to establish a trigger tool based on GTT, which could provide a reference for the further modification of the trigger tool and more suitable for the local pediatric inpatients.
Aim and design
This study attempts to establish a trigger tool based on GTT to detect ADEs in pediatric inpatients, and to investigate the factors associating with the occurrence of ADEs. The trigger tool was established by three steps including literature search, triggers extraction and revision, and experts investigation. A retrospective cohort study was conducted to detect ADEs by using 200 pediatric inpatient records of Sichuan Provincial People’s Hospital.
Literature search, which contains the key words such as “pediatric trigger tool” and “trigger tool”, was performed by using the literature published from January 1996 to November 2016 on PubMed (http://pubmed.cn/) and CNKI (http://www.cnki.net/). Inclusive criteria: (1) specific items with triggers;(2) application of triggers in pediatric ADE detection; (3) the trigger had detecting results. Then, this study evaluated the quality of enrolled literatures through the Combieg cross-sectional method .
Triggers Extraction and Revision
Then, extracted preliminary triggers were from the included literature, and formed a review panel which included pharmacists and physicians. The panel revised preliminary triggers were based on pediatric authority guides, and added triggers through the ADR which had been reported a large number in the Chinese National Adverse Drug Reaction Monitoring System (NADRMS) from March 6, 2007 to March 6, 2017. During the revision process, pharmacists were responsible for inquiry and collation of the references, and physicians were responsible for identifying the consistency of the contents.
Experts Investigation (Delphi Methodology)
Delphi methodology was used to conduct experts investigation in this study. Under the principles of informed consent and voluntary participation, pediatric physicians and pharmacists were selected randomly from nationally-level medical institutions. Then the suggestions on preliminary triggers were put forward by these experts, including the rationality of triggers setting and interpretation. Next, triggers were modified based on the suggestions of experts. After a few rounds, a trigger tool which was highly recognized by experts was created finally.
Retrospective Records Review
This review was conducted in Sichuan Provincial People’s Hospital, a tertiary teaching hospital with 4,200 beds. We selected pediatric inpatient records from January 1, 2017 to September 30, 2017. Review panel also reviewed the records. The pharmacists reviewed the records primarily, and then the physicians authenticated the consensus of the pharmacists and provided answers to the questions about findings in a specific record raised by the record reviewers. The panel identified whether there existed a positive trigger according to the records, and determined whether any ADEs occurred. If there was no positive trigger but an ADE that was identified during the review process, this ADE would also need to be recorded. ADE data was collected by three ways: (1) adverse events per 1,000 patient days; (2) adverse events per 100 admissions; (3) percent of admissions with ADE  .
The categories of ADEs refer to WHO’s Adverse Reaction Terminology (WHO-ART) .
The assessment of ADE causality was based on WHO-UMC system . The causality categories included: certain, probable/likely, possible, unlikely, conditional/unclassified, unassessable/unclassifiable.
The severity of ADEs was evaluated by Common Terminology Criteria for Adverse Events (CTCAE)(Version 4.0). Grade 1: Mild; asymptomatic or mild symptoms; clinical or diagnostic observations only; intervention not indicated. Grade 2: Moderate; minimal, local or noninvasive intervention indicated; limiting age-appropriate instrumental activities of daily living(ADL). Grade 3: Severe or medically significant but not immediately life-threatening; hospitalization or prolongation of hospitalization indicated; disabling; limiting self care ADL. Grade 4: Life-threatening consequences; urgent intervention indicated. Grade 5: Death related to ADE.
Pediatric Inpatients Characteristics
In the retrospective review, a total of 200 inpatients from 200 pediatric records were identified, including 72 females and 128 males. The age ranged from 0 days to 18 years old, and the average age was 6.04 years. The inpatients were hospitalized from 2 days to 43 days, and the average hospital day was 10.45 days. The total hospital day was 2090 days. There were 1 to 6 species of diagnosed diseases per child, and the average species/record was 1.53. The most common diagnoses were pneumonia and bronchitis (57/200, 28.5%), leukemia (27/200, 13.5%), cardiovascular disease (23/200, 11.5%), sepsis and infection (20/200, 10.0%), and tonsillitis (15/200, 7.5%). The characteristics of inpatients were shown in Table 1.
Literature Search And Triggers Extraction
Forty-five literatures were retrieved through the literature search process, and 11 of them were in accordance with the inclusive criteria [8,9,10,11,12,13,14,15,16,17,18]. The quality level of one literature was grade B (score 5.5) , and the other 10 were grade A (score 6 to 7) [8,9,10,11,12,13,14,15,16,17]. The included literatures which detected ADEs in pediatric inpatients by trigger tools were from Canada, Britain, United States, Australia, Sweden, Netherlands and China. A total of 193 triggers were extracted from the included literatures, of which 115 triggers were deleted (60 triggers were repeated contents, 2 triggers were unclear descripted contents, 33 triggers had no positive trigger or the triggers were suggested deleted by authors of the included literatures because of low positive trigger rates), and 78 triggers were retained finally.
According to authoritative guidelines, 4 of the 78 triggers had been revised: (1) Similar triggers were merged. (2) Different indicators of some triggers were set through different age groups, such as hemoglobin (Hb), blood glucose (BG), white blood cell (WBC), thyroid stimulating hormone (TSH), etc. (3) Three indicators of the biomarkers of myocardial injury were selected simultaneously: creatine kinase isoenzyme (CK-MB), CK-MB/CK and hypersensitive troponin I (hs-cTnI). (4) Some indicators were added to the biomarkers of liver injury such as R indicator. According to the reports in NADRMS, the top 5 categories of ADRs were skin system damages (rash, itching, urticaria, erythema, etc.), vomiting, leukopenia, abnormal liver function, and constipation, with a total of 73 drugs were involved. Based on the above-mentioned drugs, 4 triggers were supplemented. At last, 33 preliminary triggers were established and they would be further revised through experts investigation.
A total of 99 experts participated in this investigation (56 pharmacists and 41 pediatricians). In the initial round, 91.8% (101/110) of the experts responded, and 41.6% (42/101) of them gave revisions. According to the opinions of experts, the triggers were modified, and the modified contents mainly include: (1) adjusting the contents of 29 triggers; (2) deleting one trigger which was lack of evidence (relieve antibiotic-related diarrhea by antidiarrheal or microecological drugs). One trigger (pediatric glucocorticoid-induced osteoporosis (GIPO) ) was added. In the second round, 98.0% (99/101) of the experts responded, and 3.0% (3/99) of them gave revised opinions, which includes: revising the contents of 2 triggers.
Finally, 33 pediatric triggers were established, and 3 modules include: 16 laboratory test triggers, 13 medication triggers, and 4 symptom triggers.
In the retrospective review, 128 records had at least one positive trigger. The rate of positive triggers was 64.0% (128/200), and 95% CI was 57.0%~71.0%. The triggers totally had 394 positive triggering, and 98 ADEs were identified from 41 records. The ADE positive predictive value (PPV, %) of the triggers was 24.9% (98/394), and the 95% CI was 20.1%~28.0%. Another 7 cases of ADEs involving 7 records were none positive trigger during the review process, while they were also been recorded. The triggers and PPV were shown in Table 2. The identified ADEs were shown in Table 3.
Characteristics of ADEs
The categories of ADEs: 98 ADEs involving 14 categories. The most common 3 categories were leukocyte disorders (21/98, 21.4%), skin disorders (11/98, 11.2%) and platelet disorders (10/98, 10.2%). The categories of ADEs were shown in Fig. 1.
The assessment of ADE causality: according to the WHO-UMC method, 4 cases (4.1%) were assessed as certain, 73 cases (74.5%) were assessed as probable/likely, 19 cases (19.4%) were assessed as possible, 1 case (1.0%) was assessed as conditional/unclassified due to the incomplete information of records, and 1 case (1.0%) was assessed as conditional/unclassified due to the contradiction between physician record and nursing record. The ADE-related drugs: a total of 52 drugs involving 16 categories. Antineoplastics had the highest frequency of occurrence, accounting for 44.1% (63/143), the top 3 drugs were cytarabine, methotrexate and vindesine; followed by antibiotics, accounting for 23.8% (34/143), the top 3 drugs were cefathiamiadine, piperacillin sodium and tazobactam sodium, imipenem and cilastatn. The ADE-related drugs were shown in Fig. 2.
The severity grade of ADEs: 39 ADEs were grade 1 (39/98, 39.8%), 55 ADEs (55/98, 56.1%) were grade 2 and 4 ADEs were grade 3 (4/98, 4.1%).
Risk Factors Associated With the Occurrence of ADEs
A regression model was established. After 2 rounds of variable screening, the “length of hospital day” and “leukemia” were included in the regression model. For each additional day of hospital stay, the risk of ADE would be increased by 20.8%. Leukemia might be the only diagnosed disease associated with the occurrence of ADE, which was 6.8 times higher than the other diagnosed diseases. There was no significant correlation between the “gender”, “age”, “number of diagnosed disease”, “other diagnosis” and the occurrence of ADE (P > .05). The logistic regression model was shown in Table 4.
In this study, 33 triggers were established based on GTT and modified through three steps (literature search, triggers extraction and revision, experts investigation). The application of triggers was based on GTT in the world, and combined with the opinions of Chinese pediatric experts, the established triggers were more suitable for local needs.
Based on the recommendations of the IHI white paper, a review panel was formed to discuss each review. The pharmacists were mainly responsible for the inquiry and collation of the materials, and the physicians were mainly responsible for identifying the consistency of the query contents.
In this study, the number of ADE identified by the trigger tool (49.0ADEs/100 admissions) was significantly more than the voluntary reporting system. The data in NADRMS showed that, in Sichuan Provincial People’s Hospital, only 2 cases of pediatric ADR/ADE were reported from January 1 to September 30, 2017. The rate of positive triggers, PPV and ADE detection rate in our research, were higher than many previous studies which used trigger tools to detect pediatric ADE[8,9,10,11,12,13,14,15,16,17,18, 37].
The triggers should be modified to reduce the false positive and increase the accuracy. The positive trigger frequencies of M7 and M13 were higher (75 and 17 cases), while the detections of ADEs were low (1 and 2 cases), and the PPV of them were also low (1.33 and 11.76). Among M13 positive trigger patients, 45.3% (34/75) were surgical patients who were often injected with crystalloid or colloid fluid to supplement functional extracellular fluid and to regulate electrolytes. So the routine rehydration of surgical patients should be considered to be excluded from M13 trigger. Among M7 positive trigger patients, 82.3% (14/17) were leukemia children during chemotherapy. Tumor patients often use antiemetics as a preventive medication during chemotherapy in clinical. So the M7 trigger should be considered to be revised: “vomit (due to surgery or drugs)”. During the retrospective review, 7 ADEs without positive trigger had been found. Among them, 5 ADEs were “diarrhea caused by the use of broad-spectrum antibiotics”, and all the 5 patients were infected by Gram-positive cocci. The PPV of M8 trigger was 0.0% (0/8). It could be supplemented as: “oral vancomycin /metronidazole or clostridium difficile-positive”. The other 2 ADEs were “methotrexate blood concentration 24 h > 10 µmol ·L− 1, and rescued by calcium leucovorin”. A trigger was considered to be added to the tool: “methotrexate blood concentration abnormal and rescued by calcium folinate (after methotrexate administration).”
There were 4 triggers without positive trigger including L16 and L8, L12, M5 which were originated from previous studies in other countries. It might be caused by the following factors: (1) the sample size was not enough, (2) the 200 medical records extracted in this study were less involved in the above triggers or the related drugs were less used in the hospital. For example, in M5 trigger, opioids were often used to moderate and severe pain such as cancer. However, in recent years, antitussive drugs containing opioids were not recommended for children under 18. So in our hospital, there might be fewer children using opioids. L16 trigger was a new item added based on expert opinions, and had no positive trigger in this study. For one thing, it might be because the children didn’t measure bone density as a regular item; for another, China had always attached great importance to the rational use of glucocorticoids in children.
This study also had some limitations. It was a retrospective study of randomly selected medical records, and each patient had only one hospitalization record. We didn’t have any other records about “rechallenge”, so most ADEs could be assessed as “probable/likely”, but not “certain”, according to the WHO-UMC method. The 33 pediatric triggers established in this study were only used in Sichuan Provincial People’s Hospital. Although it was the largest hospital in Sichuan Province, we recommend conducting retrospective records review in more hospitals and the triggers would been modified in future studies.
This was one of the few studies that have looked into detect ADEs in pediatric (including neonates) through establishing a trigger tool based on GTT in China. The study established 33 pediatric triggers through literature search, triggers extraction and revision, and experts investigation, to detected ADEs by retrospective cohort analysis. Our results showed that more than three-fifths pediatric inpatients had at least one positive triggers, more than one-fifth pediatric inpatients had ADEs, and the length of hospital stay and the leukemia patients were the high risk factors of ADEs. The 33 pediatric triggers may detect ADEs effectively, but still need to be optimized. This study may provide some references for further research in order to improve the rationality and safety of medication.
Availability of data and materials
Datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Adverse drug event
Adverse drug reaction
Global Trigger Tool
Positive predictive value
Common Terminology Criteria for Adverse Events
Kaushal R. Medication errors and adverse drug events in pediatric inpatients. JAMA. 2001;285(16):2114–20.
China Food and Drug Administration. Annual report on national ADR monitoring. (2016).Apr 28, 2017. Available at: http://samr.cfda.gov.cn/WS01/CL0844/172167.html.Accessed 5 May 2018.
Griffin FA, Resar RK. IHI Global Trigger Tool for Measuring Adverse Events (Second Edition). IHI Innovation Series white paper. Cambridge: Institute for Healthcare Improvement; 2009.
Crombie I. The pocket guide to critical appraisal. London: BMJ Publishing Group; 1996. pp. 35–48.
WHO. International monitoring of adverse reactions to drugs: adverse reaction terminology. Uppsala: WHO Collaborating Centre for International Drug Monitoring; 1992.
WHO. The use of the WHO-UMC system for standardised case causality assessment.. Available at:http://www.who.int/medicines/areas/quality_safety/safety_efficacy/pharmvigi/en. Accessed 1 Oct 2018.
U.S.DEPARTMENT OF HEALTH AND HUMAN SERVICES. Common Terminology Criteria for Adverse Events (CTCAE), National Institutes of Health, National Cancer Institute, 2009.
Matlow AG, Cronin CM, Flintoft V, et al. Description of the development and validation of the Canadian Paediatric Trigger Tool. BMJ Qual Saf. 2011;20(5):416–23.
Chapman SM, Fitzsimons J, Davey N, et al. Prevalence and severity of patient harm in a sample of UK-hospitalised children detected by the Paediatric Trigger Tool. BMJ Open. 2014;4(7):e005066.
Solevag AL, Nakstad B. Utility of a Paediatric Trigger Tool in a Norwegian department of paediatric and adolescent medicine. BMJ Open. 2014;4(5):e005011.
Stockwell DC, Bisarya H, Classen DC, et al. A trigger tool to detect harm in pediatric inpatient settings. Pediatrics, 2015;135(6):1036–1042.
Landrigan CP, Stockwell D, Toomey SL, et al. Performance of the Global Assessment of Pediatric Patient Safety (GAPPS) Tool. Pediatrics 2016;137(6):e20154076.
Maaskant JM, Smeulers M, Bosman D, et al. The trigger tool as a method to measure harmful medication errors in children. J Patient Saf. 2015;0(0):1–6.
Hooper AJ, TibballS J. Comparison of a Trigger Tool and voluntary reporting to identify adverse events in a paediatric intensive care unit. Anaesth Intensive Care. 2014;42(2):199–206.
Unbeck M, Lindemalm S, Nydert P, et al. Validation of triggers and development of a pediatric trigger tool to identify adverse events. BMC Health Serv Res. 2014;14(5):655.
Kirkendall ES, Kloppenborg E, Papp J,et al. Measuring adverse events and levels of harm in pediatric inpatients with the Global Trigger Tool. Pediatrics. 2012;130(5):e1206–14.
Takata GS, Mason W, Taketomo C, et al. Development, testing, and findings of a pediatric-focused trigger tool to identify medication-related harm in US children’s hospitals. Pediatrics. 2008;121(4):e927–35.
Ji HH, Song L, Xiao JW, et al. Use of global trigger tool for detecting adverse drug events in pediatric inpatients. Chin J New Drugs Clin Rem. 2016;35(9):674–9.
Wang Q. The mechanism and management of hyperkalemia oand hypokalemia in children(Chinese). Chin Pediatr Emerg Med. 2016;23(10):655–9.
Drug-induced Liver Disease Study Group,Chinese Society of Hepatology,Chinese Medical Associetion. Guid lines for the management of drug-induced liver injury. J Clin hepatol. 2015;31(11):1752–69.
Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Hypoglycemia Can J Diabetes. 2015;39(Suppl 4):6–8.
Shen XM, Wang WP. Pediatrics(Chinese). Beijing: People’s Health Publishing House,2010:136–137.
Zou XY, Sun ZH, Han J, et al. Study on the Causes of Hypoglycemia in Patients with Diabetes Mellitus during Therapy(Chinese). Chinese general practice,2012; 15(6):690–693.
Jin HZ, Huang DH, Guan XJ. Practical neonontology(Chinese). Beijing: People’s Health Publishing House,2003: 813–818.
Chinese Society of Cardiology. Chinese expert consensus on warfarin anticoagulation therapy(Chinese). China J Intern Med. 2013;52(1):76–82.
Lazarus J, Brown RS, Daumefie C, et al. 2014 European thyroid association guidelines for the management of subclinical hypothyroidism in pregnancy and in children. Eur Thyroid J, 2014,3(2):76–94.
Tian GL, Cao QX, ,Dong QY. Neonatal screening and clinical analysis for congenital hypothyroidism(Chinese). Chin J Endocrinol Met ab. 2001;17(2):90–3.
Chinese society of Endocrinology. Guidelines for diagnosis and treatment of thyroid diseases in China- Hyperthyroidism(Chinese). China J Intern Med. 2007;46(10):876–82.
Zhang ZX, Wang DS, Niu X. Physiology(Chinese).Shanghai: Shanghai Science and Technology Press,2007:38 – 37.
Liu XG, Zeng JT, Wang JS, et al. The establishment of normal reference range for serum CK-MB of healthy children in different age in baoan district of Shenzhen(Chinese). China Medical Equipment. 2017;7(14):92–5.
Jiang MF, Zheng Q, Chen JG. Discussion on the normal reference range of CK-MB/CK(Chinese). Jiangxi journal of medical laboratory sciences. 2004;22(4):357–8.
Guo B, Xie N, Liu W, et al. Establishment of blood reference ranges and the comparative study of differences with national standard in northeast Sichuan area(Chinese). Int J Lab Med. 2015;36(22):3255–6.
Liang YY. Establishment of Reference Intervals for Peripheral Blood Hemoglobin Aiming at Children below 8 Years Old(Chinese). Chinese General Pract,2012;15(5):1744–1745.
Chen XJ, Wang XO, Li XY, et al. The Foundation of Medical Reference Range of Hemoglobin of the Juvenile between11 and14 Years Old in the Southern Area of Zhejiang Province(Chinese). J Med Res. 2011;40(5):63–5.
Zheng RF, Xiong F. Progress in diagnosis and treatment of osteoporosis in children(Chinese). Chinese Journal of Practical Pediatrics Mar. 2016;31(3):227–32.
Feng JM, Wang JX, Wang PM. Early intervention and Countermeasures of hypoglycemia in preterm infants(Chinese). Chinese Journal of maternal child health. 2014;29(13):2025–6.
Wu J, Hu YB, Xu N. Effectiveness Study on Global Trigger Tool in Detecting Adverse Drug Events for Children(Chinese). Chinese Pharmacovigilance 2017;14 (2):119–122.
We would like to thank the physicians for their assistance with the study.
This study was funded by the Health and Family Planning Commission of Sichuan(No. 16PJ484), Sichuan Medical Association (No. S16070) and Clinical Research and Transformation Project of Sichuan provincial People’s Hospital(No. 2018LY09). These funding sources had no role in the design of the study and did not have any role in collection, analysis, and interpretation of data or in writing the manuscript.
Ethics approval and consent to participate
Ethics approval was obtained from the respective ethics committees of Sichuan Provincial People’s Hospital, China(NO.2017250).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Liu, Y., Yan, J., Xie, Y. et al. Establishment of a pediatric trigger tool based on Global Trigger Tool to identify adverse drug events of children: experience in a Chinese hospital. BMC Pediatr 20, 454 (2020). https://doi.org/10.1186/s12887-020-02354-9
- Drug toxicity
- Trigger points
- Adverse drug events