- Study protocol
- Open Access
- Open Peer Review
Alberta Provincial Pediatric EnTeric Infection TEam (APPETITE): epidemiology, emerging organisms, and economics
BMC Pediatrics volume 15, Article number: 89 (2015)
Each year in Canada there are 5 million episodes of acute gastroenteritis (AGE) with up to 70 % attributed to an unidentified pathogen. Moreover, 90 % of individuals with AGE do not seek care when ill, thus, burden of disease estimates are limited by under-diagnosing and under-reporting. Further, little is known about the pathogens causing AGE as the majority of episodes are attributed to an “unidentified” etiology. Our team has two main objectives: 1) to improve health through enhanced enteric pathogen identification; 2) to develop economic models incorporating pathogen burden and societal preferences to inform enteric vaccine decision making.
This project involves multiple stages: 1) Molecular microbiology experts will participate in a modified Delphi process designed to define criteria to aid in interpreting positive molecular enteric pathogen test results. 2) Clinical data and specimens will be collected from children aged 0–18 years, with vomiting and/or diarrhea who seek medical care in emergency departments, primary care clinics and from those who contact a provincial medical advice line but who do not seek care. Samples to be collected will include stool, rectal swabs (N = 2), and an oral swab. Specimens will be tested employing 1) stool culture; 2) in-house multiplex (N = 5) viral polymerase chain reaction (PCR) panel; and 3) multi-target (N = 15) PCR commercially available array. All participants will have follow-up data collected 14 days later to enable calculation of a Modified Vesikari Scale score and a Burden of Disease Index. Specimens will also be collected from asymptomatic children during their well child vaccination visits to a provincial public health clinic. Following the completion of the initial phases, discrete choice experiments will be conducted to enable a better understanding of societal preferences for diagnostic testing and vaccine policy. All of the results obtained will be integrated into economic models.
This study is collecting novel samples (e.g., oral swabs) from previously untested groups of children (e.g., those not seeking medical care) which are then undergoing extensive molecular testing to shed a new perspective on the epidemiology of AGE. The knowledge gained will provide the broadest understanding of the epidemiology of vomiting and diarrhea of children to date.
Current epidemiologic knowledge of acute gastroenteritis (AGE) pathogens is limited to subsets of children with select clinical presentations and by tests capable of identifying only a limited number of pathogens. APPETITE (The Alberta Provincial Pediatric EnTeric Infection TEam) has built a pathway to innovation (Fig. 1) that strives to develop a better understanding of the infectious causes of AGE by proposing a paradigm shift in specimen collection and testing. We will move from: 1) stool collection (usually at home, if done at all, and returned to facility) to point of care swabs [oral/rectal – by health-care provider (HCP)]; 2) multiple labour intensive tests (e.g., culture, microscopy, electron microscopy) with poor sensitivity to a single device, which employs polymerase chain reaction (PCR) technology to target multiple pathogens with high sensitivity and has the potential to be integrated into point of care testing technology [1–3].
Our proposal includes three activities that are chronologically inter-woven and interconnected to maximize the conduct of integrated knowledge translation (iKT). The activities are: Activity 1 - burden of disease assessment through broad population surveillance with expanded data collection; Activity 2 - enhanced pathogen identification through improved specimen collection (oral and rectal swabs) and molecular (PCR) diagnostic technology; and Activity 3 – preference elicitation and economic modeling which will be planned, and interpreted alongside our decision-makers. Activity #3 will be conducted in conjunction with the data and knowledge gained from Activities #1 and 2. Multi-directional knowledge exchange will be used to address the following key questions identified by our end-users: Theme 1) Do we add an enteric vaccine to Alberta’s vaccination schedule, and when (now for rotavirus; later for norovirus)? If so, how do we optimize uptake?; Theme 2) Do we change policy and employ swabs in Alberta’s laboratories that process specimens? Do we integrate multi-analyte, non-culture PCR technology into all or some of our laboratories? What would the cost be of such an approach?
APPETITE’s research plan was designed through a series of in-person meetings, teleconferences, and an in-person all day gathering of investigators in Calgary (October 28, 2013). APPETITE’s agenda addresses a high-impact, high-needs problem while balancing the needs of our end-user partners. The agenda directly tackles key health policy issues - child health, infectious disease, health promotion, vulnerable populations - identified by Alberta’s Health Research and Innovation Strategy , and Alberta’s Maternal, Newborn, Child & Youth Health Emerging Clinical Network’s  research priorities (i.e., rotavirus immunization).
Suggestions from the Alberta Children’s Hospital (ACH) Family Advisory Committee (November 7, 2013), and a HCP survey (November 2013) were integrated into our research plan. Preliminary analysis (n = 90) provided the following insights: 1) 53 % believe caregivers would be interested in adding an enteric vaccine; 2) 81 % believe an additional requirement should include cost-effectiveness; 3) only 9 % believe that current methods of stool sample collection are easy and convenient; and 4) 82 % believe that specimen submission would be improved if rectal swab samples were employed.
We test for too few pathogens in too few patients and thus do not understand the true impact of AGE
Unknown Epidemiology of Disease (Fig. 2):
Although 90 % of affected individuals do not seek medical care, they account for over 70 % of the total cost of illness (due to missed employment) . Of those who do seek care, only 6 % submit stool samples . Even then, only diarrheal specimens are tested and most often for bacteria and parasites (Table 1), and such agents cause only 10-15 % of disease. Over 60 % of pediatric stool cultures in Calgary are from hospitalized children who represent <1 % of the pediatric population with AGE [8, 9]. In a survey of 1000 randomly identified patients at 31 Canadian emergency departments (ED), vomiting was the most common reason children were brought for care [TRanslating Emergency Knowledge for Kids (TREKK); http://trekk.ca/] . However, because of technological limitations children with isolated vomiting (i.e., without diarrhea), rarely have samples tested to identify an infectious etiology. Hence diarrheagenic pathogens are over-represented among causes of enteric events. Our lack of true pathogen-specific burden of disease knowledge impairs our ability to deliver evidence-based prevention strategies.
Enhanced enteric disease diagnostics are needed as 1) there are significant public health implications; 2) the potential severity of disease is significant (2–3 % of those affected develop persistent health problems) ; and 3) timely treatment may be crucial. Examples of the importance of pathogen identification include: 1) Verotoxin-producing E. coli (synonymous with Shiga-toxin producing E. coli) , although uncommon, can cause hemolytic uremic syndrome, the most common cause of acute renal failure in children [13, 14]. The lifetime cost/case is >2.8 million Euro . Current testing algorithms entail sending patients home to collect and return stool specimens. If returned, often 1 – 2 days later, such specimens are processed employing culture techniques, which further delay pathogen identification . Point of care collection (i.e., rectal swab) followed by rapid molecular identification (e.g., PCR) would enable the early provision of therapies to reduce the severity of renal failure [17–19]; 2) The identification of norovirus, which causes 800 deaths annually in the U.S. , may lead to passive immunotherapy administration to high-risk individuals ; 3) From a public health perspective, a rapid assessment tool will assist in separating epidemic episodes of mild AGE from public health emergencies .
Patient Preferences and Cost Effectiveness
Little is known about preferences of patients and caregivers in relation to enteric vaccines. Economics also play a role in decision-making processes because optimizing the distribution of limited health-care resources is mandatory . In accordance with recommendation in the 2013 report from the Public Health Agency of Canada , we conducted focus group meetings with the ACH Family Advisory Committee. The following themes emerged from these discussions: 1) need to focus on introducing “critical” vaccines; 2) a vaccine now (i.e., rotavirus) may decrease future vaccine uptake (i.e., norovirus); and 3) importance of comparing public health impact of rotavirus vaccine to other (non-AGE) potential interventions that could be implemented. However, since studies to date have not included children with isolated vomiting, which is commonly seen with norovirus [24, 25] and those not seeking care, the economic models employed to guide vaccine policy, and outline the opportunity costs of such policies, have employed data with significant limitations [26–28].
This phase of our team’s study focuses on developing an adaptation-friendly reproducible model of infectious disease epidemiology assessment. It is designed to capture a comprehensive clinical picture of AGE (i.e., those with isolated vomiting, isolated diarrhea, and combined) in diverse settings (e.g., home, primary care, ED). Evaluating etiology in an unbiased manner has been identified as priority by key decision-makers to 1) identify the most common pathogens (viral, bacterial, parasitic); 2) associate each pathogen with illness severity (all settings); and 3) enable the construction of economic models to inform health-care investment decisions.
The health challenge
We do not know which pathogen(s) are most responsible for AGE in terms of frequency or severity because the full community-based spectrum and extent of AGE (which is 8 times more frequent than physician visits)  has not been performed in recent decades. The frequency of AGE and its impact in the community is reflected in Health Link Alberta (provincial telephone help-line) data: 39 % of all pediatric calls are because of AGE and 67 % result in a recommendation for care at home [courtesy Alberta Health (AH)]. Although viral infections cause 75–90 % of infectious gastroenteritis, current testing approaches identify a pathogen in only 10 % of specimens (Fig. 3) because testing focuses on rotavirus which has been viewed as the most important pathogen . Consequently rotavirus has been the target of Canadian surveillance efforts  which collect data on hospitalized children and select ED populations. In light of this knowledge gap, the Office of the Chief Medical Officer of Health of Alberta has added rotavirus to the notifiable diseases list effective January 2014. However, standard clinical testing will remain restricted to individuals with diarrhea presenting for ED care and those requiring hospitalization. In the current state, the true burden of disease (e.g., isolated vomiting; never tested) will remain unknown as will the prevalence of other pathogens, especially norovirus .
Alberta is an outstanding setting in which to study the pathogen-specific burden of disease because 1) rotavirus vaccine has not been introduced in this province so the natural spectrum of illness exists; 2) vaccines are administered at public health clinics thereby providing a wealth of population and patient specific vaccine data; and 3) our team will have access to clinical outcome and exposure data related to notifiable enteric pathogens. The need to study AGE epidemiology where rotavirus remains prevalent is important. In U.S. where rotavirus vaccination is common, norovirus is the most frequent cause of diarrheal disease in children [33–38]. However, the relative burden of disease (rotavirus vs. norovirus) in the absence of rotavirus vaccine is unknown.
Project #1: case definitions
Case definitions for illnesses likely to be caused by each candidate pathogen will be defined a priori. This work will employ a modified Delphi technique consisting of anonymous questionnaires and a face-to-face expert panel meeting. This is required as not all positive tests represent true “disease” (e.g., C. difficile in children <1 year rarely causes disease) .
Indicator identification and development
For the clinical features selected by the advisory panel, a review of the literature will be conducted to identify 1) existing case definitions 2) practice guidelines, and high quality systematic reviews that could be used to inform the creation of case definitions and 3) infections for which no guidelines or evidence exists.
Existing case definitions
Existing case definitions for the selected pathogens will be identified through a search of the literature on enteric infections in children. Search terms will include those corresponding to clinical features and case definitions combined with terms describing each of the enteric pathogens. Examples of search terms will include: case definition, clinical feature, specific pathogen and infection/carrier. An initial list of existing case definitions and references will be created. Case definitions will be presented by pathogen, infection status (carrier/”infection”), and diagnostic test modality.
Existing case definitions for the selected conditions will also be identified by searching websites that focus on enteric infectious diseases and specific pathogens. Examples of websites include the Infectious Disease Society of America.
An advisory panel consisting of approximately 20 decision makers and stakeholders will be created to select variables to be included in our case definitions. The Delphi technique, a structured interactive method involving repetitive administration of anonymous questionnaires, will be used . The advisory panel will consist of pediatricians, pediatric emergency medicine physicians, infectious disease experts, medical microbiologists, and experts in virology and laboratory medicine. Participants will be identified by APPETITE’s International Scientific Advisory Committee and Strategic Advisory Committee and will be recognized experts in this field and will be representative of the perspectives held in Canada, the USA and Europe. Representatives from stakeholder organizations will be contacted and asked to provide the names of individuals with an interest in pediatrics, infectious disease and enteric infections. The panel will then be chosen from the master list of experts by the research team. Criteria for selection will include: interest or expertise in enteric infections in the pediatric population, experience in infectious diseases, geographic representation across Canada, practice diversity, and balance between individuals with clinical expertise and those with laboratory expertise. Selected panel members will receive a written invitation to participate in this project that will outline the goals of the project, their responsibilities and the timeline. Written invitations will be followed by a telephone conversation with one of the study investigators.
A description of the goals of the research project, as well as a summary of the literature review including the full list of existing and newly developed evidence-based, case definitions will be sent. The case definitions will be organized by pathogen, specimen type (rectal swab, oral swab, bulk stool), and diagnostic test employed.
The advisory panel will be sent the candidate list of variables to be considered. They will then be asked to suggest other clinical features that might assist in discriminating “infection” from the “carrier” state. A complete list of all candidate clinical features will then be assembled. A prioritized list of clinical features will then be generated through a multistage survey process.
In the first stage of the survey panelists will be asked to rate each clinical feature on three different criteria: 1) Importance/Impact – to what degree is this clinical feature important when discriminating infection from carrier state. 2) Prevalence – how frequently is this clinical feature present in those usually determined to have “disease”. 3) Validity – how solid is the scientific or professional consensus to support a link between the clinical feature and the presence of “disease”. Panelists will be asked to rate each clinical feature on all three criteria on a scale from 1 (strongly disagree) to 9 (strongly agree).
Any clinical feature rated 1, 2 or 3 for all of the 3 criteria by all panelists will be removed from further consideration. Any clinical feature rated 7, 8 or 9 by all panelists for all 3 criteria will be retained for further case definition development and removed from the next survey round.
The remaining clinical features will be included in a new survey for the second stage of the Delphi Process. The second survey will be individualized for each panel member and for each clinical feature and will include the member’s prior rating, the overall panel median rating and the range of ratings assigned on each of the clinical features. The panelists will then be asked to re-rate each clinical feature on the same three criteria. Each panelist’s ratings for the three criteria will be added. Conditions with mean scores ≥7 by 2/3 of panelists will included in the final list of clinical features used to define “disease”.
The advisory panel will then have a face-to-face meeting. At the meeting, the panelists will review anonymized ratings of all the clinical features. Panelists will be asked to refine highly scored clinical features and to discuss low scoring and indeterminate clinical features. Panelists will also be given the opportunity to suggest clinical features for pathogens with no existing case definitions and to identify significant gaps where more knowledge is needed. At the end of the face-to-face meeting panelists will be asked to independently re-rate each clinical feature on the same four criteria. Clinical features with mean scores ≥7 across all four criteria by 2/3 of panelists will be included in the final list of indicators.
Project #2: specimen collection/testing
We will collect specimens (oral and rectal swabs plus stool) from children spanning the spectrum of severity and clinical presentations (i.e., isolated diarrhea, diarrhea and vomiting, isolated vomiting). A multi-year evaluation will allow us to capture the seasonal variation of clinical presentation and intensity of pathogen activity [41, 42].
The project will achieve the following objectives:
Determine if swab specimens are adequate (or even preferred) alternatives to stool sample collection and testing, stratified by clinical presentation, for viral, bacterial, parasitic and C. difficile.
Determine the test characteristics of the multi-analyte assay employing all three sampling methods, in comparison with reference standards (i.e., stool culture), and work with end-users [Calgary Laboratory Services (CLS), Provincial Laboratory for Public Health (ProvLab)] to clarify its role in the Alberta context.
Determine the genotype profiles of bacteria and viruses in relation to vaccines and epidemic strains.
Note – oral swabs will only be analyzed in the context of viral pathogens (no expectation to identify bacteria, parasites).
Primary outcome: The proportion of all cases caused by the most common pathogen (likely rotavirus or norovirus).
Secondary outcome: The ‘burden of disease index’ which is created by multiplying 1) frequency of disease and 2) mean Modified Vesikari Scale score to provide the burden in relation to setting and resource use.
Inclusion Criteria: Eligible children will:
Be aged 0–17.99 years of age
Have AGE defined by the presence of a minimum of three episodes of vomiting OR diarrhea in the preceding 24 h and < 7 days of symptoms  (Medical Care)
Exclusion Criteria: Children with any of the following will not be eligible:
Previously enrolled within the last 14 days (Medical Care)
Previously enrolled in the study (Self-Care)
Unavailable for follow-up
Chief complaint likely related to acute infection (i.e., presence of any of the following: vomiting, diarrhea, fever, running nose, and/or cough) (Self-Care)
History of depression, bipolar disorder, schizophrenia, or other significant underlying psychiatric illness
History of low white blood cells (neutrophils < 1000)
The child needing emergent care from the clinical team
Participants will be indentified from two cohorts:
Medical Care (N = 2250): To reflect a broad range of severity, children will be recruited from EDs including Alberta’s two pediatric EDs (Calgary and Edmonton). Both are members of Pediatric Emergency Research Canada (PERC) which has endorsed this study. Specimens (stool, oral and rectal swabs) will be obtained from children during the ED visit (if consent and assent are obtained as appropriate-Appendix 5). Home stool collection will be performed for those unable to provide a sample while in the ED and will be achieved by providing families with collection kits, instructions for specimen handling and preparation and a number to call to arrange for specimen retrieval and transport for processing (Appendix 5) .
Self-Care (N = 2250): This group will illuminate the burden of disease amongst children whose families do not physically seek evaluation. This cohort represents the greatest burden of disease, particularly in economic terms (i.e., caregiver lost productivity). We will recruit (i.e., pre-enrol) these participants while asymptomatic to enable them to participate when they experience an episode of AGE (defined as ≥3 episodes of vomiting or diarrhea in a 24 h period) . Based on available data, 90 % of such events will not result in medical care  – such visits will define our self-care cohort. Should medical care be sought (10 % of this group), they will be re-assigned to the medical care cohort. At the index visit, children will have rectal and oral swabs performed to enable the generation of baseline data to understand the carrier rate in the general population. This opportunity will also serve as a teaching moment such that caregivers will understand how to collect specimens (oral and rectal swabs, and stool) at home once their child becomes ill. Prior to leaving the ED, they will be provided with collection kits, instructions for specimen handling and a number to call to arrange for specimen retrieval and transport for processing (to optimize return rate) .
In addition children will be recruited through HealthLink Alberta. This is a telephone resource, which is accessible to all Albertans, that provides guidance on the management of common medical conditions. For true emergencies, callers are told to call 911. For very minor conditions they are given guidance and instructed to manage the client at home. For those with symptoms of unclear importance they are often instructed to seek medical care. HealthLink AB has agreed to provide, with caregiver permission, the contact information related to phone calls of children aged < 18 years with AGE who are instructed to be cared for at home. The APPETITE team member will then follow-up with the caregiver/child to seek consent/assent for participation. This can be done either 1) verbally by phone; or 2) electronically with the consent/assent forms downloaded from the study website (www.gotgastro.ca) and then returned to our team electronically. Once consent is obtained the study sample collection packets and instructions will be emailed to the client/caregiver and they will be asked to complete the data collection forms.
The medical care and self-care cohorts will have clinical data collected:
In person or electronically/telephone on the day the specimens are provided/collected (Appendix 8).
14 days after initial specimen collection (Appendix 9). This approach will enable us to collect outcome data to quantify illness severity employing the Modified Vesikari Scale score. This validated score [46, 47] is based on symptoms and therapy provided and is designed for use in AGE of unspecified etiology. Additional data collected will include risk factors for infection and severe disease, expenditures and quality of life.
Experimental maneuvers – medical care cohort
Patients will be assessed and treated by ED staff without any regard to this study. Stool specimen testing will continue as per standard of care at all participating sites. Once the inclusion criteria are confirmed and parental consent is obtained (and child assent when appropriate) an enrollment ID number will be assigned. Research ethics board approval was obtained for recruitment and specimen collection from both the Conjoint Health Research Ethics Board of the University of Calgary, and the Health Research Ethics Board of the University of Alberta.
Parents will be asked to participate in a standardized 5 min survey administered by study personnel. The survey will collect descriptive data regarding gastroenteritis symptoms, childcare arrangements, parental work data, medical treatment sought during the child’s illness, and personal medical history. Those enrolled in an ED will directly enter the information into an iPAD device.
We will collect four specimens (2 rectal swabs, 1 oral swab, and a stool sample) from each enrolled child. Approximately 750 children will be enrolled annually from our medical care cohort. Oral and rectal swabs will be performed prior to departure from the point of care using a flocked rectal swab (FLOQSwab, Copan Italia, Brescia, Italy). Stool will also be collected prior to departure. If a specimen is not provided prior to departure, we will provide caregivers with specimen collection containers and contact information for a courier service that will retrieve the sample. After cultures are performed, all swabs and stool specimens will be frozen at −70 °C for future testing which will be performed in batches.
At the index visit, caregivers will be asked their preferred method of communication – electronic (i.e., email survey) versus telephone. 14 days after enrollment, a standardized script or survey/data collection form will be employed to conduct follow-up. This would be performed using a secure RedCAP data system to minimize time required and transcription errors. If phone is opted for, the caller will enquire about ongoing symptoms, medical evaluations, treatments, child care and work absenteeism, and side effects. Detailed questioning will follow positive responses. The survey will employ advanced logic to enhance ease of use. Electronic surveys will be e-mailed daily (maximum of 3 times) until a survey is completed. If the caregiver does not complete the electronic survey after 3 days, telephone follow-up will be performed. Protocols will be developed to deal with caregiver questions in accordance with institutional requirements.
All standardized surveys employed in this study consist of a series of single-and multiple-select closed-ended items allowing for the selection of a residual “other” category. In cases in which the respondent feels that his or her response does not correspond to one of those already listed (ie. he/she selects “other”), the respondent will be asked to elaborate on his or her answer in full text.
In order to optimize follow-up the following data is collected at the initial point of contact: home, cellular, work and alternate telephone numbers; e-mail and home address. If phone follow-up is performed, we will call all numbers provided at least once daily over 3 days (maximum 5 attempts).
RT-PCR 5- target ‘in-house’ virus panel (adenovirus, astrovirus, norovirus, rotavirus, sapovirus) ;
multi-analyte assay [Luminex xTAG® Gastrointestinal Pathogen Panel (GPP)]
standard bacterial culture
The Luminex GPP is an FDA and Health Canada approved, qualitative bead-based multiplexed molecular diagnostic test that simultaneously identifies AGE causing viral, bacterial and parasitic pathogens. It has excellent test characteristics when stool97,125 and rectal swabs100,104 are employed - sensitivity >94 %, specificity >98 % [50, 51]. Moreover, 65 % of pathogens identified by the Luminex GPP remain unidentified when current laboratory procedures are followed (i.e., physician must suspect and order the appropriate pathogen specific test) . We will explore the use of the Luminex GPP to identify viral targets from oral swabs which will undergo confirmatory analysis via our ‘in-house’, RT-PCR, 5-target viral panel. Employing Plan-Do-Study-Act cycles we will modify our protocols (collection methods, swab types, transport media, nucleic acid extraction) based on results. Pathogen detection accuracy will be compared, as appropriate, between the varying specimen collection methods. The ‘best’ (accurate and convenient) specimen type for testing will be identified. Once optimal specimen collection type and analysis methods have been determined, subsequent testing will be streamlined.
Because monitoring for genetic and antigenic changes in pathogens is crucial for viruses , specimens testing positive for rotavirus will be analyzed for G typing (VP7) and P typing (VP4) using nested RT-PCR . Those positive for norovirus will be typed by DNA sequencing [52, 54]. Typing of bacterial targets will be performed, as appropriate, using standard methodologies  to evaluate the ability of our surveillance and comprehensive diagnostic approach to discover outbreaks not identified by traditional approaches.
Experimental maneuvers – self care cohort
Screening, consent and the index interview will occur as per the medical cohort.
We will collect three specimens (2 rectal swabs, 1 oral swab) from each enrolled child during the index visit. Approximately 750 children will be enrolled annually from our self- care cohort. Oral and rectal swabs will be performed prior to departure from the point of care using a flocked rectal swab (FLOQSwab, Copan Italia, Brescia, Italy). After a culture is performed, all swabs will be frozen at −70 °C for future testing which will be performed in batches.
At the index visit, caregivers will be provided with specimen collection containers, and instructions on sampling to be repeated when their child does become sick. They will be instructed to contact a research team member should their child have ≥ 3 diarrheal or vomiting episodes in a 24 h period. This contact will initiate a call to a courier service to conduct specimen retrieval along with the e-mailing (or telephone completion) of the baseline illness survey. If the caregiver does not contact a team member, follow-up reminders will occur three and/or six months following the index visit.
Follow-up and specimen testing will occur as per the medical care cohort.
We anticipate that rotavirus and norovirus will each be present in ~20 % of cases. All other viruses combined will be identified in ~20 % of cases; bacteria may be present in 10 %. Thus, a pathogen will be identified in 60 – 70 % of participants. Each cohort (medical care & self-care) will require 2250 (4500 in total) participants assuming a point estimate of 20 % for the most frequent pathogen (closest to point of most uncertainty to ensure accurate estimates for less frequent ones) and a desire for the 95 % confidence interval to be ≤ ±2 %. The prevalence of disease attributable to each pathogen will be stratified by zone, potential risk groups (e.g., aboriginal, co-morbidity, age, socioeconomic status) , exposures, season, enrollment location, symptoms, severity, site of recruitment, and antibiotic use. 4500 cases (and ~3150 containing at least one of the pathogens tested in this study) will allow for a minimum of 10 cases of AGE for each stratification covariate and thus extensive regression modeling. Since the primary outcome is based on point-of-care rectal swab performance, compliance is a potential concern for the self-care group. Recruitment for the later will continue until specimens are received from the required number of participants (N = 2250). Duplicate samples <14 days from the same individual will be removed to provide case-based data
Clinical features and outcomes will be correlated with microbiologic findings. Age and sex-adjusted pathogen specific prevalence and severity data will be calculated and compared for all targets. Seasonality and geographic distribution of each pathogen over time will be analyzed.
Integrated knowledge translation plan
Results will be analyzed bi-weekly, and the formats and fields will be tailored to end-user needs. Recruitment strategies will be modified in real-time based on success (e.g., add/drop clinics, study promotion). Education targeting participating families (e.g., information sheet, hydration, hand hygiene, transmission) will be central to our research-practice loop and will be refined based on accrued data. Through our knowledge/end-user collaborators, and utilizing the communication and reporting chains present within their respective organizations (primary care network leaders, pediatric ED end-users, informatics, public health officers) we will share and exchange findings to integrate results immediately to assist with unrecognized outbreaks, pathogen clustering, severe disease and complications. We will maintain bi-annual dialogue with our partner parent group to modify our data collection and aims. There will be ongoing discussion of our results at network meetings [PERC, TREKK, National Advisory Committee on Immunization (NACI), medical officers of health, Alberta Health Services (AHS), AH] and immediate improvements in health-care delivery could result through early implementation of novel sampling and testing methods or by linking of ED physician and nurse staffing to weekly APPETITE data.
APPETITE has identified the need for a well designed governance structure and research management mechanism. The governance model is designed to enhance cross-sectoral collaborations and partnerships between academia, industry and the applied healthcare setting. The entities within the model create a framework whereby APPETITE leaders are challenged with rigorous internal checks and balances on research accountability, quality, and productivity. The governance structure is comprised of the following groups:
Strategic Advisory Committee (SAC)
Advises the APPETITE Executive Committee on the overarching plans and goals at a high level (e.g., major projects, activities, future funding, business model). The SAC is comprised of representation from APPETITE’s provincial [AH, AHS, Alberta Office of Chief Medical Officer of Health, First Nations Inuit health Branch, CLS, Clinical Informatics – AH, ProvLab Alberta), universities (University of Calgary – Alberta Children’s Hospital Research Institute; University of Alberta – Women and Children’s Health Research Institute), and community stakeholders (Alberta Children’s Hospital Parent Advisory Committee). APPETITE’s Executive team will seek advice from its SAC on dispute resolution for high-level issues.
International Scientific Advisory Committee (ISAC)
This group includes experts in enteric bacteria (Dr. Claire Jenkins, Public Health England), diagnostic microbiology (Dr. Carey-Ann Burnham, Washington University), translational research (Dr. Eileen Klein, Seattle Children’s Hospital), emerging topics in gastrointestinal research (Dr. Phil Sherman – Director, Canadian Institutes of Health Research, Institute of Nutrition Metabolism and Diabetes), viral gastroenteritis (Dr. Jon Gentsch, Centers for Disease Control and Prevention), virology [Dr. Marion Koopmans, National Institute of Public health (Netherlands)] They are also joined by Dr. Bill Ghali who has expertise in leading large multi-disciplinary research teams within the University of Calgary (U of C). They will serve as strategic and scientific advisors to APPETITE’s research programs and collaborating members. APPETITE will host each ISAC member as visiting professors for periods of up to 1 week, during which time they will advise in real-time on APPETITE activities, and specific projects, give local teaching/training rounds and will meet with trainees.
Composed of APPETITE’s Lead (Dr. Freedman), Co-Leads (Drs. Lee, Louie, Pang), and the health economic activity Co-Lead (Dr. Currie), the executive committee meets weekly. Its members are accountable for the core decision-making of all programs, ensuring completeness of agency reporting, human resource and financial matters, keeping all activities on track, and updating team members and relevant end-users as required.
Our comprehensive and extensive dataset will contain the necessary information to engage in deep, evidence-informed, discussions regarding policy change with our partner decision-makers at Alberta’s laboratories and the Office of the Chief Medical Officer of Health. These discussions will determine diagnostic testing, vaccine, and surveillance policy in Alberta for years to come, thereby optimizing health at individual and societal levels. APPETITE’s data and specimen repository will be employed to conduct the next steps in PCR-based, point of care diagnostics and norovirus vaccine research. Academia and industry partners will work to develop: 1) an oral viral pathogen panel; and 2) simplified point-of-care diagnostic technology [2, 3, 56] to enable use in remote communities and in low and middle income countries to reduce AGE mortality .
Alberta Children’s Hospital
Alberta Health Services
Alberta Provincial Pediatric EnTeric Infection TEam
Calgary Laboratory Services
Gastrointestinal Pathogen Panel
Infectious Disease Society of America
Integrated Knowledge Transfer
International Scientific Advisory Committee
Polymerase Chain Reaction
Pediatric Emergency Research Canada
Provincial Laboratory for Public Health
Strategic Advisory Committee
TRanslating Emergency Knowledge for Kids
Ivaska L, Niemela J, Heikkinen T, Vuorinen T, Peltola V. Identification of respiratory viruses with a novel point-of-care multianalyte antigen detection test in children with acute respiratory tract infection. J Clin Virol. 2013;57(2):136–40.
Manage DP, Lauzon J, Atrazhev A, Pang X, Pilarski LM. A novel method for sample delivery and testing of whole blood: gel strip PCR for point of care (POC) molecular diagnostics. Lab Chip. 2013;13(20):4011–4.
Kaigala GV, Huskins RJ, Preiksaitis J, Pang XL, Pilarski LM, Backhouse CJ. Automated screening using microfluidic chip-based PCR and product detection to assess risk of BK virus-associated nephropathy in renal transplant recipients. Electrophoresis. 2006;27(19):3753–63.
Government of Alberta. Alberta’s Health Research and Innovation Strategy; Available at: http://eae.alberta.ca/media/277640/ahris_report_aug2010_web.pdf; Accessed October 25, 2013. In.; Published August 2010.
Alberta Innovates Health Solutions. SCN/OCN Research Connections; Available at: http://www.aihealthsolutions.ca/media/FINAL-Report.pdf; Accessed July 23, 2015. In.; Published July 2013.
Majowicz SE, McNab WB, Sockett P, Henson TS, Dore K, Edge VL, et al. Burden and cost of gastroenteritis in a Canadian community. J Food Prot. 2006;69(3):651–9.
Hall AJ, Rosenthal M, Gregoricus N, Greene SA, Ferguson J, Henao OL, et al. Incidence of acute gastroenteritis and role of norovirus, Georgia, USA, 2004–2005. Emerg Infect Dis. 2011;17:1381–8.
Freedman SB, Gouin S, Bhatt M, Black KJ, Johnson D, Guimont C, et al. Prospective assessment of practice pattern variations in the treatment of pediatric gastroenteritis. Pediatrics. 2011;127(2):e287–95.
Church DL, Cadrain G, Kabani A, Jadavji T, Trevenen C. Practice guidelines for ordering stool cultures in a pediatric population. Alberta Children’s Hospital, Calgary, Alberta, Canada. Am J Clin Pathol. 1995;103(2):149–53.
Scott S: Results of the TREKK Needs Assessment. In: TREKK Network Meeting, October 5, 2013, Winnipeg, MB: 2013; 2013. http://trekk.ca/teams/phase-1-needsassessment. Accessed July 23, 2015
Butler-Jones D. The Chief Public Health Officer’s Report on the State of Public Health in Canada - 2013: Infectious Disease - The Never-ending Threat. Avialable at: http://www.phac-aspc.gc.ca/cphorsphc-respcacsp/2013/assets/pdf/2013-eng.pdf; Accessed November 26, 2013. In. Edited by Canada PHAo.
Government of Alberta (Alberta Health and Wellness). Escherishia coli verotoxigenic infections. Published March 2011. Available at: http://www.health.alberta.ca/documents/Guidelines-Escherichia-coli-Verotoxigenic-2011.pdf. Accessed December 2, 2013. In.
Proulx F, Sockett P. Prospective surveillance of Canadian children with the haemolytic uraemic syndrome. Pediatr Nephrol. 2005;20(6):786–90.
Scheiring J, Andreoli SP, Zimmerhackl LB. Treatment and outcome of Shiga-toxin-associated hemolytic uremic syndrome (HUS). Pediatr Nephrol. 2008;23(10):1749–60.
Tariq L, Haagsma J, Havelaar A. Cost of illness and disease burden in The Netherlands due to infections with Shiga toxin-producing Escherichia coli O157. J Food Prot. 2011;74(4):545–52.
Mead PS, Griffin PM. Escherichia coli O157:H7. Lancet. 1998;352(9135):1207–12.
Hickey CA, Beattie TJ, Cowieson J, Miyashita Y, Strife CF, Frem JC, et al. Early volume expansion during diarrhea and relative nephroprotection during subsequent hemolytic uremic syndrome. Arch Pediatr Adolesc Med. 2011;165(10):884–9.
Balestracci A, Martin SM, Toledo I, Alvarado C, Wainsztein RE. Dehydration at admission increased the need for dialysis in hemolytic uremic syndrome children. Pediatr Nephrol. 2012;27(8):1407–10.
Ake JA, Jelacic S, Ciol MA, Watkins SL, Murray KF, Christie DL, et al. Relative nephroprotection during Escherichia coli O157:H7 infections: association with intravenous volume expansion. Pediatrics. 2005;115(6):e673–80.
Hall AJ, Lopman BA, Payne DC, Patel MM, Gastanaduy PA, Vinje J, et al. Norovirus disease in the United States. Emerg Infect Dis. 2013;19(8):1198–205.
Chen Z, Sosnovtsev SV, Bok K, Parra GI, Makiya M, Agulto L, et al. Development of Norwalk virus-specific monoclonal antibodies with therapeutic potential for the treatment of Norwalk virus gastroenteritis. J Virol. 2013;87(17):9547–57.
Busani L, Boccia D, Caprioli A, M Ruggeri F, Morabito S, Minelli F, et al. Public health implications of a case of haemolytic-uraemic syndrome associated with a concomitant outbreak of mild gastroenteritis in a small rural community. Epidemiol Infect. 2006;134(2):407–13.
Pang XL, Lee BE, Pabbaraju K, Gabos S, Craik S, Payment P, et al. Pre-analytical and analytical procedures for the detection of enteric viruses and enterovirus in water samples. J Virol Methods. 2012;184(1–2):77–83.
Wikswo ME, Desai R, Edwards KM, Staat MA, Szilagyi PG, Weinberg GA, et al. Clinical profile of children with norovirus disease in rotavirus vaccine era. Emerg Infect Dis. 2013;19(10):1691–3.
Richards GP. Critical review of norovirus surrogates in food safety research: rationale for considering volunteer studies. Food Environ Virol. 2012;4(1):6–13.
Coyle C, Coyle K, Bettinger JA, Halperin SA, Vaudry W, Scheifele DW, et al. Cost effectiveness of infant vaccination for rotavirus in Canada. Can J Infect Dis Med Microbiol. 2012;23(2):71–7.
Fisman DN, Chan CH, Lowcock E, Naus M, Lee V. Effectiveness and cost-effectiveness of pediatric rotavirus vaccination in British Columbia: a model-based evaluation. Vaccine. 2012;30(52):7601–7.
Aballea S, Millier A, Quilici S, Caroll S, Petrou S, Toumi M. A critical literature review of health economic evaluations of rotavirus vaccination. Hum Vaccin Immunother. 2013;9(6):1272–88.
Pang XL, Preiksaitis JK, Lee BE. Enhanced enteric virus detection in sporadic gastroenteritis using a multi-target real-time PCR panel – One-year study. J Medical Virology (in press) 2013.
Ford-Jones EL, Wang E, Petric M, Corey P, Moineddin R, Fearon M. Hospitalization for community-acquired, rotavirus-associated diarrhea: a prospective, longitudinal, population-based study during the seasonal outbreak. The Greater Toronto Area/Peel Region PRESI Study Group. Pediatric Rotavirus Epidemiology Study for Immunization. Arch Pediatr Adolesc Med. 2000;154(6):578–85.
Le Saux N, Bettinger JA, Halperin SA, Vaudry W, Scheifele DW, Canadian Immunization Monitoring Program A. Substantial morbidity for hospitalized children with community-acquired rotavirus infections: 2005–2007 IMPACT surveillance in Canadian hospitals. Pediatr Infect Dis J. 2010;29(9):879–82.
Lee BE, Pang XL. New strains of norovirus and the mystery of viral gastroenteritis epidemics. CMAJ. 2013;185(16):1381–2.
Division of Viral Diseases, National Center for Immunization Respiratory Diseases, Centers for Disease Control Prevention. Updated norovirus outbreak management and disease prevention guidelines. MMWR Recomm Rep. 2011;60(RR-3):1–18.
Havelaar AH, Haagsma JA, Mangen MJ, Kemmeren JM, Verhoef LP, Vijgen SM, et al. Disease burden of foodborne pathogens in the Netherlands, 2009. Int J Food Microbiol. 2012;156(3):231–8.
Payne DC, Vinje J, Szilagyi PG, Edwards KM, Staat MA, Weinberg GA, et al. Norovirus and medically attended gastroenteritis in U.S. children. N Engl J Med. 2013;368(12):1121–30.
Vaillant V, de Valk H, Baron E, Ancelle T, Colin P, Delmas MC, et al. Foodborne infections in France. Foodborne Pathog Dis. 2005;2(3):221–32.
Hall G, Kirk MD, Becker N, Gregory JE, Unicomb L, Millard G, et al. Estimating foodborne gastroenteritis, Australia. Emerg Infect Dis. 2005;11(8):1257–64.
Scallan E, Hoekstra RM, Angulo FJ, Tauxe RV, Widdowson MA, Roy SL, et al. Foodborne illness acquired in the United States--major pathogens. Emerg Infect Dis. 2011;17(1):7–15.
Adlerberth I, Huang H, Lindberg E, Aberg N, Hesselmar B, Saalman R, et al. Toxin-producing Clostridium difficile strains as long-term gut colonizers of healthy infants. J Clin Microbiol. 2013;52:173.
Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326(7393):816–9.
Lee BE, Robinson JL, Khurana V, Pang XL, Preiksaitis JK, Fox JD. Enhanced identification of viral and atypical bacterial pathogens in lower respiratory tract samples with nucleic acid amplification tests. J Med Virol. 2006;78(5):702–10.
Pang XL, Jiang J. Gastroenteritis Viruses. In: Versalovic J, editor. 10th Manual of Clinical Microbiology. Washington, DC: American Society for Microbiology; 2011.
Guarino A, Albano F, Ashkenazi S, Gendrel D, Hoekstra JH, Shamir R, et al. European Society for Paediatric Gastroenterology, Hepatology, and Nutrition/European Society for Paediatric Infectious Diseases evidence-based guidelines for the management of acute gastroenteritis in children in Europe. J Pediatr Gastroenterol Nutr. 2008;46 Suppl 2:S81–122.
Denno DM, Stapp JR, Boster DR, Qin X, Clausen CR, Del Beccaro KH, et al. Etiology of diarrhea in pediatric outpatient settings. Pediatr Infect Dis J. 2005;24(2):142–8.
Majowicz SE, Edge VL, Fazil A, McNab WB, Dore KA, Sockett PN, et al. Estimating the under-reporting rate for infectious gastrointestinal illness in Ontario. Can J Public Health. 2005;96(3):178–81.
Freedman SB, Eltorky M, Gorelick M, Pediatric Emergency Research Canada Gastroenteritis Study G. Evaluation of a gastroenteritis severity score for use in outpatient settings. Pediatrics. 2010;125(6):e1278–85.
Schnadower D, Tarr PI, Gorelick MH, O’Connell K, Roskind CG, Powell EC, et al. Validation of the Modified Vesikari Score in Children with Gastroenteritis in 5 U.S. Emergency Departments. J Pediatr Gastroenterol Nutr. 2013;57:514.
Luinstra K, Goldfarb D, Castriciano S, Chong S, Mahony J, Smieja M. Stability of nucleic acid recovery from flocked rectal swabs after prolonged storage at elevated temperatures. Daytona Beach FL: Clinical Virology Symposium; 2013.
Goldfarb D, Steenhoff A, Pernica J, Castriciano S, Chong S, Luinstra K, et al. Copan flocked rectal swab samples outperform bulk stool for the detection of diarrheal pathogens in children when using the xTAG gastrointestinal pathogen panel (GPP) assay. Daytona Beach FL: Clinical Virology Symposium; 2013.
Claas EC, Burnham CA, Mazzulli T, Templeton K, Topin F. Performance of the xTAG(R) gastrointestinal pathogen panel, a multiplex molecular assay for simultaneous detection of bacterial, viral, and parasitic causes of infectious gastroenteritis. J Microbiol Biotechnol. 2013;23(7):1041–5.
Navidad JF, Griswold DJ, Gradus MS, Bhattacharyya S. Evaluation of Luminex xTAG gastrointestinal pathogen analyte-specific reagents for high-throughput, simultaneous detection of bacteria, viruses, and parasites of clinical and public health importance. J Clin Microbiol. 2013;51(9):3018–24.
Hasing ME, Lee BE, Preiksaitis JK, Tellier R, Honish L, Senthilselvan A, et al. Emergence of a New Norovirus GII.4 Variant and Changes in the Historical Biennial Pattern of Norovirus Outbreak Activity in Alberta, Canada (2008–2012). J Clin Microbiol. 2013;51:2204.
Iturriza Gomara M, Kang G, Mammen A, Jana AK, Abraham M, Desselberger U, et al. Characterization of G10P rotaviruses causing acute gastroenteritis in neonates and infants in Vellore, India. J Clin Microbiol. 2004;42(6):2541–7.
Sarantis H, Johnson G, Brown M, Petric M, Tellier R. Comprehensive detection and serotyping of human adenoviruses by PCR and sequencing. J Clin Microbiol. 2004;42(9):3963–9.
PulseNet International. Molecular typing by PFGE. Available at: http://www.pulsenetinternational.org/protocols/. Accessed July 23, 2015.
Manage DP, Lauzon J, Atrazev A, Chavali R, Samuel RA, Chan B, et al. An enclosed in-gel PCR amplification cassette with multi-target, multi-sample detection for platform molecular diagnostics. Lab Chip. 2013;13(13):2576–84.
Bhutta ZA, Zipursky A, Wazny K, Levine MM, Black RE, Bassani DG, et al. Setting priorities for development of emerging interventions against childhood diarrhoea. J Glob Health. 2013;3(1):10302.
We are indebted to Karen Lowerison for her project management which has been invaluable in taking our ideas and assisting with their implementation. We also thank the Clinical Research Unit at the University of Calgary for their assistance with data management, the Pediatric Emergency Medicine Research Assistant Program at the Alberta Children's Hospital who assisted with patient recruitment, HealthLink Alberta staff for their assistance with recruitment, Calgary Laboratory Services and ProvLab Alberta for their assistance with specimen transport and processing.
Funding for the conduct of this study was provided by Alberta Innovates – Health Solutions (AIHS) who awarded APPETITE a Team CRIO (Collaborative Research Innovation Opportunity) grant. We also thank the Alberta Children’s Hospital Research Institute for providing financial support to the APPETITE team. Neither of these funding bodies played any role in design, in the collection, analysis, and interpretation of data or in the writing of the manuscript or in the decision to submit the manuscript for publication.
We also thank Copan Diagnostics Inc. for the provision of rectal swabs and Luminex Corporation for supporting our molecular diagnostic testing employing the Luminex xTAG® Gastrointestinal Pathogen Panel. Dr. Stephen Freedman's work is supported by the Alberta Children's Hospital Foundation's Professorship in Child Health and Wellness.
Dr. Linda Chui has received in-kind research support from Copan Diagnostics Inc. (provision of rectal swabs) and Luminex Corporation (Luminex xTAG® Gastrointestinal Pathogen Panel). None of the authors have received any reimbursements, fees, funding, or salary from any organization related to the content of this protocol.
SF conceived and designed the protocol and is responsible for data acquisition and interpretation; he drafted the current protocol and approved the final version as submitted. BL conceived and designed the protocol and is responsible for data acquisition and interpretation; she revised the current protocol and approved the final version as submitted. ML conceived and designed the protocol and is responsible for data acquisition and interpretation; she revised the current protocol and approved the final version as submitted. XP conceived and designed the protocol and is responsible for data acquisition and interpretation; she revised the current protocol and approved the final version as submitted. SA is responsible for specimen and data acquisition; she revised the current protocol and approved the final version as submitted. AC designed the economic analysis protocol and is responsible for data analysis; he revised the current protocol and approved the final version as submitted. LC conceived and designed the molecular diagnostic testing protocol and is responsible for data acquisition, analysis and interpretation; she revised the current protocol and approved the final version as submitted. GC conceived and designed the preference elicitation protocol and is responsible for data acquisition, analysis and interpretation; she revised the current protocol and approved the final version as submitted. JD assisted with protocol design; he revised the current protocol and approved the final version as submitted. SD designed the oral swab protocol; he revised the current protocol and approved the final version as submitted. ME assisted with protocol design; he revised the current protocol and approved the final version as submitted. TG assisted with protocol design; he revised the current protocol and approved the final version as submitted. XJ assisted with protocol design; he revised the current protocol and approved the final version as submitted. DJ designed the knowledge translation plan; he revised the current protocol and approved the final version as submitted. JK assisted with protocol design; he revised the current protocol and approved the final version as submitted. ML assisted with protocol design; he revised the current protocol and approved the final version as submitted. JM devised our public health connections and she assisted with protocol design, revised the current protocol, and approved the final version as submitted. SM assisted with protocol design; she revised the current protocol and approved the final version as submitted. LS assisted with protocol design; he revised the current protocol and approved the final version as submitted. JT assisted with protocol design; he revised the current protocol and approved the final version as submitted. PT conceived and designed the protocol and is responsible for data interpretation; he revised the current protocol and approved the final version as submitted. RT designed the adenovirus protocol and he assisted with protocol design; he revised the current protocol and approved the final version as submitted. OV assisted with protocol design; he revised the current protocol and approved the final version as submitted.
About this article
Cite this article
Freedman, S.B., Lee, B.E., Louie, M. et al. Alberta Provincial Pediatric EnTeric Infection TEam (APPETITE): epidemiology, emerging organisms, and economics. BMC Pediatr 15, 89 (2015) doi:10.1186/s12887-015-0407-7
- Polymerase Chain reaction
- Rectal swabs
- Discrete choice experiments
- Economic analysis