Associations between study questionnaire-assessed need and school doctor-evaluated benefit of routine health checks: an observational study

Abstract

Background

In Finland, school doctors examine all children at predetermined ages in addition to annual health checks by school nurses. This study explored the association of study questionnaire-assessed need for and school doctor-evaluated benefit of routine health checks conducted by doctors.

Methods

Between August 2017 and August 2018, we recruited a random sample of 1341 children in grades 1 and 5 (aged seven and eleven years, respectively) from 21 elementary schools in four Finnish municipalities. Children mainly studying in special education groups or whose parents needed an interpreter were excluded. School nurses performed their health check as usual. Parents, nurses, and teachers then completed study questionnaires that assessed the concerns of parents, school nurses, and teachers regarding each child’s physical, mental and social health. Doctors, blinded to the responses, routinely examined all the children. The primary outcome measures were (1) the need for a health check based on the study questionnaires and (2) the benefit/harm of the appointment as estimated by the doctors according to predetermined criteria, and (3) the patient-reported experience measures (PREMs) of benefit/harm of the appointment as estimated by the parents and children. We compared the need for a health check with the doctor-evaluated benefit using multilevel logistic regression.

Results

The participation rate was 75.5 %. According to all questionnaires, 20–25 % of the 1013 children had no need for a health check. The doctors regarded 410 (40.6 %) and the parents 812 (83.4 %) of the appointments as being beneficial. Respondents rarely reported harm. The children who were classified as needing a health check more often benefitted from the health check (assessed by the doctor) than children with no need for one (OR 3.53; 95 % CI 2.41–5.17).

Conclusions

The need for a health check is an important predictor of school-doctor evaluated benefit of the health check. This approach could allow school doctors to allocate time for the children who need them most.

Trial registration

ClinicalTrials.gov, Identifier NCT03178331, registration June 6th 2017.

Background

School health services exist in at least 102 countries [1] and provide a unique opportunity to identify and help children at risk of long-lasting physical, mental and social problems. Even in high-income nations, poorer children are at increased risk of adverse health outcomes [2]. One solution to this problem could be school-based health centers that can advance health equity [3]. Large-scale interventions by school health services may be more cost-effective than individual screening procedures [4, 5]. The interventions should focus on the individual, family, and community [6].

Substantial gaps exist in the evidence supporting many preventive care recommendations such as behavioral counceling and screening which are often included in health checks [9]. According to a review of research published in English from 1943 to 1995, yearly physical examinations had no value in detecting important pathologic conditions in adolescents [10]. The diagnostic accuracy of blood pressure measurements among asymptomatic children and the benefits and harm of screening for adolescent idiopathic scoliosis are unclear [11,12,13]. In the Netherlands, no significant differences were found in the detection of children’s overweight, visual disorders or psychosocial problems between doctors’ assistants, nurses, and doctors [14]. A German study suggested that health checks by physicians at school entry could be reduced by targeting them at children who are at risk of a severe developmental disorder [15]. However, a recent review found evidence supporting the implementation of anxiety prevention programs, asthma education, and vision screening [16].

In Finland, the public preventive health care of children and young people is legally bound to offer routine general health checks by nurses and doctors in addition to appointments related to special health care needs [7]. Prior to the age of 6 years, well child clinics offer children fifteen general health checks by nurses and five health checks that also involve a doctor. Despite the lack of robust evidence supporting health checks of asymptomatic school children, school nurses conduct annual health checks of children aged 7–15 years. In grades one, five, and eight (at ages seven, eleven, and fourteen years, respectively) parents are invited to participate in the extensive health checks. During these extensive health checks, both the nurse and the doctor check the children regardless of previously identified children’s health risks. The roles of school nurses and school doctors are described in Table 1 of the study protocol [8]. The major differences between nurses and doctors are that doctors evaluate the status of the child more extensively than nurses (auscultation of heart and lungs, examination of testicles, psychiatric and neurologic status, diagnostics and differential diagnostics), and write prescriptions and referrals to secondary care when needed. Local authorities regulate the execution of school doctors’ health checks at predetermined ages, which restricts the use of doctors’ expertise in schools. School doctors have insufficient time for children in other age groups, for multidisciplinary work, and for the treatment of school-related health problems.

Table 1 Baseline characteristics of participating 1013 children and 14 doctors

It is not known if the health check by the school nurse is sufficient for elementary school children. The primary aim of this study was to explore the association of study questionnaire-assessed need for and school doctor-evaluated benefit of routine general health checks of elementary school children in grades 1 and 5 (at ages seven and eleven years, respectively).

Methods

Study design

The study protocol for this observational study is available online [8]. The school nurses performed their health check as usual. Before the health check conducted by a school doctor, parents, school nurses, and teachers reported their concerns regarding each child. These concerns constituted the need for a health check. After the health check, this need was compared with the benefit or harm of the health check as assessed by the doctors according to predetermined criteria (Fig. 1). In addition, the parents and children filled in patient-reported experience measures (PREMs) of the benefit or harm. The study was undertaken in 2017–2018 in four municipalities in Finland. In one of the municipalities (Helsinki) doctors worked exclusively in schools, whereas in the three other municipalities (Tampere, Kerava and Kirkkonummi), doctors regularly visited schools but some also provided services in well child-clinics and health centers.

Fig. 1

Study design

Participants

In Helsinki, six school doctors consented to participate in the study and they chose schools from different socioeconomic areas in the city. In Tampere, Kirkkonummi and Kerava, the medical directors recruited doctors with varying education and work experience and schools from different socioeconomic areas. All the schools were Finnish language elementary schools. The school nurses and teachers were recruited from the participating schools.

Between August 22, 2017 and August 31, 2018, we recruited a random sample of 1341 eligible children from the participating schools. Exclusion criteria were children mainly studying in special education groups and the parents’ need for an interpreter. The study nurse assigned all eligible children a computer-generated random number. The first 30 children in each school and their guardians were asked to participate. If more than five families declined, more children were recruited from the random order list.

Procedures

Parents are invited to participate in the extensive health checks in grades 1 and 5. Before the health check by nurses, the nurses receive background information of the child and family from the questionnaires provided by the National Institute for Health and Welfare (parent 1st and 5th grade), child 5th grade and teacher (some schools). These questionnaires have been developed to guide discussion. School nurses performed their health check as usual. Parents, school nurses, and teachers then completed study questionnaires which assessed the concerns of the parents, school nurses, and teachers regarding each child’s physical and mental health and the well-being of the whole family. One question from the Strengths and Difficulties Questionnaire (SDQ), “Overall, do you think that your child has difficulties in one or more of the following areas: emotions, concentration, behaviour or being able to get on with other people?” was modified into four separate questions [17,18,19,20]. The questionnaires also included questions regarding the child’s growth, physical well-being, eating, sleeping, learning, school absenteeism, and the well-being of the whole family, based on previous evidence [21,22,23,24,25,26], and the clinical knowledge of the research group. One final question inquired whether the respondent wished for a school doctor’s assessment of these or some other concerns.

All school doctors performed their health checks as usual blinded to the questionnaire responses. The doctors had access to routine background information and patient records. After each health check, the doctors filled in an electronic report that included any interventions undertaken during the health check and evaluated the benefit or harm of the health check. The parents, and children filled in patient-reported experience measures (PREMs) of the benefit or harm.

Outcomes

The primary outcome measures were (1) the need for a health check by a doctor based on the questionnaires and (2) the benefit/harm of the health check as estimated by the doctors, according to predetermined criteria, and (3) the PREMs of the benefit/harm of the health check as estimated by the parents and children.

We assessed the need for a health check by a doctor based on the questionnaires completed by the parents, teachers, and nurses. Responses were categorized into three groups: (1) “No need for a health check by a doctor”, (2) “Needs a health check by a doctor”, and (3) “Consulting with a nurse or doctor may be sufficient”. The categorization of questionnaire responses is described in the study protocol [8]. Missing responses to individual questions were considered to indicate no concern or no wish for a school doctor’s assessment of the concerns. An empty questionnaire was reported as missing and excluded from the analyses.

Participating doctors assessed the benefit or harm of each health check according to criteria described in Table 2 of the study protocol [8]. The doctors reported quite a lot or a great deal of benefit if they staged any significant interventions based on predetermined criteria. The doctors reported “Only a little benefit” if the nurse could have replaced the doctor. The doctors reported harm if the interaction was unsatisfactory, or if they suspected no progress in care or refusal of school doctor services in the future. The parents and children rated how beneficial or harmful they found the school doctor’s examination without predetermined criteria. The English versions of the PREMs are provided in Additional files 5 and 6 of the study protocol [8]. In contrast to the study protocol and to increase clarity, we reported the doctors’ and parents’ evaluations of benefit and harm separately.

Table 2 Reason for non-participation of children

The questionnaires with a free description of concern require time-consuming individual analysis. Therefore, we also conducted an exploratory analysis of the need for a health check by a doctor according to the final ‘wish question’ of the study questionnaires which refers to all the other concern questions of the study questionnaires. For parents, the question was: “Do you wish to speak with the school doctor about these concerns or some other concern related to the child’s well-being?” For nurses and teachers, the question read: “Do you wish the school doctor to address these concerns or some other concern related to the well-being of the pupil?” The response options were: (1) “Yes”, (2) “No”, or (3) “I don’t know”. Responses to the wish question were categorized into three groups as follows: (1) “Yes” = “Needs a health check by a doctor”, (2) “No” = “No need for a health check by a doctor”, and (3) “I don’t know” = “Consulting with a nurse or doctor may be sufficient”. Missing study questionnaire responses were treated as missing values and excluded from the analyses.

Statistical analyses

According to power calculations, 450 children were needed from both grades to detect a 20 % difference (25 % vs. 45 %) in the benefit between children in need of and children with no need for a health check by a doctor [8]. Frequencies with percentages and medians with interquartile ranges were used as descriptive statistics.

The intrarater and interrater reliability of the evaluation of need were assessed with the kappa coefficient. KN evaluated the need for a health check by a doctor from the whole data and 200 randomly selected cases for intrarater reliability. To assess interrater reliability, SK evaluated the data from 200 randomly selected children. SK repeated the evaluation of the same 200 children to assess her intrarater reliability. TS resolved any discrepancies. Only questionnaires with a free description of concerns required manual analysis. Otherwise, the need was assessed using a formula according to predetermined criteria [8].

The association of the need for a health check by a doctor (based on the concerns of parents, teachers and school nurses) and the benefit of the health check by a doctor (assessed by the doctor) was analyzed using multilevel logistic regression analysis to account for the clustered nature of the data. Multilevel logistic regression models were used with child at level one, school at level two, doctor at level three, and municipality at level four. Results were expressed using odds ratios (OR) with 95 % confidence intervals (CI). Analyses were also conducted separately for children in grades one and five because the outcome may differ in different age groups. SAS 9.4 System for Windows (SAS Institute Inc., Cary, NC) was used for multilevel modeling. Other analyses were performed using IBM SPSS Statistics 25.0 for Windows (IBM Corp., Armonk, NY). P-values less than 0.05 were considered statistically significant.

Results

From 1341 eligible children, 1013 (75.5 %) participated in the study. In total, 506 first graders (78.4 %) and 507 fifth graders (72.8 %) and their parents, 14 doctors, 31 nurses and 105 teachers from 21 schools participated in the study. Half of the doctors held some specialist degree and over half worked full-time in schools and/or well-child clinics (Table 1). The numbers of missing or late questionnaires, electronic reports by doctors, and PREMs of parents and children are presented in Additional file 1. The reasons for non-participation of children are collated in Table 2.

According to all questionnaire responses, 212 children (20.9 %) had no need for a health check by a school doctor (Table 3). Parents, nurses, and teachers respectively provided 542 (54.4 %), 563 (58.2 %), and 305 (37.4 %) free descriptions of their concerns, respectively. The kappa measures of agreement for inter- and intrarater reliability of the questionnaires were over 0.7 (good) and 0.8 (excellent), respectively.

Table 3 Need for school doctor’s health check according to all study questionnaire responses

The doctors evaluated 410 (40.6 %) of the health checks as being beneficial. The parents and children respectively reported benefit from 812 (83.4 %) and 598 (60.3 %) health checks (Table 4). In 42 cases, the doctors considered the health check beneficial but the parents disagreed. In 113 cases, the doctors evaluated the appointments as being beneficial purely due to the instructions provided or the discussion held. In 14 of these cases, the parent disagreed with the doctors’ evaluation. All evaluations of benefit and harm are presented in Additional file 2.

Table 4 Evaluation of the benefit of a doctor’s health check by the doctors, parents, and children

Doctors reported harm from six appointments. In all of these cases, they felt that the interaction had failed. Parents reported harm from three appointments, two of which were due to failed interaction or an unnecessary check of a healthy child. One parent’s report of harm was an error, because it was based on the argument of receiving advice and help for the problem. Twelve children reported harm because of pain (vaccination or planned blood test), their dislike of being touched or having to undress, or because of being bored.

The children who were classified as needing a health check more often benefitted from it (assessed by the doctor) than those with no need for a health check (OR 3.53; 95 % CI 2.41–5.17) (Table 5). In total, doctors evaluated 42 health checks as beneficial despite no need for a health check based on questionnaires by parents, nurses, and teachers. Two of these 42 children had a minor finding (gliding testis) that is usually only recognized by physicians. In total, doctors evaluated 431 health checks as non-beneficial despite need for a health check based on questionnaires by parents, nurses, and teachers. In 264 of these 431 cases the doctor reported “Only a little benefit”, in 161 cases “No benefit or harm”, and in 6 cases harm.

Table 5 Association of need for and doctor-evaluated benefit of the doctor’s health check; multilevel logistic regression analysis

In the exploratory analysis, the single wish question proved as valuable as using all the questionnaire responses for determining the need for a health check by the school doctor. According to the responses to the wish question, 257 children (25.4 %) had no need for a doctor’s appointment (Additional file 3). In this analysis, the children in need of a health check also more often benefitted (assessed by the doctor) from the health check than those with no need for one (OR 3.60; 95 % CI 2.53–5.11) (Additional file 4).

Discussion

The children who were classified as needing a health check more often benefitted from the health check than children with no need for a health check. In this study, 20–25 % of the participating children had no need for a health check by a school doctor. Doctors evaluated two-fifths and parents four-fifths of health checks as being beneficial. All respondents rarely reported harm.

Nurses wished that the school doctor would address their concerns regarding over half of the children in grades one and five, which is surprisingly high. Children in other grades rarely meet a school doctor even when they have special health care needs, for example, related to overweight or obesity [27]. However, many health problems would be most efficiently detected and managed in the school [28, 3]. Furthermore, nurses may be unaware of the concerns of parents and teachers regarding children in other grades since they often meet children alone during the annual health checks between the extensive health checks in grades 1 and 5. The value of these health checks by school nurses without collaboration with parents and teachers is questionable.

Parents considered most health checks as beneficial. This may reflect their appreciation of the doctor thoroughly checking their child, as well as the opportunity to have a discussion with a doctor. On the other hand, the doctors reported benefit from 42 health checks that the parents considered of minor value. In these cases, the doctor may have regarded some intervention important although it had no current value to the parent.

One-fifth of the children with no need for a health check by a school doctor benefitted from it according to the doctor. Several explanations for under-reporting of some concerns prior to the health check are plausible: (1) the parents’ concerns may have changed, even within a short time after filling in the questionnaire; (2) the parents may remember or express their concerns only when meeting a professional; (3) the parents and teachers may be unaware of the doctor’s role in school health services and thus expect no help from the doctor for psychosocial or learning problems; and (4) the doctors may offer prescriptions, for example, for skin conditions and allergies that are unessential at the time but likely to be necessary in the future.

Children rarely had findings that require a doctor’s expertise to be recognized. In all, 42 children who had no questionnaire-based need for a health check, still benefitted of the health check. Two of these children had a minor finding (gliding testis) that is usually only recognized by physicians. Hutson and coworkers recommended the screening of all boys for acquired undescended testis at school entry [29]. In Finland, children are already thoroughly examined for this condition as well as other similar conditions such as heart murmurs [30, 31] in health checks at the age of four years, in addition to earlier health checks in well-child clinics. These results are in line with a review in which annual physical examinations had no value in detecting important pathologic conditions in adolescents [10].

Over half of the children with need for a health check gained no benefit from it according to the doctor. Most of these cases belonged to the categorization “Only a little benefit” which comprised findings and instructions that the school nurse could have provided. Several other factors may explain this finding. The concerns may have changed, even within a short time after filling in the questionnaire. The doctors may have been unaware of the teachers’ concerns and unable to target interventions. Parents and teachers may disagree about their concerns regarding a child. Despite significant concerns the family and/or child may have been referred to appropriate specialists already earlier and required no interventions from the school doctor.

Our study has several strengths. The study was conducted in a “real world” setting of children’s regular health checks with a high participation rate. We reduced information bias by similar training of the participating doctors, nurses, and teachers and by blinding the doctors to the study questionnaire responses. The researchers assessed the need for a health check by a doctor without knowing the evaluations of the benefit provided by the doctors and parents. The study included schools and professionals from different municipalities and socioeconomic areas, which increases the generalizability of the results. The questionnaires were easy to understand and could be completed within a few minutes. Using only the ‘wish question’ to determine the need for a health check by a doctor was especially feasible, since the considerable amount of free descriptions of concern became rudundant. However, the ‘wish question’ refers to all the other concern questions of the study questionnaires and thus cannot be used alone. In practice, the questionnaires could be provided digitally throughout the school year, which could improve the timeliness of the health check. School doctors could also utilize all the questionnaire responses (multi-informant approach) to target interventions during the health check, unlike in the present research setting.

The study also had some limitations. A randomized controlled trial was inconceivable because school health care in Finland is legally defined. Recruiting a control group that would undergo no health checks was impossible. However, the doctors performed their health checks as usual for all children and were blinded to the study questionnaire responses. Although the participation rate in this study was high, selection bias may have occurred, since a quarter of invited families refused to participate. Non-participants may have been families who had the most stressors in their life. The frequency of missing questionnaires from parents and nurses was low, but about one-fifth of the teachers’ questionnaires were missing. However, the use of a multi-informant approach reduced the impact of missing questionnaires. The participating doctors were not randomly selected. However, doctors with varying education and work experience from different cities participated in the study and only three doctors’ evaluations of benefit or harm were missing. Children mainly studying in special education groups and children whose parents needed an interpreter were excluded. In these vulnerable groups, involving the school doctor is plausibly beneficial to provide information and ascertain adequate health and social care contacts and rehabilitation services. Information bias may have occurred when doctors evaluated the benefit of the health check. Although the doctors followed previously defined criteria when assessing benefit, subjectivity was impossible to eliminate. We accounted for this in the statistical analyses by using multilevel logistic regression and included different doctors as one of the four covariates.

We focused on a surrogate outcome of benefit that the doctors evaluated immediately after each health check. Surrogate end points can fail to predict a true clinical outcome [32]. General health checks in adults have been found to increase the number of new diagnoses but failed to reduce morbidity and mortality [33]. However, if the school doctor conducted no interventions during the health check, substantial benefit would be improbable. Even the health checks considered beneficial should be appraised critically as several reasons may diminish the actualized benefit. Families may neglect the suggested tests and treatment plans. The intensity of the interventions may be insufficient to affect both the school and the family environment [34]. Despite the preventive health care system in Finland, Häkkänen and coworkers demonstrated that obesity increased and obese children remained obese during the primary school years [35]. Furthermore, other pathways may affect any clinical outcome. Parents may contact doctors or other professionals outside the school health services. Unpredictable adverse life events may also occur after the health check.

Although organizational models of school health services differ globally [1, 28, 36, 37], this proposed approach of concern-based health checks by school doctors may be useful internationally. In the future, this method of assessing children’s need for a health check by a doctor could be tested digitally in a country where general health checks by doctors are non-obligatory. A multidisciplinary approach in co-operation with the family to find the most suitable way to reduce concerns detected by this method may be valuable. The ability to coordinate effective preventive care requires multidisciplinary work related to poverty, educational outcomes, the healthiness of social and physical environments, and healthy lifestyle choices [6, 38]. Doctors should have time to participate in multidisciplinary work within the school, and cooperate with family counselling, child-protection services, and secondary care more often than is currently feasible. Children with special health care needs require more services than their peers [39].

Conclusions

The children who were classified as needing a health check more often benefitted from the health check than children with no need for a health check. The need for a health check is an important predictor of school-doctor evaluated benefit of the health check. If unnecessary routine general health checks were omitted, school doctors could allocate more time for children and families in greatest need, regardless of the grade. These findings can be used in future studies and policymaking to enhance equity in school health services.