Skip to main content

Table 3 Reliability of the CareCAT tool

From: Oral medicine acceptance in infants and toddlers: measurement properties of the caregiver-administered Children’s acceptance tool (CareCAT)

 

Intra-rater agreement (video-review1)

Inter-rater agreement2

 

Observer I

Observer II

Observer III

Tool developer

Caregivers

 

N = 69

N = 69

N = 69

N = 104

N = 104

Scores dichotomized regarding acceptance behaviour3

     

%a

89%

87%

87%

88%

84%

кb

0.68

0.72

0.69

0.76

0.66

95% CIc

0.47–0.88

0.54–0.89

0.51–0.87

0.64–0.89

0.52–0.80

interpretation

strong

strong

strong

strong

strong

Scores dichotomized regarding completeness of medicine ingestion4

     

%a

93%

85%

91%

86%

82%

кb

0.67

0.50

0.70

0.67

0.59

95% CIc

0.39–0.94

0.23–0.76

0.48–0.92

0.52–0.83

0.42–0.76

interpretation

strong

moderate

strong

strong

moderate

Detailed scores

     

%a

81%

73%

78%

75%

63%

кb

0.56

0.49

0.55

0.59

0.34

95% CIc

0.36–0.75

0.33–0.65

0.38–0.72

0.47–0.71

0.25–0.44

interpretation

moderate

moderate

moderate

moderate

fair

  1. aagreement in %
  2. bCohen’s kappa coefficient
  3. c95% confidence interval of kappa
  4. 1Comparison of scoring videos shown in systematic consecutive vs. random order
  5. 2Observers’ scores compared with scores of tool developer and caregivers
  6. 3Acceptance behavior: positive: swallows well vs. negative: all other combinations
  7. 4Medicine ingestion: complete: swallows well, also combined with refusal vs. incomplete: all other combinations