Skip to main content

Table 6 Reliability measure of agreement summary statistics: Inter-rater (Senior clinician & clinician) & intra-rater (Clinician)

From: The Queensland high risk foot form (QHRFF) – is it a reliable and valid clinical research tool for foot disease?

 

Inter-rater reliability

Intra-rater reliability

QHRFF field

%

K(SE)

Strength of agreement [[37]]

%

K(SE)

Strength of agreement [[37]]

General demographics

      

Indigenous status*

83.7

--

--

100

1.00 (0.01)

Near Perfect

Health professionals attending (in the past week)

   

Podiatrist

88.4

--

--

N/A

N/A

N/A

GP

81.4

0.45 (0.15)

Moderate

N/A

N/A

N/A

Nurse

81.4

0.47 (0.14)

Moderate

N/A

N/A

N/A

Orthotist

100

--

--

N/A

N/A

N/A

Physician

90.7

--

--

N/A

N/A

N/A

Surgeon

90.7

0.45 (0.23)

Moderate

N/A

N/A

N/A

Other

97.7

--

--

N/A

N/A

N/A

Medical co-morbidity history

    

Medical (diabetes) history

95.3

0.94 (0.05)

Near perfect

100

1.00 (0.01)

Near Perfect

Diabetes duration#

 

0.94 (0.87–0.97)

Strong

 

1.00 (0.99–1.00)

Strong

Recent BGLs >15 mmol/L*

83.7

0.67 (0.12)

Substantial

N/A

N/A

N/A

HbA1c result#

 

1.00 (1.00–1.00)

Strong

 

1.00 (1.00–1.00)

 

Hypertension

88.4

0.73 (0.11)

Substantial

89.5

0.78 (0.15)

Substantial

Dyslipidaemia

83.7

0.67 (0.11)

Substantial

94.7

0.90 (0.10)

Near Perfect

Smoker

88.4

0.64 (0.15)

Substantial

94.7

0.83 (0.17)

Near Perfect

CVD

88.4

0.76 (0.10)

Substantial

84.2

0.69 (0.17)

Substantial

CKD

86.1

0.58 (0.15)

Moderate

94.7

0.86 (0.14)

Near Perfect

ESRF

97.7

0.66 (0.32)

Substantial

100

--

--

Other (non-listed)

69.1

0.34 (0.11)

Fair

78.9

0.57 (0.19)

Moderate

High-risk history

    

Neuropathy

90.7

0.66 (0.16)

Substantial

94.7

--

--

PAD

83.7

0.67 (0.11)

Substantial

78.9

0.60 (0.16)

Moderate

Previous foot ulcer

90.7

0.72 (0.13)

Substantial

94.7

0.64 (0.33)

Substantial

Current foot ulcer

97.7

--

--

100

--

--

New foot ulcer

97.4

--

--

100

--

--

Previous amputation

97.7

0.95 (0.05)

Near perfect

100

1.00 (0.01)

Near Perfect

Clinical diagnoses of high-risk factors

    

Neuropathy

97.7

0.90 (0.10)

Near perfect

94.7

--

--

PAD*

97.9

0.97 (0.03)

Near perfect

84.2

0.69 (0.16)

Substantial

Acute charcot

100

1.00 (0.01)

Near perfect

100

--

--

Foot deformity

83.7

0.38 (0.18)

Fair

84.2

0.31 (0.30)

Fair

Risk classification

100

--

--

100

--

--

Clinical diagnoses of foot disease

    

Ulcer type*

88.4

0.81 (0.08)

Near perfect

84.2

0.77 (0.14)

Substantial

Combined surface area mm2#

 

0.94 (0.89–0.97)

Strong

 

1.00 (1.00–1.00)

Strong

Clinical signs infection*

76.7

0.60 (0.12)

Moderate

89.5

0.46 (0.32)

Moderate

UTWCS grade#

 

0.90 (0.83–0.95)

Strong

 

0.98 (0.94–0.99)

Strong

Ulcer depth^

95.3

0.90 (0.10)

Near perfect

94.7

0.79 (0.23)

Substantial

Clinical management principles performed

    

Debrided ulcer/callus*

97.7

0.66 (0.32)

Substantial

94.7

--

--

Dressing optimum*

97.7

--

--

100

--

--

Antibiotics required*

79.1

0.54 (0.12)

Moderate

89.5

0.44 (0.33)

Moderate

Off-loading optimum*

72.1

0.36 (0.13)

Fair

68.4

0.32 (0.23)

Fair

Footwear optimum*

67.4

0.33 (0.14)

Fair

68.4

0.37 (0.21)

Fair

Educated patient*

97.7

--

--

89.5

--

--

  1. K = Kappa; (SE) = Standard Error; -- = Measure of agreement was unable to be calculated because at least one variable was a constant.
  2. GP = General Practitioner; CVD = Cardiovascular Disease; ESRF = End Stage Renal Failure; N/A = Not applicable to test due to unstable rating environment; PAD = Peripheral Arterial Disease; UTWCS = University of Texas Wound Classification System.
  3. *= Weighted Kappa used for ordinal data;
  4. # = Intraclass correlation (ICC) (Standard Deviation (SD)) for continuous data.
  5. ^ = Depth was determined from the UTWCS score.