The paediatric flat foot proforma (p-FFP): improved and abridged following a reproducibility study
Journal of Foot and Ankle Research volume 2, Article number: 25 (2009)
Concern about a child's flat foot posture is a common reason for frequent clinical consultations for an array of health care and medical professionals. The recently developed paediatric flatfoot clinical-care pathway (FFP) has provided an evidence based approach to diagnosis and management. The intra and inter-rater/measurer reliability of the FFP has been investigated in this study.
From a study population of 140 children aged seven to 10 years, a sample with flat feet was identified by screening with the Foot posture index (FPI-6). Subjects who scored ≥ 6 on the FPI-6 for both feet became the study's flat foot sample. A same subject, repeated measure research design was used for this study which examined the reliability of the FFP in 31 children aged seven to 10 years, as rated by three examiners.
Approximately half of the items of the FFP showed less-than-desirable inter-rater reliability, arbitrarily set at the conventional 0.7 level (intra-class correlations). Removal of the unreliable items has produced a shorter; more relevant instrument designated the paediatric flat foot proforma (p-FFP).
The p-FFP is a reliable instrument for the assessment and resulting treatment actions for children with flat feet. Findings indicate that the simplified p-FFP is a reproducible instrument for the clinical assessment of flat foot in mid-childhood.
The significance of "flat feet" continues to debated within the general community, medical and allied health fields, as it has for decades [1–12]. Although flat foot in childhood is a common diagnosis and well established clinical term, there is a lack of a reliable and reproducible tool for the assessment of this condition.
The paediatric flat foot is a controversial topic. Whilst many reports relating to flat feet/pes planus/pes valgus have occupied the medical literature[4, 6–8, 10, 11, 13–20], there remains a paucity of well-founded, scientific knowledge about this common condition. A definitive definition is lacking and children's flat feet continue to be diagnosed by a plethora of methods, from observation to clinical measurements and imaging, which are largely unsubstantiated in terms of the reliability and validity of the same. Flat feet, as a postural morphology, have long been associated with pain and disability (eg an exclusion from military service in both World Wars) and thus are often a concern to parents from a preventative perspective of their children's health and mobility.
The reported prevalence of paediatric flat foot varies in the literature and ranges from approximately 3 – 15% [1, 5, 21]. Views of treatment are contentious [4, 6, 22] and there is little longitudinal data to provide evidence of the efficacy of different regimen [23–25].
Clinicians often disagree about the management of flatfeet [26, 27], partly because there is no standard approach to assessment or classification of flat foot sub types (eg rigid, flexible, symptomatic, developmental). The flat foot clinical pathway or proforma (FFP) developed in previous work , offers an evidence based clinical tool for the evaluation of this common childhood condition (Figure 1).
The FFP offers a structured checklist approach to significant clinical findings viz. arch shape (weight bearing compared to non-weight bearing), range of motion (reduced, increased or asymmetry), tender areas (joint location and presentation eg swelling), gait (limp, asymmetry, or altered angle of gait; examined shod and barefoot), and diagnostic studies (as available, required).
The focus of the FFP is centred on an accurate diagnosis of the suggested sub-types of paediatric flat foot (flexible, rigid, skewfoot, other). For the purposes of this study the FFP observations/assessments items were collected in categorical form eg medial longitudinal arch: ok/reduced, heel inversion with tip toe: yes/no, tibial, knee positions: medial/straight/lateral. Clinical measures were collected in the units of measure (degrees, millimetres) or as scaled observations for FPI-6 criteria. The FPI-6 was used as described elsewhere  to assess all subjects overall foot posture. The FPI-6 consists of six separate scaled observations (-2 to +2) which are then summed to give a total score/foot. The FPI-6 total scores range from -12 (highly supinated) to +12 (highly pronated) and provides a scaled rating of static foot posture.
The present study was undertaken to assess the reproducibility of the FFP, when used by the same observer and between different observers evaluating the same subject.
Ethical approval was obtained from the Human Research and Ethics committee at the University of South Australia. Two primary schools in Port Pirie were approached and consented to being involved in the study. Consent forms were returned from the parents of 140 children, aged between seven and 10 years.
All 140 paediatric subjects were initially assessed by the one examiner (AE) using the Foot Posture Index (FPI-6) to establish designated flatfoot status [29–31]. Of these, 31 subjects returned an FPI-6 score of ≥ = 6 for both feet, indicating bilateral flat foot  and these subjects were selected for the flatfoot proforma reproducibility study.
All measures were recorded against each child's allocated identity (ID) code. Coloured paper (eg pink, green, blue) to designate each investigator, were used for the FFP charts, with 'am' on the first examination session sheets and 'pm' on the repeated examination sheets. All measures were performed with children dressed but with shoes and socks removed.
The reliability study followed standard protocol as a same subject, repeated measures investigation by three examiners. Each child removed their shoes and socks and stood on a low table approximately 0.5 m in height. The child was asked to look straight ahead (out of a window) whilst their feet were examined. Each of the investigators observed the child's feet and recorded their findings via the FFP. Each child's gait was also briefly observed by each investigator. The total foot examination time took approximately five to10 minutes for each child for each investigator.
The second examination session took place at least three hours after the first session. The second examination session was identical to the first, excepting the collection of anthropometric data which was only collected at the initial examination. At the completion of this examination shoes and socks were replaced, and the children were returned to their classrooms.
All examination findings were entered into a database for statistical analyses of the investigator's examining reliability (both intra and inter-rater) utilizing the FFP. To preserve confidentiality, only the children's ID codes were entered with this data.
Data were entered and all analyses were performed using constructed data sets in SPSS version 15 (SPSS Science, Chicago, Illinois) and Microsoft Excel 2000 (Microsoft Inc, Redmond, Washington) software packages.
To determine intra-rater agreement, intraclass correlation coefficients (ICCs) were calculated (model [3, 1] based on two-way analysis of variance, mixed effect with consistency). 95% confidence intervals were also calculated for each rater's measures .
To determine inter-rater agreement, the intraclass correlation coefficient was used in its most conservative form (model [1, 1] based on two-way analysis of variance, random effect with absolute agreement) were calculated, within 95% confidence intervals.
The ICC, widely used for reliability analyses, reflects both correlation and agreement and provides a single index among two or more ratings, which was a requirement of this study . Calculating ICCs also made the results comparable with previous studies [34, 35].
An acceptable level of reliability was defined, acknowledging that such limits are essentially arbitrary. However, such definitions provide useful "benchmarks" for discussion. Intraclass correlation coefficient values greater than 0.70 indicated good reliability  and were used to determine which FFP items might be retained or discarded. Confidence Intervals (95%) were also calculated to show the range of reliability results.
The foot posture histograms for the study population (N = 140) (Figure 2) showed normal distribution for both left and right FPI-6 total scores. The FPI-6 left foot total score averaged 4.12 (± 2.2) and the FPI-6 right foot total score averaged 3.74 (± 2.3). The FPI-6 scores ranged from -3 to +9 indicating that a range of foot types, ie supinated to pronated, were encountered within this study group, which is important for the external validity of these findings.
The results of the FFP items which returned inter-rater reliability results (ICC [1,1]) of approximately ≥ 0.70 in the flatfoot group (n = 31), are shown in Table 1 (within 95% CI).
Table 3 shows the items/examination area of the FFP and the same when inter-rater reliability (ICC [1,1] ≥ 0.70) levels were applied. The net result of reliability testing effectively halved the number of items remaining (to form the new p-FFP, Figure 3).
Assessment of the reliability of the individual items of the FFP revealed that many of the items returned poor reliability. As measures, items with poor inter-rater reliability are of little value for clinicians and once identified, usefully discarded. The net effect of this study has been to revise the FFP  by eliminating the items with demonstrably poor inter-rater reliability, which by convention were those with ICC of < 0.70 . Approximately half the items failed to meet the set inter-rater reliability standard (ICC > 0.70). The resulting flat foot assessment tool is greater in brevity, reliability and hence general clinical value.
A limitation of this study is that the overall reproducibility of the newly modified p-FFP was not confirmed as part of this study. This issue is being addressed in a project currently underway, but remains a limitation of the present study. The selection of subjects aged seven to 10 years may limit the application of the p-FFP. However, in clinical practice this is a common age of presentation, parental concern and clinical quandary regarding management .
The paediatric flat foot proforma (p-FFP) provides a pragmatic standard by which paediatric flat feet can be assessed and management broadly directed. The p-FFP is a compilation of best available evidence , consensus guidelines  and tested clinical foot posture measures . Within a framework of context (history and signs), the p-FFP is diagnostically rich, yet simple. As a tool, it allows reliable comparison from baselines and between clinicians or researchers. In addition, the p-FFP maintains the simple 'traffic light" framework, making it easy to explain to parents and other medical or health professionals, and ensuring that all are literally on the same evidence-based page when considering the child's flat foot.
It is interesting to note that the focal points of the p-FFP are the presence/absence of symptoms, the arch morphology, and the heel position – all of which, mooted for many years [3, 4, 6, 19, 38–40], are now substantiated. The p-FFP directs action largely dependent upon symptoms (treatment indicated, the 'red light'), age (developmental flat foot is normal physiology, the 'green light') and clinical experience (monitoring and simple management of the 'amber light'). Whilst concerning for some , this approach is judicious, evidence-based and contemporary .
It must be stressed that any clinical pathway, no matter how rigorously evaluated, should always be used in conjunction with good clinical judgement.
The findings of this study suggest that the modified p-FFP is a more reproducible and reliable tool for the assessment of flat foot in children, than the previously developed version: the paediatric flat foot clinical pathway (FFP). The modified tool, which requires approximately half the number of items is both simpler and less time consuming to use and most importantly demonstrated satisfactory inter-rater/measurer reliability. Within the limitations of the study, these findings support the use of the p-FFP as a clinical tool for the assessment and evaluation of this common childhood condition. However it is recommended that if this instrument were to be used in future research studies of flat foot in childhood, the intra-rater and or if appropriate inter-rater reproducibility of the tool should be tested and recorded prior to data collection to demonstrate and ensure scientific rigour.
Sullivan JA: Pediatric flatfoot: evaluation and management. Journal of the American Academy of Orthopaedic Surgeons. 1999, 7: 44-53.
Suzuki N: An electromyographic study of the role of muscles in arch support of the normal and flat foot. Nagoya Medical Journal. 1972, 17: 57-79.
Tareco JM, Miller NH, MacWilliams BA, Michelson JD: Defining flatfoot. Foot & Ankle International. 1999, 20: 456-460.
Tax HR: Flexible flatfoot in children. Journal of the American Podiatry Association. 1977, 67: 616-619.
Alakija W: Prevalence of flat foot in school children in Benin City, Nigeria. Tropical Doctor. 1979, 9: 192-194.
D'Amico JC: Developmental flatfoot. Clinics in Podiatry. 1984, 1: 535-546.
Ferciot CF: The etiology of developmental flatfoot. Clinical Orthopaedics & Related Research. 1972, 85: 7-10. 10.1097/00003086-197206000-00003.
Gervis WH: Flat foot. British Medical Journal. 1970, 1: 479-481. 10.1136/bmj.1.5694.479.
McCarthy DJ: The developmental anatomy of pes valgo planus. Clinics in Podiatric Medicine & Surgery. 1989, 6: 491-509.
Bordelon RL: Hypermobile flatfoot in children. Comprehension, evaluation, and treatment. Clinical Orthopaedics & Related Research. 1983, 181: 7-14.
Miller GR: The operative treatment of hypermobile flatfeet in the young child. Clinical Orthopaedics & Related Research. 1977, Jan-Feb: 95-101.
Staheli LT: Planovalgus foot deformity. Current status. J Am Podiatr Med Assoc. 1999, 89: 94-99.
Staheli LT: Evaluation of planovalgus foot deformities with special reference to the natural history. J Am Podiatr Med Assoc. 1987, 77: 2-6.
Dockery GL: Treatment of flexible flatfoot. A panel discussion. J Am Podiatr Med Assoc. 1987, 77: 46-49.
Caselli MA, Sobel E, McHale KA: Pedal manifestations of musculoskeletal disease in children. Clinics in Podiatric Medicine & Surgery. 1900, 15: 481-497.
Chang FM: The flexible flatfoot. Instructional Course Lectures. 1988, 37: 109-110.
Lepow GM, Valenza PL: Flatfoot overview. Clinics in Podiatric Medicine & Surgery. 1989, 6: 477-489.
Roper BA: Flat foot. British Journal of Hospital Medicine. 1979, 22: 355-357.
Salo JM, Viladot A, Garcia-Elias M, Sanchez-Freijo JM, Viladot R: Congenital flat foot: different clinical forms. Acta Orthopaedica Belgica. 1992, 58: 406-410.
Silk FF, Wainwright D: The recognition and treatment of congenital flat foot in infancy. Journal of Bone & Joint Surgery – British Volume. 1967, 49: 628-633.
Pfeiffer M, Kotz R, Ledl T, Hauser G, Sluga M: Prevalence of flat foot in preschool-aged children. Pediatrics. 2006, 118: 634-639. 10.1542/peds.2005-2126.
Bordelon RL: Correction of hypermobile flatfoot in children by molded insert. Foot Ankle. 1980, 1: 143-150.
Wenger DR, Mauldin D, Speck G, Morgan D, Lieber RL: Corrective shoes and inserts as treatment for flexible flatfoot in infants and children. Journal of Bone & Joint Surgery – American Volume. 1989, 71: 800-810.
Rome K, Ashford RL, Evans AM: Non-surgical interventions for paediatric pes planus. Cochrane Database of Systematic Reviews. 2007, 1-7. Art. No.: CD006311. DOI: 10.1002/14651858.CD006311,
Whitford D, Esterman A: A randomized controlled trial of two types of in-shoe orthoses in children with flexible excess pronation of the feet. Foot and Ankle International. 2007, 28: 715-723. 10.3113/FAI.2007.0715.
Bresnahan P: The Flat-Footed Child – To Treat or Not to Treat. What is the Clinician to Do?. J Am Podiatr Med Assoc. 2009, 99: 178-
Evans AM: The Flat-Footed Child – To Treat or Not to Treat. What is the Clinician to Do?. J Am Podiatr Med Assoc. 2009, 99: 179-
Evans AM: The flat-footed child – to treat or not to treat, what is the clinician to do?. J Am Podiatr Med Assoc. 2008, 98: 386-393.
Redmond AC, Crosbie J, Ouvrier R: Development and validation of a novel rating system for scoring foot posture: the Foot Posture Index. Clin Biomechanics. 2006, 21: 89-98. 10.1016/j.clinbiomech.2005.08.002.
Keenan A-M, Redmond AC, Horton M, Conaghan PG, Tennant A: The Foot Posture Index: Rasch analysis of a novel, foot specific outcome measure. Rheumatology. 2006, 45: i128-
Redmond AC, Crosbie J, Peat J, Burns J, Ouvrier R: A new criterion based, composite clinical rating system for the quantification of foot posture: its validation and use in clinical trials. Book of Abstracts. 2001, 55-57. Ref Type: Abstract
Portney LG, Watkins MP: Foundations of clinical research. Applications to practice. 2000, Upper Saddle River, NJ: Prentice Hall Health, 2
Shrout PE, Fleiss JL: Intraclass correlation: uses in assessing interrater reliability. Psychology Bulletin. 1979, 86: 420-428. 10.1037/0033-2909.86.2.420.
Evans AM, Copper AW, Scharfbillig RW, Scutter SD, Williams MT: Reliability of the Foot Posture Index and Traditional Measures of Foot Position. J Am Podiatr Med Assoc. 2003, 93: 203-
Evans AM, Scutter SD, Iasiello H: Measuring the paediatric foot – a criterion validity and reliability study of navicular height in 4-year-old children. The Foot. 2003, 13: 76-82. 10.1016/S0958-2592(02)00148-7.
Gould N, Moreland M, Alvarez R, Trevino S, Fenwick J: Development of the child's arch. Foot & Ankle. 1989, 9: 241-245.
Harris EJ, Vanore JV, Thomas JL, Kravitz SR, Mendicino RW, Silvani SH, Gassen SC: Diagnosis and treatment of pediatric flatfoot. Journal of Foot & Ankle Surgery. 2004, 43: 341-373.
Aharonson Z, Arcan M, Steinback TV: Foot-ground pressure pattern of flexible flatfoot in children, with and without correction of calcaneovalgus. Clinical Orthopaedics & Related Research. 1992, 177-182.
Rose GK, Welton EA, Marshall T: The diagnosis of flat foot in the child. Journal of Bone & Joint Surgery – British Volume. 1985, 67: 71-78.
Wenger DR, Leach J: Foot deformities in infants and children. Pediatric Clinics of North America. 1986, 33: 1411-1427.
The authors declare that they have no competing interests.
AE conceived and lead the study, participated in data collection, performed the statistical analysis and drafted the manuscript. HN and NZ participated in data collection. All authors participated in protocol development and read and approved the manuscript.
About this article
Cite this article
Evans, A.M., Nicholson, H. & Zakarias, N. The paediatric flat foot proforma (p-FFP): improved and abridged following a reproducibility study. J Foot Ankle Res 2, 25 (2009). https://doi.org/10.1186/1757-1146-2-25