- Open Access
Intra-rater reliability of hallux flexor strength measures using the Nintendo Wii Balance Board
Journal of Foot and Ankle Research volume 8, Article number: 48 (2015)
The purpose of this study was to investigate the intra-rater reliability of a new method in combination with the Nintendo Wii Balance Board (NWBB) to measure the strength of hallux flexor muscle.
Thirty healthy individuals (age: 34.9 ± 12.9 years, height: 170.4 ± 10.5 cm, weight: 69.3 ± 15.3 kg, female = 15) participated. Repeated testing was completed within 7 days. Participants performed strength testing in sitting using a wooden platform in combination with the NWBB. This new method was set up to selectively recruit an intrinsic muscle of the foot, specifically the flexor hallucis brevis muscle. Statistical analysis was performed using intra-class coefficients and ordinary least product analysis. To estimate measurement error, standard error of measurement (SEM), minimal detectable change (MDC) and percentage error were calculated.
Results indicate excellent intra-rater reliability (ICC = 0.982, CI = 0.96-0.99) with an absence of systematic bias. SEM, MDC and percentage error value were 0.5, 1.4 and 12 % respectively.
This study demonstrates that a new method in combination with the NWBB application is reliable to measure hallux flexor strength and has potential to be used for future research and clinical application.
Hallux flexor muscle strength is a significant determinant of balance and functional ability in older adults  and an independent predictor of falls in this population . Whilst hallux flexor strength is mainly contributed by flexor hallucis longus and flexor hallucis brevis (FHB) muscles, attention is drawn towards FHB because it is one of the intrinsic foot muscles that is thought to be essential for the stability of the longitudinal foot arch . As such training hallux flexor strength has been shown to improve balance  and potentially reduce falls in the elderly. However, assessment of intrinsic muscles of the foot with respect to the prevention of falls is largely neglected in clinical and research settings . This is unfortunate as falls in older adults are prevalent  and present a substantial health problem for society .
One of the challenges encountered by researchers and clinicians is the difficulty in selectively measuring the strength of intrinsic foot muscles. Previous methods to measure the strength of the intrinsic foot muscles such as the paper grip test , plantar pressure sensors , and various dynamometry methods [10–13] are of questionable validity due to the difficulty in separating intrinsic and extrinsic foot muscle activity during testing . It has been suggested that these methods may promote flexion of the interphalangeal joint during strength tests, a movement that is thought to result from extrinsic foot muscle activity . In a review article, Soysa and colleagues (2012) have recommended the use of hand-held dynamometry (HHD) to measure toe flexor strength as it permits concurrent metatarsophalangeal (MTP) joint flexion and interphalangeal joint extension and thus minimises the contribution of the extrinsic muscles. However, previous study using the HHD did not report any efforts in stabilising the foot or toe to minimise the extrinsic foot muscles contribution , thereby questioning the validity of their methodology.
A potentially useful tool which could replicate a HHD assessment of hallux flexor muscle strength is the Nintendo Wii Balance Board (NWBB). The NWBB contains four individual strain-gauge type load cells and is a reliable measurement tool to assess balance  and other weightbearing parameters such as asymmetry [15, 16]. Using the NWBB to assess hallux flexor muscle strength is therefore particularly appealing, because if it is shown to be valid it could be used as a centrepiece tool for assessment of multiple components of balance and falls risk. The purpose of this study is to evaluate the use of the NWBB when combined with a purpose built platform for the measurement of hallux flexion strength. Specifically, we assessed the intra-rater reliability of hallux flexor strength measurements using this new method. We hypothesised that this method will provide reproducible measurements of hallux flexion strength as the NWBB/platform configuration minimises extraneous foot movement, thereby improving selectivity of the intrinsic foot muscles .
Thirty healthy individuals (age: 34.9 ± 12.9 years, height: 170.4 ± 10.5 cm, weight: 69.3 ± 15.3 kg, female = 15) were recruited by convenience sampling. Participants were excluded if they reported any foot deformities or ankle problems. All participants gave informed consent as outlined by the institution’s Human Research Committee and all procedures were conducted according to the Declaration of Helsinki.
For the purpose of this study a NWBB was turned upside down and one of its four load cells was utilised for all measurement procedures (Fig. 1). The NWBB was interfaced via Bluetooth with a customized software program on a Windows computer, and the force data (in kg) was derived using the internally stored calibration information unique to each NWBB. To improve the accuracy of these data, the value derived from the load cell used in the measurement of force was re-calibrated in the testing position. This consisted of applying a range of known loads (0.1–20 kg) to the load cell. A regression equation evaluating the relationship between expected force and that obtained from the NWBB load cell exceeded R2 = 0.999 demonstrating the accuracy of the equipment consistent with a previous study .
To ensure accurate positioning of the hallux onto the load cell, and to minimise the influence of the extrinsic muscles of the foot (ankle plantarflexors and flexor hallucis longus) and the 2nd to 4th toes, a purpose-built wooden platform was constructed and positioned under the NWBB. As shown in Fig. 2 this permitted the tested foot to be positioned such that the proximal metatarsophalangeal joint of the big toe was at the edge of the platform, and a Velcro strap was used to secure the anterior section of the foot onto the platform. To prevent the heel from lifting adhesive Velcro tape was applied under the participant’s heel and fixed onto Velcro fastened to the platform and the participants thigh was additionally strapped to the platform with a non-elastic belt (Fig. 1). Excessive adduction moments from the big toe were minimized by a toe separator made of smooth plastic that was positioned between the first and second toes and fastened to the platform (Fig. 2). Finally, a circular wooden block of 2.8 cm in diameter was placed over the NWBB load cell to ensure the application point of the load cell was level with the platform and therefore the hallux positioned in its anatomic neutral position for testing.
To assess intra-rater reliability all participants attended two measurement sessions spaced 1–7 days apart. All procedures on both days were identical and supervised by the same physiotherapist (JQ) who has postgraduate qualifications and 13 years of clinical experience in the musculoskeletal field. Participants were seated on a firm chair positioned on the wooden platform (See Fig. 1). The sitting position was standardised using high density foam mats if required, (0 to 4 mats, 1.2 cm in depth each) and positioned on the chair to ensure 90° of hip and knee flexion . The dominant foot was then positioned accurately on the platform and the other foot also rested on the platform.
Participants were given one warm-up trial where they were instructed to apply 50 % of their perceived maximal effort. Participants then performed a minimum of three trials at maximal effort with a 1-min rest period between trials to minimize muscle fatigue. Participants were blinded to the results throughout the testing procedure. Standardised instructions were given throughout testing to; (i) keep the heel planted on the platform, (ii) avoid leaning backwards or forwards at the trunk (iii) avoid flexion at the interphalangeal joint of the big toe and (iv) apply a vertical downward force at the interphalangeal joint of the big toe. To minimize movement from the foot, a Velcro strap was firmly secured across the foot and fixed onto the platform between the first metatarsophalangeal joint to the middle of the arch (see Fig. 2).
To prevent the heel from lifting, besides giving standard instructions, the heel was fixed using a strap placed over the knee. This was also assisted by the fact that the Velcro under the heel would make a sound if the participant raised the heel (indicating use of the calf muscles) during testing. The examiner was alerted to this incorrect manoeuvre by the sound of the Velcro that held the heel to the platform separating. In the event of this occurring the trial would be discarded and repeated. Testing was ceased when three consistent measures were obtained (no greater than 20 % difference in measures) or a maximum of 6 trials had been performed. The average of three consistent measures was calculated. Strength was measured in kilograms.
We determined the sample size of 30 participants using the method proposed by Walter et al. . This was calculated based on a minimum acceptable reliability of 0.70 and an expected ICC value of 0.90 in a test-retest (k = 2) design, with a level (1-tailed) of 0.05 and power of 95 %.
Visual inspection for bias and heteroscedasticity was performed by examining a generated Bland-Altman plot for the difference between the scores obtained on both days against their means. Intra-rater reliability was calculated using intra-class coefficients (ICC [3,3]) and Ordinary Least Product (OLP) regression analysis. To calculate ICC, two-way analysis of variance based on absolute agreement was performed. ICC values of >0.75 were considered excellent, 0.40 to 0.75 modest or <0.40 poor . Next, systematic biases (proportional and fixed biases) were determined using OLP regression analysis . To estimate measurement error, standard error of measurement (SEM), 95 % limits of agreement (LoA), and minimal detectable change (MDC) calculations were performed.
The results are presented in Table 1. This new method of hallux flexor strength measurement demonstrated excellent intra-rater reliability (ICC = 0.982, 95 % CI = 0.96 to 0.99) with percentage error of 12 % and no presence of systematic bias and no evidence of heteroscedasticity. The LOA plot is presented in Fig. 3.
In this study a new method of measuring hallux flexion strength with an emphasis to selectively measure flexor hallucis brevis (an intrinsic foot muscle) strength using the NWBB was described and intra-rater reliability of this method was investigated. The findings suggest this new method reliably measures hallux flexion strength (ICC = 0.982). Moreover the method is inexpensive and straight-forward to set up and therefore has application for research and clinical settings. Furthermore, the NWBB has other useful applications such as for balance assessment  and rehabilitation , and therefore has diverse clinical and research utility.
To address issues of previous studies  the method described in this study attempted to minimise compensatory strategies from the trunk and ankle, as well as extrinsic muscles of the foot, from confounding accurate measurement of the intrinsic foot muscle strength. Specifically we attempted to minimise extrinsic foot muscle activity by localising toe flexion at the MTP joint and extension at the interphalangeal joint . This resulted in force being applied to the load cell under the interphalangeal joint. Strength trials were subsequently ceased and discarded if toe curling was observed. Performing the test in this manner is proposed to optimise selective activity of the FHB, an intrinsic foot muscle, with minimal contribution from the extrinsic foot muscles , although future electromyographic studies are required to validate this proposition.
From a clinical perspective this new method permits an accurate and selective measure of flexor hallucis brevis muscle performance, and could have positive implications for clinical assessment and rehabilitation. This is particularly relevant in light of evidence suggesting that improved intrinsic foot muscle strength is associated with improved dynamic support of the medial longitudinal arch and balance . From a statistical perspective, it is useful to note that the percentage error of 12 % would suggest that any differences observed in flexor hallux strength following an intervention must exceed 12 % in order to indicate that a real change has occurred.
This study has some limitations. Firstly we did not assess the inter-rater reliability of the method which potentially limits the applicability between observers. Secondly, although all effort was taken to ensure that participants did not use compensatory strategies by using appropriate physical restraints and standardised instructions, it was not possible to know if the experimental set-up was able to separate the extrinsic and intrinsic foot muscle activity, which will need to be investigated in future studies. Similarly, while we attempted to minimise adduction of the big toe by using a smooth plastic separator between the first and second toes, it was not possible to separate the influence of toe adduction moments during measurements.
Given that the purpose of this study was to test the reliability of within-subject measures across 2 time-points, we did not need to include variables such as foot arch height and length, the size of interphalangeal joint prominence, the length of the first MTP shaft and the range of motion of MTP joint. However these are important when comparing between subjects, and should be considered in future studies.
Despite the growing evidence of the importance of maintaining hallux flexion strength for optimal gait and balance in older adults [1, 23], it remains poorly addressed in rehabilitation . The results of this study demonstrate that hallux flexion strength can be reliably assessed using a NWBB application. Given that hallux flexion strength may be an indicator of intrinsic foot muscle performance, this method utilising the NWBB is of great potential for future research and clinical application. Potentially this method may also have application for other foot conditions requiring accurate measurement of hallux flexion strength.
Flexor hallucis brevis
Nintendo Wii Balance Board
Standard error of measurement
Limits of agreement
Minimal detectable change
Spink MJ, Fotoohabadi MR, Wee E, Hill KD, Lord SR, Menz HB. Foot and ankle strength, range of motion, posture, and deformity are associated with balance and functional ability in older adults. Arch Phys Med Rehabil. 2011;92(1):68–75.
Mickle KJ, Munro BJ, Lord SR, Menz HB, Steele JR. ISB Clinical Biomechanics Award 2009: toe weakness and deformity increase the risk of falls in older people. Clin Biomech (Bristol, Avon). 2009;24(10):787–91.
Soysa A, Hiller C, Refshauge K, Burns J. Importance and challenges of measuring intrinsic foot muscle strength. J Foot Ankle Res. 2012;5(1):29.
Kobayashi R, Hosoda M, Minematsu A, Sasaki H, Maejima H, Tanaka S, et al. Effects of toe grasp training for the aged on spontaneous postural sway. J Phys Ther Sci. 1999;11:31–4.
McKeon PO, Hertel J, Bramble D, Davis I. The foot core system: a new paradigm for understanding intrinsic foot muscle function. Br J Sports Med. 2014;0:1–9.
Hausdorff JM, Rios DA, Edelberg HK. Gait variability and fall risk in community-living older adults: a 1-year prospective study. Arch Phys Med Rehabil. 2001;82(8):1050–6.
Lajoie Y, Gallagher S. Predicting falls within the elderly community: comparison of postural sway, reaction time, the Berg balance scale and the Activities-specific Balance Confidence (ABC) scale for comparing fallers and non-fallers. Arch Gerontol Geriatr. 2004;38(1):11–26.
Menz HB, Morris ME, Lord SR. Foot and ankle risk factors for falls in older people: a prospective study. J Gerontol A Biol Sci Med Sci. 2006;61(8):866–70.
Menz HB, Zammit GV, Munteanu SE, Scott G. Plantarflexion strength of the toes: age and gender differences and evaluation of a clinical screening test. Foot Ankle Int. 2006;27(12):1103–8.
Unger CL, Wooden MJ. Effect of foot intrinsic muscle strength training on jump performance. J Strength Cond Res. 2000;14(4):373–8.
Senda M, Takahara Y, Yagata Y, Yamamoto K, Nagashima H, Tukiyama H, et al. Measurement of the muscle power of the toes in female marathon runners using a toe dynamometer. Acta Med Okayama. 1999;53(4):189–91.
Kwon O, Tuttle L, Johnson J, Mueller M. Muscle imbalance and reduced ankle joint motion in people with hammer toe deformity. Clin Biomech. 2009;24(8):670–5.
Spink MJ, Fotoohabadi MR, Menz HB. Foot and ankle strength assessment using hand-held dynamometry: reliability and age-related differences. Gerontology. 2009;56(6):525–32.
Garth WP, Miller ST. Evaluation of claw toe deformity, weakness of the foot intrinsics, and posteromedial shin pain. Am J Sports Med. 1989;17(6):821–7.
Clark RA, Bryant AL, Pua Y, McCrory P, Bennell K, Hunt M. Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. Gait Posture. 2010;31(3):307–10.
Clark RA, McGough R, Paterson K. Reliability of an inexpensive and portable dynamic weight bearing asymmetry assessment system incorporating dual Nintendo Wii Balance Boards. Gait Posture. 2011;34(2):288–91.
Soma M, Murata S, Kai Y, Nakae H, Satou Y. An examination of limb position for measuring Toe-grip strength. J Phys Ther Sci. 2014;26(12):1955.
Walter S, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17(1):101–10.
Fleiss JL. The design and analysis of clinical experiments. New York: Wiley; 1986. p. 432. xiv.
Ludbrook J. Statistical techniques for comparing measurers and methods of measurement: a critical review. Clin Exp Pharmacol Physiol. 2002;29(7):527–36.
Gil-Gómez J-A, Lloréns R, Alcañiz M, Colomer C. Effectiveness of a Wii balance board-based system (eBaViR) for balance rehabilitation: a pilot randomized clinical trial in patients with acquired brain injury. J Neuroeng Rehabil. 2011;8(1):30.
Mulligan EP, Cook PG. Effect of plantar intrinsic muscle training on medial longitudinal arch morphology and dynamic function. Man Ther. 2013;18(5):425–30.
Misu S, Doi T, Asai T, Sawa R, Tsutsumimoto K, Nakakubo S, et al. Association between toe flexor strength and spatiotemporal gait parameters in community-dwelling older people. J Neuroeng Rehabil. 2014;11(1):143.
JQ received a PhD scholarship funded by Singapore General Hospital.
RAC is a recipient of an NHMRC Career Development Fellowship (R.D. Wright Biomedical, No. 1090415). We thank Dr Alan Huang from the School of Mathematics and Physics at the University of Queensland for his statistical advice.
The authors declare that they have no competing interests. RAC reserves the right to make software related to this article freely available in the future.
JQ was involved in the study design, coordination, data collection, statistical analysis and manuscript drafting. JT was involved in the study design, coordination, manuscript drafting and general supervision of the study. SB was involved in the study design, coordination, manuscript drafting and general supervision of the study. SOL was involved in the platform design and manuscript drafting. RC was involved in the study design, application creation, data collection, coordination, manuscript drafting and general supervision of the study. All authors read and approved the final manuscript.
About this article
Cite this article
Quek, J., Treleaven, J., Brauer, S.G. et al. Intra-rater reliability of hallux flexor strength measures using the Nintendo Wii Balance Board. J Foot Ankle Res 8, 48 (2015). https://doi.org/10.1186/s13047-015-0104-7
- Nintendo Wii Balance Board
- Hallux flexor strength
- Intrinsic foot muscles
- Intra-rater reliability