Validation and reliability testing of a new, fully integrated gait analysis insole
© Braun et al. 2015
Received: 4 April 2015
Accepted: 14 September 2015
Published: 22 September 2015
A new tool (OpenGo, Moticon GmbH) was introduced to continuously measure kinetic and temporospatial gait parameters independently through an insole over up to 4 weeks. The goal of this study was to investigate the validity and reliability of this new insole system in a group of healthy individuals.
Gait data were collected from 12 healthy individuals on a treadmill at two different speeds. In total, six trials of three minutes each were performed by every participant. Validation was performed with the FDM-S System (Zebris). Complete sensor data were used for a within test reliability analysis of over 10000 steps. Intraclass correlation was calculated for different gait parameters and analysis of variance performed.
Intraclass correlation for the validation was >0.796 for temporospatial and kinetic gait parameters. No statistical difference was seen between the insole and force plate measurements (difference between means: 36.3 ± 27.19 N; p = 0.19 and 0.027 ± 0.028 s; p = 0.36). Intraclass correlation for the reliability was >0.994 for all parameters measured.
The system is feasible for clinical trials that require step by step as well as grouped analysis of gait over a long period of time. Comparable validity and reliability to a stationary analysis tool has been shown.
KeywordsGait analysis Integrated insole system Validation Reliability
Gait analysis is a quick and powerful tool with a wide range of clinical applications in various fields [1, 2]. However, due to the expensive and highly specialized equipment required, gait studies are mostly limited to academic research centers and small sample sizes  and no large-scale, randomized controlled trials have been performed . Several authors have proposed inexpensive accelerometer-based systems to remedy this situation [5, 6]. Through mathematic transformation they adequately measure step time and length . With these systems however only temporospatial gait parameters can be recorded; kinetic gait parameters, such as ground reaction force, cannot be measured . As these kinetic parameters are important for clinical studies, especially in fracture  and rehabilitation research  different methods are needed.
Apart from the fact that its availability is mainly limited to research centers, conventional gait analysis is further hindered by its stationarity and that it only allows momentary views of the patient’s gait in a confined research environment. Even smaller, wearable systems have to be attached to an external apparatus, or are limited by their battery capacity, data storage and other device specific factors [3, 10, 11]. Furthermore, the use of these systems is at an early clinical stage and their full potential not yet developed . As most disease processes are continuous, tools with long-term, continuous measuring capabilities are needed. For this reason a new pressure-measuring insole with built in battery and data storage was developed in cooperation with the AO Foundation (AO Foundation, Davos, Switzerland). The system offers complete independence from any external measures for up to 4 weeks and monitors a patients every step during this time. It is currently in preliminary research and clinical use in rehabilitation, neurology and orthopedic trauma.
In order to establish this new continuous gait analysis system as a research tool thorough testing of the new device’s validity and reliability is necessary before clinical trials are feasible. The purpose of the current study is to show the validity and reliability of a new and promising continuous gait analysis tool—the OpenGo Sensor Insole (Moticon GmbH).
Twelve healthy individuals between the age of 18 and 37 took part in the study. None of the participants had any history of physical or neurological conditions which might interfere with their respective gait. All participants gave written informed consent. Ethical approval was granted by the local ethics committee.
The insole operates completely wireless and only needs to be activated once by a study nurse. It runs for approximately up to 4 weeks on a single battery charge and data are stored on an incorporated flash storage.
The patient is free to remove the sole from his or her shoe and place them in any other shoe at any time. The top layer of the sole is washable and desinfectable.
Every participant performed 3 walks on a standard treadmill at 2 different speeds: 1,0 m/s and 1,7 m/s. Each walk lasted 3 min. Gait was continuously sampled by the Moticon insole at 50 Hz. Gait data were automatically segmented and analyzed by the proprietary Beaker software (version 01.01.14).
Validation of the insole system was performed with the FDM-S pressure plate (Zebris Medical GmbH) [13, 14]. It incorporates 2560 sensors on an area of 54 by 34 cm, giving a resolution of approximately 8.7 sensors per square inch. Reported accuracy is within 5 %.
Each participant performed 30 steps with the dominant leg on the pressure plate at a preferred normal gait speed with 10 m gait in advance. The insole values were measured simultaneously under shod conditions and matched to the corresponding force plate steps. Gait data were sampled at 50 Hz. Segmentation and analysis was performed with the commercially available WinFM software (Zebris Medical GmbH). Resulting forces and contact times between simultaneous steps on the pressure insole and force plate were compared.
Mean and standard deviation were calculated independently for every gait parameter measured at each speed and for every trial. Gait data were screened for normality with the Shapiro-Wilk-Test. ANOVA with a Bonferroni posttest and t-Test were performed to compare the gait parameters of the three treadmill trials, as well as left and right foot values. Intraclass correlation coefficients were calculated for the validation and reliability of the trials. P < 0.05 was defined as statistically significant.
Modern gait analysis offers excellent opportunities for identifying pathological gait in many clinical fields: the measurement of subtle gait changes in Parkinson patients, the tracking of recovery in knee arthroplasty patients, the monitoring of various lower extremity fractures and many more [1, 2, 8, 12, 15, 16]. These studies highlight the great potential of gait analysis, whilst revealing its momentary weaknesses. Many different gait analysis systems exist, but their use is restricted mainly to academic research centers , considerably limiting their potential efficacy . Furthermore, since only momentary measurements are performed, pathologies are mostly detected at a later point in time when preventive measures are limited and clinical interventions often needed [3, 11, 17, 18].
Especially in trauma care, where fracture healing is influenced by the biomechanical environment as soon as treatment is initiated, early, continuous application of these gait analysis tools is the key to influencing the healing process [19–21]. This was one of the underlying reasons for the development of the insole now under examination. It measures and stores every gait event over 4 weeks completely independent of any other external measures. Analysis is fully automatic: either as a step-by-step analysis or as a grouped analysis showing the daily and weakly activity level. The insole also generates raw data that are available for further segmentation and analysis. Unlike other wearable sensor systems, this insole has the advantage of being fully integrated into the sole and does not require any external measurements during the 4 week period .
In order to accommodate all the systems in the insole and to enable the independent running time of up to four weeks, fewer sensors are used than in other available in-shoe systems [23–25]. However, despite the reduced sensor capability, the validation values presented in this study show a good correlation between the insole and the force plate system for temporospatial (ICC > 0.837 stance time) and kinetic parameters (ICC >0.796 peak force). Furthermore, there was no statistical difference between the insole and the force plate with regard to the resulting force and stance time. The Bland-Altman plots confirm the validation results, showing equal error margins between the limits of agreement. All of these are well within the level of ICC values for established gait analysis systems [26–28].
The retest reliability values show excellent concordance (ICCs > 0.983) between the three trials, not only confirming the insole’s reliability but also the reliability of the automated analysis process. The automated analysis process is a key factor of the proposed system, since its ease of use aims at increasing applicability, especially in smaller clinics without academic research centers. The reliability values for this system are in accordance with other reported, wearable systems . Furthermore the established gait characteristics and significant differences between the chosen gait speeds are within the known ranges for other validated and established systems . The standard deviations and variances are also within these limits, further confirming the insole’s validity. Step by step reliability analysis and dominant foot validation were performed in this study to account for any potential left to right variability .
This study has several limitations, one being the overall low number of participants. This problem was addressed by performing the study as a step-by-step analysis, amounting to over 10000 measured steps. Furthermore, reliability testing was conducted under standardized treadmill conditions, limiting its transferability to overground conditions. Validation measurements were performed simultaneously under shod conditions, creating a foot-sole interface and a shoe-force plate interface. For this reason only resultant forces were compared. No damping effect of the shoe’s insole was observed. Measurements under unshod conditions are not possible with the insole system. Further studies on the influences of different footwear on the insole measurements and long-term reliability testing under overground conditions are necessary.
This study shows the within test reliability and validity of a new, fully integrated gait analysis tool. The system can be used in broad clinical trials that require step by step as well as grouped analysis of gait over a long period of time with the validity and reliability of a stationary analysis tool. Combined with the reliable automated analysis system, broad applicability outside of academic research centers is feasible.
The authors thank Ann Soether for language editing and Sabine Drum for her assistance during the study. We thank the AO Foundation for providing the insole material for this study.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Atallah L, Jones GG, Ali R, Leong JJH, Lo B, Yang GZ. Observing recovery from knee-replacement surgery by using wearable sensors. Proceedings of the 2011 International Conference on Body Sensor Networks. 2011; Dallas, TX, USA: IEEE. 29–34, (23–25 May 2011).View ArticleGoogle Scholar
- Salarian A, Russmann H, Vingerhoets FJ, Dehollain C, Blanc Y, Burkhard PR, et al. Gait assessment in Parkinson’s disease: toward an ambulatory system for long-term monitoring. IEEE Trans Biomed Eng. 2004;51(8):1434–43. doi:https://doi.org/10.1109/TBME.2004.827933.View ArticlePubMedGoogle Scholar
- Simon SR. Quantification of human motion: gait analysis—benefits and limitations to its application to clinical problems. J Biomech. 2004;37(12):1869–80.View ArticlePubMedGoogle Scholar
- Wren TA, Gorton 3rd GE, Ounpuu S, Tucker CA. Efficacy of clinical gait analysis: A systematic review. Gait Posture. 2011;34(2):149–53. doi:https://doi.org/10.1016/j.gaitpost.2011.03.027.View ArticlePubMedGoogle Scholar
- Godfrey A, Del Din S, Barry G, Mathers JC, Rochester L. Within trial validation and reliability of a single tri-axial accelerometer for gait assessment. Conf Proc IEEE Eng Med Biol Soc. 2014;2014(1557-170X (Print)):5892–5. doi:https://doi.org/10.1109/EMBC.2014.6944969.PubMedGoogle Scholar
- Lara J, Godfrey A, Evans E, Heaven B, Brown LJE, Barron E, et al. Towards measurement of the Healthy Ageing Phenotype in lifestyle-based intervention studies. Maturitas. 2013;76(2):189–99.View ArticlePubMedGoogle Scholar
- McCamley J, Donati M, Grimpampi E, Mazza C. An enhanced estimate of initial contact and final contact instants of time using lower trunk inertial sensor data. Gait and Posture. 2012;36(2):316–8.View ArticlePubMedGoogle Scholar
- Jansen H, Fenwick A, Doht S, Frey S, Meffert R. Clinical outcome and changes in gait pattern after pilon fractures. Int Orthop. 2013;37(1):51–8. doi:https://doi.org/10.1007/s00264-012-1716-1.View ArticlePubMedGoogle Scholar
- Hurkmans HL, Bussmann JB, Benda E, Verhaar JA, Stam HJ. Effectiveness of audio feedback for partial weight-bearing in and outside the hospital: a randomized controlled trial. Arch Phys Med Rehabil. 2012;93(4):565–70. doi:https://doi.org/10.1016/j.apmr.2011.11.019.View ArticlePubMedGoogle Scholar
- Bamberg SJ, Benbasat AY, Scarborough DM, Krebs DE, Paradiso JA. Gait analysis using a shoe-integrated wireless sensor system. IEEE Trans Inf Technol Biomed. 2008;12(4):413–23. doi:https://doi.org/10.1109/TITB.2007.899493.View ArticlePubMedGoogle Scholar
- Coutts, Fiona. "Gait analysis in the therapeutic environment." Manual therapy 4.1. 1999; 2–10.Google Scholar
- Tao W, Liu T, Zheng R, Feng H. Gait analysis using wearable sensors. Sensors. 2012;12(2):2255–83. doi:https://doi.org/10.3390/s120202255.View ArticlePubMedPubMed CentralGoogle Scholar
- Błażkiewicz M, Wiszomirska I, Wit A. Comparison of four methods of calculating the symmetry of spatial-temporal parameters of gait. Acta Bioeng Biomech. 2014;16(1):29–35.PubMedGoogle Scholar
- Fan YF, Loan M, Fan YB, Li ZY, Luo DL. Least-action principle in gait. EPL (Europhysics Letters). 2009;87(5):58003.View ArticleGoogle Scholar
- Gigi R, Mor A, Haim A, Luger E, Melamed E, Beer Y, et al. Deviations in gait metrics in patients with chronic ankle instability. Osteoarthritis Cartilage. 2014;22:S123.View ArticleGoogle Scholar
- Segal G, Elbaz A, Parsi A, Heller Z, Palmanovich E, Nyska M, et al. Clinical outcomes following ankle fracture: a cross-sectional observational study. J Foot and Ankle Res. 2014;7(1):50.View ArticleGoogle Scholar
- Hailey D, Tomie J. An assessment of gait analysis in the rehabilitation of children with walking difficulties. Disabil Rehabil. 2000;22(6):275–80. doi:https://doi.org/10.1080/096382800296737.View ArticlePubMedGoogle Scholar
- Macri F, Marques LF, Backer RC, Santos MJ, Belangero WD. Validation of a standardised gait score to predict the healing of tibial fractures. J Bone Joint Surg. 2012;94(4):544–8. doi:https://doi.org/10.1302/0301-620X.94B4.27927.View ArticleGoogle Scholar
- Braun BJ, Rollmann M, Veith N, Pohlemann T. Fracture healing redefined. Medical Hypotheses. 2015Google Scholar
- Goodship AE, Kenwright J. The influence of induced micromovement upon the healing of experimental tibial fractures. J Bone Joint Surg. 1985;67(4):650–5.Google Scholar
- Marsell R, Einhorn TA. The biology of fracture healing. Injury. 2011;42(6):551–5. doi:https://doi.org/10.1016/j.injury.2011.03.031.View ArticlePubMedPubMed CentralGoogle Scholar
- Abdul Razak AH, Zayegh A, Begg RK, Wahab Y. Foot plantar pressure measurement system: a review. Sensors. 2012;12(7):9884–912.View ArticlePubMedGoogle Scholar
- Benocci M, Rocchi L, Farella E, Chiari L, Benini L, editors. A wireless system for gait and posture analysis based on pressure insoles and Inertial Measurement Units. Pervasive Computing Technologies for Healthcare, 2009. PervasiveHealth 2009. 3rd International Conference on; 2009: IEEE.Google Scholar
- Feng Y, Ge Y, Song Q, editors. A human identification method based on dynamic plantar pressure distribution. Information and Automation (ICIA), 2011 IEEE International Conference on; 2011; New York City, NY, USA: IEEE. 329–32.Google Scholar
- Morris Bamberg SJ, Benbasat AY, Moxley Scarborough D, Krebs DE, Paradiso JA. Gait Analysis Using a Shoe-Integrated Wireless Sensor System. IEEE Trans Inf Technol Biomed. 2008;12:413–23.View ArticleGoogle Scholar
- Hartmann A, Murer K, de Bie RA, de Bruin ED. Reproducibility of spatio-temporal gait parameters under different conditions in older adults using a trunk tri-axial accelerometer system. Gait Posture. 2009;30(3):351–5. doi:https://doi.org/10.1016/j.gaitpost.2009.06.008.View ArticlePubMedGoogle Scholar
- Menz HB, Latt MD, Tiedemann A, Mun San Kwan M, Lord SR. Reliability of the GAITRite walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait Posture. 2004;20(1):20–5. doi:https://doi.org/10.1016/S0966-6362(03)00068-7.View ArticlePubMedGoogle Scholar
- Welk GJ, Schaben JA, Morrow Jr JR. Reliability of accelerometry-based activity monitors: a generalizability study. Med Sci Sports Exerc. 2004;36(9):1637–45.PubMedGoogle Scholar
- Lee SJ, Hidler J. Biomechanics of overground vs. treadmill walking in healthy individuals. J Appl Physiol. 2008;104(3):747–55. doi:https://doi.org/10.1152/japplphysiol.01380.2006.View ArticlePubMedGoogle Scholar
- Menz HB. Two feet, or one person? Problems associated with statistical analysis of paired data in foot and ankle medicine. The Foot. 2004;14(1):2–5.View ArticleGoogle Scholar