Skip to main content
Download PDF

Validation and reliability testing of a new, fully integrated gait analysis insole

Journal of Foot and Ankle Research volume 8, Article number: 54 (2015) Cite this article

Abstract

Background

A new tool (OpenGo, Moticon GmbH) was introduced to continuously measure kinetic and temporospatial gait parameters independently through an insole over up to 4 weeks. The goal of this study was to investigate the validity and reliability of this new insole system in a group of healthy individuals.

Methods

Gait data were collected from 12 healthy individuals on a treadmill at two different speeds. In total, six trials of three minutes each were performed by every participant. Validation was performed with the FDM-S System (Zebris). Complete sensor data were used for a within test reliability analysis of over 10000 steps. Intraclass correlation was calculated for different gait parameters and analysis of variance performed.

Results

Intraclass correlation for the validation was >0.796 for temporospatial and kinetic gait parameters. No statistical difference was seen between the insole and force plate measurements (difference between means: 36.3 ± 27.19 N; p = 0.19 and 0.027 ± 0.028 s; p = 0.36). Intraclass correlation for the reliability was >0.994 for all parameters measured.

Conclusion

The system is feasible for clinical trials that require step by step as well as grouped analysis of gait over a long period of time. Comparable validity and reliability to a stationary analysis tool has been shown.

Peer Review reports

Background

Gait analysis is a quick and powerful tool with a wide range of clinical applications in various fields [1, 2]. However, due to the expensive and highly specialized equipment required, gait studies are mostly limited to academic research centers and small sample sizes [3] and no large-scale, randomized controlled trials have been performed [4]. Several authors have proposed inexpensive accelerometer-based systems to remedy this situation [5, 6]. Through mathematic transformation they adequately measure step time and length [7]. With these systems however only temporospatial gait parameters can be recorded; kinetic gait parameters, such as ground reaction force, cannot be measured [5]. As these kinetic parameters are important for clinical studies, especially in fracture [8] and rehabilitation research [9] different methods are needed.

Apart from the fact that its availability is mainly limited to research centers, conventional gait analysis is further hindered by its stationarity and that it only allows momentary views of the patient’s gait in a confined research environment. Even smaller, wearable systems have to be attached to an external apparatus, or are limited by their battery capacity, data storage and other device specific factors [3, 10, 11]. Furthermore, the use of these systems is at an early clinical stage and their full potential not yet developed [12]. As most disease processes are continuous, tools with long-term, continuous measuring capabilities are needed. For this reason a new pressure-measuring insole with built in battery and data storage was developed in cooperation with the AO Foundation (AO Foundation, Davos, Switzerland). The system offers complete independence from any external measures for up to 4 weeks and monitors a patients every step during this time. It is currently in preliminary research and clinical use in rehabilitation, neurology and orthopedic trauma.

In order to establish this new continuous gait analysis system as a research tool thorough testing of the new device’s validity and reliability is necessary before clinical trials are feasible. The purpose of the current study is to show the validity and reliability of a new and promising continuous gait analysis tool—the OpenGo Sensor Insole (Moticon GmbH).

Methods

Participants

Twelve healthy individuals between the age of 18 and 37 took part in the study. None of the participants had any history of physical or neurological conditions which might interfere with their respective gait. All participants gave written informed consent. Ethical approval was granted by the local ethics committee.

Insole

The insole weighs no more than 80 grams and looks and feels like a regular insole worn by runners for extra cushioning (Fig. 1). It incorporates 13 capacitive pressure sensors, a 3D accelerometer, as well as a temperature sensor. It measures peak pressures, pressure distribution, acceleration, motion sequences, gait patterns and temperature.

Fig. 1
figure 1

Standard right OpenGo insole. Artificial leather cover. 13 capacitive pressure sensors, accelerometer and thermometer. The round opening for a regular 3,7 V Li-ion battery can be seen from the view from below

Full size image

The insole operates completely wireless and only needs to be activated once by a study nurse. It runs for approximately up to 4 weeks on a single battery charge and data are stored on an incorporated flash storage.

The patient is free to remove the sole from his or her shoe and place them in any other shoe at any time. The top layer of the sole is washable and desinfectable.

Experimental protocol

Every participant performed 3 walks on a standard treadmill at 2 different speeds: 1,0 m/s and 1,7 m/s. Each walk lasted 3 min. Gait was continuously sampled by the Moticon insole at 50 Hz. Gait data were automatically segmented and analyzed by the proprietary Beaker software (version 01.01.14).

Validation of the insole system was performed with the FDM-S pressure plate (Zebris Medical GmbH) [13, 14]. It incorporates 2560 sensors on an area of 54 by 34 cm, giving a resolution of approximately 8.7 sensors per square inch. Reported accuracy is within 5 %.

Each participant performed 30 steps with the dominant leg on the pressure plate at a preferred normal gait speed with 10 m gait in advance. The insole values were measured simultaneously under shod conditions and matched to the corresponding force plate steps. Gait data were sampled at 50 Hz. Segmentation and analysis was performed with the commercially available WinFM software (Zebris Medical GmbH). Resulting forces and contact times between simultaneous steps on the pressure insole and force plate were compared.

Statistical analysis

Mean and standard deviation were calculated independently for every gait parameter measured at each speed and for every trial. Gait data were screened for normality with the Shapiro-Wilk-Test. ANOVA with a Bonferroni posttest and t-Test were performed to compare the gait parameters of the three treadmill trials, as well as left and right foot values. Intraclass correlation coefficients were calculated for the validation and reliability of the trials. P < 0.05 was defined as statistically significant.

Results

Figure 2 shows the participants characteristics and average gait parameters measured via the insole for every trial and gait speed. There were no statistically significant differences between the trials for any gait parameter within each gait speed group (1.0 m/s: p = 0.99; 1.7 m/s: p > 0.99). No statistically significant difference between the left and right foot was seen (1.0 m/s: p = 0.46; 1.7 m/s: p = 0.92). In a comparison of the two speeds there were statistically significant differences in gait cycle time (difference between means: 0.28 ± 0.04 s; p < 0.001), cadence (difference between means: 14.29 ± 2.34 r/min; p < 0.001), double stance time (difference between means: 0.18 ± 0.03 s; p < 0.001), left and right swing (difference between means: left: 0.05 ± 0.01 s; p < 0.01; right: 0.05 ± 0.02 s; p = 0.02) and stance time (difference between means: left: 0.16 ± 0.31 s; p < 0.001; right: 0.16 ± 0.3 s; p < 0.001).

Fig. 2
figure 2

a Descriptive statistics of the participants. Average gait parameters as measured by the OpenGO insole at 1.0 m/s (b) and 1.7 m/s (c) are shown. * < 0.05

Full size image

Validity

The intraclass correlation was calculated between the average measures of thirty steps on the Zebris pressure plate, as well as thirty corresponding steps with the OpenGo insole worn simultaneously. Intraclass correlation (ICC 3.1/k) for the stance time in seconds was 0.837 and for the resultant force measurements 0.796 for single measures and 0.911/0.886 for average measures (Fig. 3 a, b). The corresponding Bland-Altman plots show over 95 % of the values between the limits of agreement (a = 0.05) and similar error margins for both tests. No statistically significant difference was seen between both systems for resultant force (difference between means: 36.3 ± 27.19 N; p = 0.19), or for stance time (difference between means: 0.027 ± 0.028 s; p = 0.36) (Fig. 3 c). The data were calculated from 360 steps on the force plate with the insole worn simultaneously under shod conditions.

Fig. 3
figure 3

Validation results for peak force (a) and stance time (b) measurements. The intraclass correlation coefficients for single, as well as average measures are shown. The corresponding Bland-Altman plot is shown beneath each table. Bar graphs with standard deviation for resultant force (c) and step time (d) are shown. No significant differences between both systems for resultant force (difference between means: 36.3 ± 27.19 N; p = 0.19), as well as stance time (difference between means: 0.027 ± 0.028 s; p = 0.36) were seen. Data from 360 steps over the force plate are shown

Full size image

Reliability

Intraclass correlation (ICC 3,1/k) between each item in every retest was 0.983 for single measures and 0.994 for average measures (Fig. 4 c). Results from the two different gait speeds are shown in Figs. 4a and b, respectively. In all, 356 different measurements comprising over 10000 single steps under shod conditions were used for the calculations.

Fig. 4
figure 4

Retest reliability calculations for trials at 1.0 m/s (a), 1.7 m/s (b) and both combined (c). In all 356 Measurements comprising of over 10000 steps were compared

Full size image

Discussion

Modern gait analysis offers excellent opportunities for identifying pathological gait in many clinical fields: the measurement of subtle gait changes in Parkinson patients, the tracking of recovery in knee arthroplasty patients, the monitoring of various lower extremity fractures and many more [1, 2, 8, 12, 15, 16]. These studies highlight the great potential of gait analysis, whilst revealing its momentary weaknesses. Many different gait analysis systems exist, but their use is restricted mainly to academic research centers [5], considerably limiting their potential efficacy [4]. Furthermore, since only momentary measurements are performed, pathologies are mostly detected at a later point in time when preventive measures are limited and clinical interventions often needed [3, 11, 17, 18].

Especially in trauma care, where fracture healing is influenced by the biomechanical environment as soon as treatment is initiated, early, continuous application of these gait analysis tools is the key to influencing the healing process [19–21]. This was one of the underlying reasons for the development of the insole now under examination. It measures and stores every gait event over 4 weeks completely independent of any other external measures. Analysis is fully automatic: either as a step-by-step analysis or as a grouped analysis showing the daily and weakly activity level. The insole also generates raw data that are available for further segmentation and analysis. Unlike other wearable sensor systems, this insole has the advantage of being fully integrated into the sole and does not require any external measurements during the 4 week period [22].

In order to accommodate all the systems in the insole and to enable the independent running time of up to four weeks, fewer sensors are used than in other available in-shoe systems [23–25]. However, despite the reduced sensor capability, the validation values presented in this study show a good correlation between the insole and the force plate system for temporospatial (ICC > 0.837 stance time) and kinetic parameters (ICC >0.796 peak force). Furthermore, there was no statistical difference between the insole and the force plate with regard to the resulting force and stance time. The Bland-Altman plots confirm the validation results, showing equal error margins between the limits of agreement. All of these are well within the level of ICC values for established gait analysis systems [26–28].

The retest reliability values show excellent concordance (ICCs > 0.983) between the three trials, not only confirming the insole’s reliability but also the reliability of the automated analysis process. The automated analysis process is a key factor of the proposed system, since its ease of use aims at increasing applicability, especially in smaller clinics without academic research centers. The reliability values for this system are in accordance with other reported, wearable systems [5]. Furthermore the established gait characteristics and significant differences between the chosen gait speeds are within the known ranges for other validated and established systems [29]. The standard deviations and variances are also within these limits, further confirming the insole’s validity. Step by step reliability analysis and dominant foot validation were performed in this study to account for any potential left to right variability [30].

Limitations

This study has several limitations, one being the overall low number of participants. This problem was addressed by performing the study as a step-by-step analysis, amounting to over 10000 measured steps. Furthermore, reliability testing was conducted under standardized treadmill conditions, limiting its transferability to overground conditions. Validation measurements were performed simultaneously under shod conditions, creating a foot-sole interface and a shoe-force plate interface. For this reason only resultant forces were compared. No damping effect of the shoe’s insole was observed. Measurements under unshod conditions are not possible with the insole system. Further studies on the influences of different footwear on the insole measurements and long-term reliability testing under overground conditions are necessary.

Conclusion

This study shows the within test reliability and validity of a new, fully integrated gait analysis tool. The system can be used in broad clinical trials that require step by step as well as grouped analysis of gait over a long period of time with the validity and reliability of a stationary analysis tool. Combined with the reliable automated analysis system, broad applicability outside of academic research centers is feasible.

References

  1. Atallah L, Jones GG, Ali R, Leong JJH, Lo B, Yang GZ. Observing recovery from knee-replacement surgery by using wearable sensors. Proceedings of the 2011 International Conference on Body Sensor Networks. 2011; Dallas, TX, USA: IEEE. 29–34, (23–25 May 2011).

    Book  Google Scholar 

  2. Salarian A, Russmann H, Vingerhoets FJ, Dehollain C, Blanc Y, Burkhard PR, et al. Gait assessment in Parkinson’s disease: toward an ambulatory system for long-term monitoring. IEEE Trans Biomed Eng. 2004;51(8):1434–43. doi:10.1109/TBME.2004.827933.

    Article  PubMed  Google Scholar 

  3. Simon SR. Quantification of human motion: gait analysis—benefits and limitations to its application to clinical problems. J Biomech. 2004;37(12):1869–80.

    Article  PubMed  Google Scholar 

  4. Wren TA, Gorton 3rd GE, Ounpuu S, Tucker CA. Efficacy of clinical gait analysis: A systematic review. Gait Posture. 2011;34(2):149–53. doi:10.1016/j.gaitpost.2011.03.027.

    Article  PubMed  Google Scholar 

  5. Godfrey A, Del Din S, Barry G, Mathers JC, Rochester L. Within trial validation and reliability of a single tri-axial accelerometer for gait assessment. Conf Proc IEEE Eng Med Biol Soc. 2014;2014(1557-170X (Print)):5892–5. doi:10.1109/EMBC.2014.6944969.

    PubMed  Google Scholar 

  6. Lara J, Godfrey A, Evans E, Heaven B, Brown LJE, Barron E, et al. Towards measurement of the Healthy Ageing Phenotype in lifestyle-based intervention studies. Maturitas. 2013;76(2):189–99.

    Article  PubMed  Google Scholar 

  7. McCamley J, Donati M, Grimpampi E, Mazza C. An enhanced estimate of initial contact and final contact instants of time using lower trunk inertial sensor data. Gait and Posture. 2012;36(2):316–8.

    Article  PubMed  Google Scholar 

  8. Jansen H, Fenwick A, Doht S, Frey S, Meffert R. Clinical outcome and changes in gait pattern after pilon fractures. Int Orthop. 2013;37(1):51–8. doi:10.1007/s00264-012-1716-1.

    Article  PubMed  Google Scholar 

  9. Hurkmans HL, Bussmann JB, Benda E, Verhaar JA, Stam HJ. Effectiveness of audio feedback for partial weight-bearing in and outside the hospital: a randomized controlled trial. Arch Phys Med Rehabil. 2012;93(4):565–70. doi:10.1016/j.apmr.2011.11.019.

    Article  PubMed  Google Scholar 

  10. Bamberg SJ, Benbasat AY, Scarborough DM, Krebs DE, Paradiso JA. Gait analysis using a shoe-integrated wireless sensor system. IEEE Trans Inf Technol Biomed. 2008;12(4):413–23. doi:10.1109/TITB.2007.899493.

    Article  PubMed  Google Scholar 

  11. Coutts, Fiona. "Gait analysis in the therapeutic environment." Manual therapy 4.1. 1999; 2–10.

  12. Tao W, Liu T, Zheng R, Feng H. Gait analysis using wearable sensors. Sensors. 2012;12(2):2255–83. doi:10.3390/s120202255.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Błażkiewicz M, Wiszomirska I, Wit A. Comparison of four methods of calculating the symmetry of spatial-temporal parameters of gait. Acta Bioeng Biomech. 2014;16(1):29–35.

    PubMed  Google Scholar 

  14. Fan YF, Loan M, Fan YB, Li ZY, Luo DL. Least-action principle in gait. EPL (Europhysics Letters). 2009;87(5):58003.

    Article  Google Scholar 

  15. Gigi R, Mor A, Haim A, Luger E, Melamed E, Beer Y, et al. Deviations in gait metrics in patients with chronic ankle instability. Osteoarthritis Cartilage. 2014;22:S123.

    Article  Google Scholar 

  16. Segal G, Elbaz A, Parsi A, Heller Z, Palmanovich E, Nyska M, et al. Clinical outcomes following ankle fracture: a cross-sectional observational study. J Foot and Ankle Res. 2014;7(1):50.

    Article  Google Scholar 

  17. Hailey D, Tomie J. An assessment of gait analysis in the rehabilitation of children with walking difficulties. Disabil Rehabil. 2000;22(6):275–80. doi:10.1080/096382800296737.

    Article  CAS  PubMed  Google Scholar 

  18. Macri F, Marques LF, Backer RC, Santos MJ, Belangero WD. Validation of a standardised gait score to predict the healing of tibial fractures. J Bone Joint Surg. 2012;94(4):544–8. doi:10.1302/0301-620X.94B4.27927.

    Article  CAS  Google Scholar 

  19. Braun BJ, Rollmann M, Veith N, Pohlemann T. Fracture healing redefined. Medical Hypotheses. 2015

  20. Goodship AE, Kenwright J. The influence of induced micromovement upon the healing of experimental tibial fractures. J Bone Joint Surg. 1985;67(4):650–5.

    CAS  Google Scholar 

  21. Marsell R, Einhorn TA. The biology of fracture healing. Injury. 2011;42(6):551–5. doi:10.1016/j.injury.2011.03.031.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Abdul Razak AH, Zayegh A, Begg RK, Wahab Y. Foot plantar pressure measurement system: a review. Sensors. 2012;12(7):9884–912.

    Article  PubMed  Google Scholar 

  23. Benocci M, Rocchi L, Farella E, Chiari L, Benini L, editors. A wireless system for gait and posture analysis based on pressure insoles and Inertial Measurement Units. Pervasive Computing Technologies for Healthcare, 2009. PervasiveHealth 2009. 3rd International Conference on; 2009: IEEE.

  24. Feng Y, Ge Y, Song Q, editors. A human identification method based on dynamic plantar pressure distribution. Information and Automation (ICIA), 2011 IEEE International Conference on; 2011; New York City, NY, USA: IEEE. 329–32.

  25. Morris Bamberg SJ, Benbasat AY, Moxley Scarborough D, Krebs DE, Paradiso JA. Gait Analysis Using a Shoe-Integrated Wireless Sensor System. IEEE Trans Inf Technol Biomed. 2008;12:413–23.

    Article  Google Scholar 

  26. Hartmann A, Murer K, de Bie RA, de Bruin ED. Reproducibility of spatio-temporal gait parameters under different conditions in older adults using a trunk tri-axial accelerometer system. Gait Posture. 2009;30(3):351–5. doi:10.1016/j.gaitpost.2009.06.008.

    Article  PubMed  Google Scholar 

  27. Menz HB, Latt MD, Tiedemann A, Mun San Kwan M, Lord SR. Reliability of the GAITRite walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait Posture. 2004;20(1):20–5. doi:10.1016/S0966-6362(03)00068-7.

    Article  PubMed  Google Scholar 

  28. Welk GJ, Schaben JA, Morrow Jr JR. Reliability of accelerometry-based activity monitors: a generalizability study. Med Sci Sports Exerc. 2004;36(9):1637–45.

    PubMed  Google Scholar 

  29. Lee SJ, Hidler J. Biomechanics of overground vs. treadmill walking in healthy individuals. J Appl Physiol. 2008;104(3):747–55. doi:10.1152/japplphysiol.01380.2006.

    Article  PubMed  Google Scholar 

  30. Menz HB. Two feet, or one person? Problems associated with statistical analysis of paired data in foot and ankle medicine. The Foot. 2004;14(1):2–5.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank Ann Soether for language editing and Sabine Drum for her assistance during the study. We thank the AO Foundation for providing the insole material for this study.

Author information

Authors and Affiliations

  1. Department of Trauma, Hand and Reconstructive Surgery, Saarland University, Building 57, Kirrbergerstr. 1, 66421, Homburg, Germany

    Benedikt Johannes Braun, Nils Thomas Veith, Rebecca Hell, Mika Rollmann, Jörg Holstein & Tim Pohlemann

  2. BG Trauma Center, Department of Trauma Surgery, Eberhard Karls University Tübingen, Tübingen, Germany

    Stefan Döbele

  3. Saarland University, Chair of Applied Mechanics, Saarbruecken, Germany

    Michael Roland

Authors
  1. Benedikt Johannes Braun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nils Thomas Veith
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rebecca Hell
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stefan Döbele
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michael Roland
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mika Rollmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jörg Holstein
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Tim Pohlemann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Benedikt Johannes Braun.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

BJB, NTV, SD, MR, MR, JH and TP co-conceived of the study. BJB and RH performed all clinical measurements. BJB, NTV and MR performed the statistical and clinical analysis and drafted the manuscript. RH, SD, MR, MR, JH and TP participated in the coordination of the study and helped draft the manuscript. All authors read and approved the final manuscript.

Level of evidence

III, healthy individuals, new method compared to standard

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Braun, B.J., Veith, N.T., Hell, R. et al. Validation and reliability testing of a new, fully integrated gait analysis insole. J Foot Ankle Res 8, 54 (2015). https://doi.org/10.1186/s13047-015-0111-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13047-015-0111-8

Keywords

Journal of Foot and Ankle Research

ISSN: 1757-1146