- Research
- Open Access
- Open Peer Review
The reliability of a smartphone goniometer application compared with a traditional goniometer for measuring first metatarsophalangeal joint dorsiflexion
https://doi.org/10.1186/s13047-015-0088-3
© Otter et al. 2015
- Received: 6 November 2014
- Accepted: 8 July 2015
- Published: 23 July 2015
Abstract
Background
Adequate sagittal plane motion of the first metatarsalphalangeal joint (1st MTPJ) is important during normal gait and goniometric measurement is commonly used as a diagnostic and outcome assessment tool. We aimed to determine the intra and inter-rater reliability together with the concurrent validity of a universal plastic goniometer (UG) and a smartphone applicationlication (Dr G) for the measurement of dorsiflexion at the 1st MTPJ.
Methods
Measurement of joint position and passive range of motion of the 1st MTPJ dorsiflexion was compared using a UG and DrG goniometer. A double-blind repeated measures design was utilized, with intraclass correlation coefficient (ICC) used to determine levels of reliability.
Results
For joint position good intra-rater reliability (ICC >0.861) and good inter-rater reliability (ICC >0.823) was noted. However, the Dr G application consistently measured lower angles (mean 27.8° (SD 8.37)) than the UG (mean 32° (SD 11.7)) and these associations were significant (r = 0.399, p < 0.001). For passive range of motion, the mean total range of dorsiflexion motion (from maximum plantarflexed position to maximum dorsiflexed position) was 82.8° (SD 12.2) for the UG and 82.9° (SD 11.3) for the Dr G application. Both instruments demonstrated high levels of intra-rater reliability (ICC >0.809). Inter-rater reliability was moderate to good for the UG (ICC 0.693 (95 % CI 0.580 to 0.788)) and good for the Dr G application (ICC 0.708 (95 % CI 0.597 to 0.799)).
Conclusions
Moderate to high intra and inter-rater reliability of joint position and passive 1st MTPJ motion can be achieved with traditional and smartphone-based goniometric measurement. The Dr G application may provide a slightly higher reliability, but devices should not be used inter-changeably as significant variation in measurement between devices may occur.
Keywords
- Biomechanics Cell phone
- Reproducibility of results
- First metatarsophalangeal joint
Background
Satisfactory dorsiflexion at the first metatarsophalangeal joint (1st MTPJ) is essential to facilitate forward progression of the body during gait and to activate the windlass mechanism [1–3]. Measuring the angle of dorsiflexion available can also help identify the presence of pathology, such as hallux limitus or hallux rigidus [4]. Therefore, clinical assessment of the 1st MTPJ forms a fundamental part of a lower-limb biomechanical assessment [1, 5–7].
A variety of techniques can be used to assess 1st MTPJ range of motion including radiographic measurement, traditional goniometry, electromagnetic tracking and digitisation of video [8]. Reference values from radiographic studies for 1st MTPJ dorsiflexion of between 40° to 100° have been reported by Joseph [9] and 82° by Buell et al. [10]. However, these studies made no reference to the reliability of measurement. Although their study was very small (n = 6) Taranto et al. [8] report mean values of 1st MTPJ dorsiflexion up to 64° (SD 11) with high intra-rater reliability (r = 0.65 to 1.00) and high inter-rater reliability (r = 0.87). Several sources of error may affect the interpretation of radiographs including subject and beam position, selection of anatomical landmarks and construction of measurement lines [8, 11, 12]. Importantly, X-rays may not be routinely available to many clinicians in routine practice. Traditional hand-held goniometers remain the most commonly used tool in the clinical setting to assess joint position and range of motion [13–15]. These instruments are simple and quick to use and relatively inexpensive.
First MTPJ dorsiflexion angle is typically measured either with the clinician undertaking passive dorsiflexion of the hallux or the patient dorsiflexing their hallux actively while weight-bearing [16]. The dorsiflexion angle of the 1st MTPJ is typically established by using the medial midline of 1st metatarsal, proximal phalanx of hallux with 1st MTPJ as the fulcrum [6, 17]. A previous cadaveric study [18] reported a mean 1st MTPJ dorsiflexion of 76° which is in broad accordance with reference values for assisted dorsiflexion [10]. Previous work [19] indicated approximately 65° of dorsiflexion is required for normal gait. A value of less than 60° dorsiflexion suggests pathology of the 1st MTPJ using the grading system advocated by Coughlin and Shurnas [5]. However, lower values of 1st MTPJ dorsiflexion have been reported in-vivo. Hetherington and colleagues [20] recorded a mean value of 51° and Nawoczenski et al. [21] reported a value of 42°. The literature suggests the reliability of hand-held goniometric measurement can vary from moderate to good [16, 19, 22]. However, a range of factors can adversely affect the reliability of goniometric measurement, such as anatomical landmark identification, joint positioning and incorrect usage of the goniometer [21].
More recently smartphones have been developed with a sense acceleration and inclination in their software. This has enabled the development of clinical applications with goniometric properties, providing simple, faster measurement of joint position. The reliability of inclinometric measurements have been reported as similar, or superior to, that of traditional gonimetric measurements (for example, in the shoulder) [23–27]. This technology is increasingly being used within clinical practice, because it is quick, simple to read and may give the impression of superior accuracy [28–31]. Studies regarding the validity of digital measurements of joint deformity have reported similar or better results when compared to a traditional goniometer [32, 33]. However, in the foot the amount of current research into the reliability of smartphone applications is limited. The purpose of this study was to investigate the inter- rater and intra-rater-reliability together with the concurrent validity of a smartphone goniometric application compared with a traditional goniometer when measuring both joint position and passive motion of the 1st MTPJ.
Methods
The Smartphone application used in this study was the Dr Goniometer (Dr G) application, (CDM S.r.L, Cagliari, Italy) together with a traditional, hand-held universal goniometer (UG). A double-blind, two- stage, repeated measures design was used. In stage one our aim was to determine if measurement of 1st MTPJ position by the two devices was reliable. In stage two we aimed to compare the reliability of both devices for assessing passive movement of the first MTPJ. Additionally, during both stages concurrent validity was assessed. The University of Brighton research governance and ethics panel approved the study and the GRRAS guidelines for reporting reliability [34] were followed.
Participants
All participants were university students and were recruited through convenience sampling. Participants were included if they were in good general health and aged between 18 to 55 years. Exclusion criteria were: recent (past 6 months) lower limb injury, a structural disorder of the 1st MTPJ (e.g. hallux valgus), lower limb oedema, a history of degenerative or inflammatory joint disease, any neurological disorder, or recent foot surgery. Informed, written consent was gained from each participant. Participants only took part in one tier of this two-part study. A power calculation confirmed that a sample size of 25 subjects was required, which was broadly in line with previous work in this field [19].
Raters
A total of eight raters were used in total. All raters were final year podiatry students and therefore had comparable levels of clinical experience. Importantly, all raters had received the same training in the use of goniometers. Prior to data collection a group training session on measurement of the 1st MTPJ was undertaken. This session appraised the validated methods of joint measurement [19, 35]; outlined the method used in this study and reviewed the manufacturers’ instructions for use of the UG and Dr G application.
Measurement of 1st MTPJ position
Location of skin markers
Initially each rater measured the angle of dosiflexion using the UG. The angle display was in one- degree increments and was shielded, effectively blinding raters from the result. The central point of the UG was aligned over Point B and the end of the first arm was aligned with Point C (fixed arm). While holding the fixed arm securely in position, the second arm of the goniometer (moving arm) was aligned with Point A. Once satisfied with the positioning of the goniometer, it was handed to a single rater (WM) who read and noted the angle of dorsiflexion measured. Thus, raters were not aware of each other’s findings, removing the possibility of a Hawthorne effect.
Screenshot of smartphone app
Measurement of passive joint motion
To determine intra and inter rater reliability of passive joint range of motion, the same inclusion/exclusion criteria described above were employed and the same anatomical landmarks marked. As passive dorsiflexion of the 1st MTPJ was being assessed, subjects were seated on an examination couch, but foot positioning was ensured to be constant by one rater (RK). The full range of motion was measured as pilot work indicated it was not possible to consistently determine a standard start point (i.e. where the 1st MTPJ was neither dorsiflexed nor plantarflexed) to measure dorsiflexion alone. Therefore the 1st MTPJ was maximally plantarflexed prior to measurement. To ensure a standardised technique we adopted the approach advocated by Norkin and White [17] as detailed in Additional file 1. Three different raters (GH, NB, KW) measured passive 1st MTPJ range of motion twice during the same session using both the UG and Dr G. Again the scales for both devices were covered, effectively blinding raters from their own and each others measurements. As fewer raters were involved, measurements were taken in a random order, all measurements were noted and recorded by one person (RK). Prior to each measurement the UG was returned to its closed position and the smartphone display cleared by RK. Smartphone alignment and central position referencing was confirmed to be in the same position prior to each measurement by using the inbuilt smartphone inclinometer.
Data analysis
Continuous data were entered into SPSS (v22, SPSS Inc, Chicago, Illinois) and checked for accuracy and normal distribution. Two entries from the smartphone data set for joint position were outliers and noted to be above what was considered anatomically possible (i.e. above 150°). These two data sets were discarded, as the risk of operator error could not be fully ruled out. No outliers were noted in the data set for joint range of motion. Descriptive statistics (mean, SD) were calculated for both devices for both maximially dorsiflexed 1st MTPJ position and range of motion. Pearson correlation coefficients were used to identify any significant associations between the two instruments when measuring 1st MTPJ motion. Intraclass correlation coefficients (ICCs) together with 95 % confidence intervals and the standard error of measurement (SEM) are reported to be best practice by Elliazew et al. [36]. The model of ICC used was ICC(2,k), where each subject was measured by each rater; and raters were considered representative of a larger population of similar raters [37]. The ICC values were interpreted accordingly: >0.75 indicates excellent; 0.4 to 0.75 indicates moderate-to-good reliability; and < 0.4 indicates poor reliability [38].
Results
Measurement of joint position
Intra and inter-rater reliability for measuring joint position
Universal goniometer | Smartphone app | |
---|---|---|
1st MTPJ dorsiflexion Mean (SD) | Mean 32° (SD 8.37) | Mean 27.8° (SD 11.7) |
Rater 1 Intra-rater reliability | ICC 0.861 (95 % CI 0.702 to 0.937) SEM 2 | ICC 0.807 (95 % CI 0.603 to 0.912) SEM 1.5 |
Rater 2 Intra-rater reliability | ICC 0.709 (95 % CI 0.448 to 0.860) SEM 1.8 | ICC 0.853 (95 % CI 0.689 to 0.934) SEM 1.5 |
Rater 3 Intra-rater reliability | ICC 0.829 (95 % CI 0.652 to 0.921) SEM 1.5 | ICC 0.768 (95 % CI 0.537 to 0.893) SEM 2.0 |
Rater 4 Intra-rater reliability | ICC 0.857 (95 % CI 0.697 to 0.935) SEM 1.6 | ICC 0.929 (95 % CI 0.836 to 0.969) SEM 1.6 |
Rater 5 Intra-rater reliability | ICC 0.861 (95 % CI 0.707 to 0.937) SEM 1.4 | ICC 0.907 (95 % CI 0.796 to 0.959) SEM 1.3 |
Average inter-rater reliability | ICC 0.823 (95 % CI 0.642 to 0.918 | ICC 0.853 (95 % CI 0.692 to 0.933) |
Inter-rater reliability | ICC 0.785 (95 % CI 0.675 to 0.882) | ICC 0.832 (95 % CI 0.737 to 0.911) |
Measurement of passive joint motion
Intra and inter-rater reliability for measuring passive joint motion
1st MTPJ ROM | Universal Goniometer | Smartphone app |
---|---|---|
Mean (SD) | 82.8° (12.2) | 82.9° (11.3) |
Rater 1 Intra-rater reliability | ICC 0.869 (95 % CI 0.793 to 0.918) SEM 1.6 | ICC 0.869 (95 % CI 0.794 to 0.918) SEM 1.7 |
Rater 2 Intra-rater reliability | ICC 0.771 (95 % CI 0.650 to 0.854) SEM 1.6 | ICC 0.886 (95 % CI 0.819 to 0.929) SEM 1.4 |
Rater 3 Intra-rater reliability | ICC 0.809 (95 % CI 0.672 to 0.864) SEM 1.4 | ICC 0.870 (95 % CI 0.795 to 0.919) SEM 1.4 |
Average intra rater reliability | ICC 0.809 (95 % CI 0.705 to 0.879) | ICC 0.875 (95 % CI 0.803 to 0.922) |
Inter-rater reliability | ICC 0.693 (95 % CI 0.580 to 0.788) | ICC 0.708 (95 % CI 0.597 to 0.799) |
Discussion
To the best of our knowledge this study is the first to compare the reliability and concurrent validity of a smartphone goniometer application to a traditional goniometer when measuring dorsiflexion at the 1st MTPJ. Initially we aimed to determine if these devices were comparable when measuring joint position. When assessing static joint position reliability was good, concurring with the previous work on larger joints such as the shoulder [39], elbow [40] and knee [41, 42]; supporting the argument that the use of a robust protocol assists in reducing errors. Interestingly intra-rater reliability of the universal goniometer was slightly higher than that of the smartphone, but inter-rater reliability of the smartphone was higher than the goniometer. More importantly, the significant variation in results from these two instruments in relation joint position, suggests these devices should not be used inter-changeably. Similar findings were not replicated when assessing range of motion. However, the standard deviation and range of values were consistently greater for the UG, demonstrating increased variance in this set of results. All five testers had similar clinical experience and limited experience of using goniometers or smartphone-based applications in this context. The relatively low standard error of the mean across all raters (≤2°) suggests that this sample of measurement means is representative of the population of raters. That said, the Dr. G application does not require anatomical landmark identification, therefore clinicians may prefer to use this technology especially for those that are less experienced with measuring joint angles.
Inter-rater reliability is frequently lower than intra-rater reliability for clinical measurements often due to differences in technique [43, 44]. When measuring range of motion we found good intra-rater reliability for both devices and moderate to good inter reliability was recorded. The smartphone application demonstrated slightly greater reliability: however, the overlap of the 95 % confidence intervals associated with the two tool’s datasets prevents the assertion of any significant difference between the levels of reliability. We found reduced inter-rater reliability compared well with previous work [45], although the current study was in vivo, as opposed to using two-dimensional photographs. In a study of knee joint motion (a joint with predominantly flexion/extension motion) Jones et al. [44] found slightly greater improved reliability than in the current study. It may be that in larger joints the anatomy is easier to visualise and positioning of goniometers is more straightforward. Other potential causes of reduced reliability unique to using this type of technology include the recommended use of the inbuilt smartphone inclinometer whilst photographing the joint. Although the feature aims to align the lens with the joint axis of motion; alignment of the first metatarsal and phalanx on the ground and subsequent dorsiflexion of the joint is challenging and may cause the patient to engage muscles, which potentially restrict movement [46] and further work on reliability while not using the inclinometer is required.
This study is subject to some limitations. A major question is how much of the methods can be utilised in the clinical environment, as some elements may not be transferable due to factors of time and manpower. However, this work provides individual clinicians with a baseline protocol with known parameters of reliability and they may wish to develop and adapt this. It is important to note that 1st MTPJ anatomy is inherently variable. Additionally, we excluded structural deformity; and this may not fully reflect clinical practice. Owing to an experimental design being used to determine reliability between raters it was not possible to determine which device was most accurate. In terms of the transferability of this work, there may also be greater difficulty when assessing multi-planar joints. A single clinician may find it difficult to capture an image at the same time as testing range of motion [47]. It was beyond the scope of this study design to include participants with pathology or raters with varying levels of clinical experience. All raters in the current study had a similar level of clinical experience and it is unknown if more experienced clinicians would produce less variability. Although training and a pilot study was undertaken with both devices, it might be expected that there would be a period of learning by raters as they completed the task, regardless of level of experience. However, differences in the values between individual raters indicate that variations occurred throughout the experiment.
Pathology of the 1st MTPJ is often associated with a negative impact on individuals’ quality of life [48] and the reliability of goniometric measurements are fundamental if clinical decisions are based on these findings, particularly in the surgical context. Multidisciplinary teams increasingly deliver patient treatment and so measurement tools must have high levels of intra rater and inter rater reliability to have transferrable clinical significance. Elliazew and colleagues [36] have suggested that goniometric measurements only be considered valid if ICCs surpass 0.8 for inter-rater and 0.9 for intra rater reliability. Neither the inter-rater nor intra-rater reliability results in this study reached the standards of reliability proposed by Elliazew et al., for goniometric tools, although findings for the Dr G application were close to these levels. Further refinement of the protocols and additional training of assessors may yield greater levels of reliability.
Conclusion
Using a detailed, robust protocol demonstrates that both hand-held and smartphone-based goniometric measurement of within session 1st MTPJ position and passive motion can be achieved with a moderate to high degree of intra and inter-rater reliability. It can be argued that smartphone applications such as Dr G, may provide a slightly higher degree of reliability. Importantly however, devices should not be used inter-changeably as significant variation in measurement between devices may occur.
Declarations
Acknowledgements
We wish to thanks those who volunteered their time to help with this project and to Mr M Frecklington for helpful comments on drafts of the manuscript
Authors’ Affiliations
References
- Hetherington VJ, Carnett J, Patterson BA. Motion of the first metatarsophalangeal joint. J Foot Surg. 1989;28(1):13–9.PubMedGoogle Scholar
- Perry J, Davids JR. Gait analysis: normal and pathological function. J Pediatr Orthop B. 1992;12(6):815–20.View ArticleGoogle Scholar
- Root ML, Orien WP, Weed JH. Normal and abnormal function of the foot (Vol. 2). Los Angeles: Clinical Biomechanics Corporation; 1977.Google Scholar
- Yee G, Lau J. Current concepts review: hallux rigidus. Foot Ankle Intl. 2008;29(6):637–46.View ArticleGoogle Scholar
- Coughlin MJ, Shurnas PS. Hallux rigidus Grading and long-term results of operative treatment. J Bone Joint Surg Am. 2003;85(11):2072–88.PubMedGoogle Scholar
- Gastwirth BW. Clinical biomechanics of the lower extremities. 1996. St Louis, London: Mosby Inc.Google Scholar
- Valmassy RL. Clinical biomechanics of the lower extremities. 1996. St Louis, London: Mosby Inc.Google Scholar
- Taranto MJ, Taranto J, Bryant A, Singer KP. Radiographic investigation of angular and linear measurements including first metatarsophalangeal joint dorsiflexion and rearfoot to forefoot axis angle. J Foot Ankle Surg. 2005;44(3):190–9.PubMedView ArticleGoogle Scholar
- Joseph J. Range of movement of the great to in men. J Bone Joint Surg (Br). 1954;36:450–7.Google Scholar
- Buell T, Green DR, Risser J. Measurement of the first metatarsophalangeal joint range of motion. J Am Podiatr Med Assoc. 1988;78(4):391–98.Google Scholar
- Bryant A, Tinley P, Singer K. A comparison of radiographic measurements in normal, hallux valgus and hallux limitus feet. J Foot Ankle Surg. 2000;39(1):39–44.PubMedView ArticleGoogle Scholar
- Thomas JL, Kunkel MW, Loopez R, Sparks D. Radiographic values of the adult foot in a standarised population. J Foot Ankle Surg. 2006;45(1):3–12.PubMedView ArticleGoogle Scholar
- Lea RD, Gerhardt JJ. Current concepts review: Range of motion measurements. J Bone Joint Surg (Br). 1995;77:784–79.Google Scholar
- Croxford P, Jones K, Barker K. Intertester comparison between visual estimation and goniometric measurement of ankle dorsiflexion. Physiother Theory Pract. 1998;2:107–13.View ArticleGoogle Scholar
- Bruton A, Ellis B, Goddard J. Comparison of visual estimation and goniometry for assessment of metacarpophalangeal joint angle. Physiotherapy. 1999;85(4):201–8.View ArticleGoogle Scholar
- Camasta CA. Hallux limitus and hallux rigidus. Clinical examination, radiographic findings, and natural history. Clin Podiatr Med Surg. 1996;13(3):423–48.PubMedGoogle Scholar
- Norkin CC, White DJ. Measurement of joint motion: a guide to goniometry. 2009. FA Davis.Google Scholar
- Shereff MJ, Bejjani FJ, Kummer FJ. Kinematics of the first metatarsophalangeal joint. J Bone Joint Surg Am. 1986;68(3):392–8.PubMedGoogle Scholar
- Hopson MM, McPoil TG, Cornwall MW. Motion of the first metatarsophalangeal joint. Reliability and validity of four measurement techniques. J Am Podiatr Med Assoc. 1995;85(4):198–204.PubMedView ArticleGoogle Scholar
- Hetherington VJ, Johonson RE, Albritton JS. Necessary dorsiflexion of the first metatarsophalangeal joint during gait. J Foot Surg. 1990;29(3):218–22.PubMedGoogle Scholar
- Nawoczenski DA, Baumhauer JF, Umberger BR. Relationship between clinical measurements and motion of the first metatarsophalangeal joint during gait. J Bone Joint Surg Am. 1999;81(3):370–76.PubMedGoogle Scholar
- Gajdosik RL, Bohannon RW. Clinical measurement of range of motion review of goniometry emphasizing reliability and validity. Phys Ther. 1987;67(12):1867–72.PubMedGoogle Scholar
- Green S, Forbes A, Buchbinder R, Bellamy N. A standardized protocol for measurement of range of movement of the shoulder using the Plurimeter-V inclinometer and assessment of its intra-rater and inter-rater reliability. Arthritis Rheum. 1998;11(1):43–52.View ArticleGoogle Scholar
- Hoving JL, Buchbinder R, Green S, Forbes A, Bellamy N, Brand C, et al. How reliably do rheumatologists measure shoulder movement? Ann Rheum Dis. 2002;61(7):612–6.PubMedPubMed CentralView ArticleGoogle Scholar
- Valentine RE, Lewis JS. Intraobserver reliability of 4 physiologic movements of the shoulder in subjects with and without symptoms. Arch Phys Med Rehabil. 2006;87(9):1242–9.PubMedView ArticleGoogle Scholar
- Tveitå EK, Ekeberg OM, Juel NG, Bautz-Holter E. Range of shoulder motion inpatients with adhesive capsulitis; intra-tester reproducibility is acceptable for group comparisons. BMC Musculoskel Disord. 2008;9(1):49–54.View ArticleGoogle Scholar
- Cadogan A, Laslett M, Hing W, McNair P, Williams M. Reliability of a new hand-held dynamometer in measuring shoulder range of motion and strength. Man Ther. 2011;16(1):97–101.PubMedView ArticleGoogle Scholar
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile- health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med. 2013;10(1), e1001362.PubMedPubMed CentralView ArticleGoogle Scholar
- Kailas A, Chong CC, Watanabe F. From mobile phones to personal wellness dashboards. Pulse IEEE. 2010;1(1):57–63.View ArticleGoogle Scholar
- Terry M. Medical applications for smartphones. Telemed JE Health. 2010;16(1):17–23.View ArticleGoogle Scholar
- Koehler N, Vujovic O, McMenamin C. Are individuals more accepting of the internet than mobile phone applications being used in clinical practice? J Mob Tech Med. 2013;2(1S):4–21.Google Scholar
- Farber DC, DeOrio JK, Steel MW. Goniometric versus computerized angle measurement in assessing hallux valgus. Foot Ankle Internat. 2015;26(3):234–8.Google Scholar
- Panchbhavi VK, Trevino S. Comparison between manual and computer-assisted measurements of hallux valgus parameters. Foot Ankle Int. 2014;25(10):708–11.Google Scholar
- Kotter J, Audige L, Brorson S, Donner A, Gejewski BJ, Hrobjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(2):96–106.View ArticleGoogle Scholar
- Dananberg HJ. Functional hallux limitus and its relationship to gait efficiency. J Am Podiatr Med Assoc. 1986;76(11):648–52.PubMedView ArticleGoogle Scholar
- Lorraine M, Eliasziw S, Young M, Woodbury G. Using Goniometric Measurements as an example Assessment of Interrater and Intrarater Reliability. Phys Ther. 1994;74:777–88.Google Scholar
- Nichols DP. Choosing an intraclass correlation coefficient. UCLA: Statistical Consulting Group. http://www.ats.ucla.edu/stat/sas (last accessed 17 March 2015).
- Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. 2013; John Wiley & Sons.Google Scholar
- Shin SH, Ro DH, Lee O, Oh JH, Kim SH. Within-day reliability of shoulder range of motion measurement with a smartphone. Man Ther. 2012;17(4):298–304.PubMedView ArticleGoogle Scholar
- Ferriero G, Sartorio F, Foti C, Primavera D, Brigatti E, Vercelli S. Reliability of a new applicationlication for smartphones (Dr Goniometer) for elbow angle measurement. PM&R. 2011;3(12):1153–4.View ArticleGoogle Scholar
- Watkins MA, Riddle DL, Lamb RL, Personius WJ. Reliability of goniometric measurements and visual estimates of knee range of motion obtained in a clinical setting. Phys Ther. 1991;71(2):90–6.PubMedGoogle Scholar
- Hambly K, Sibley R, Ockendon M. Level of agreement between a novel smartphone application and a long arm goniometer for the assessment of maximum active knee flexion by an inexperienced tester. Int J Physiother Rehab. 2012;2(1):1–14.Google Scholar
- Menz HB, Munteanu SE. Radiographic validation of the Manchester scale for the classification of hallux valgus deformity. Rheumatol (Oxford). 2005;4(8):1061–106.View ArticleGoogle Scholar
- Jones A, Sealey R, Crowe M. Concurrent validity and reliability of the Simple Goniometer iPhone application compared with the Universal Goniometer. Physiother Theory Prac. 2014;30(7):512–6.View ArticleGoogle Scholar
- Jones AM, Curran SA. Intrarater and Interrater Reliability of First Metatarsophalangeal Joint Dorsiflexion Goniometry versus Visual Estimation. J Am Podiatr Med Assoc. 2012;102(4):290–8.PubMedView ArticleGoogle Scholar
- Clarkson HM. Musculoskeletal assessment: joint range of motion and manual muscle strength. 2000; Lippincott Williams & Wilkins.Google Scholar
- Menadue C, Raymond J, Kilbreath SL, Refshauge KM, Adams R. Reliability of two goniometric methods of measuring active inversion and eversion range of motion at the ankle. BMC Musculoskel Dis. 2006;7(1):60–5.View ArticleGoogle Scholar
- Gilheany MF, Landorf KB, Robinson P. Hallux valgus and hallux rigidus: a comparison of impact on health-related quality of life in patients presenting to foot surgeons in Australia. J Foot Ankle Res. 2008;11(1):1–14.Google Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.