ABSTRACT
BACKGROUND AND OBJECTIVES: Digital and analogue algometry have been widely employed in clinical studies, but a recent investigation observed a systematic error between devices, which may hinder comparison of data from different studies. The objective of this study was to evaluate the reproducibility and reliability of analogue and digital algometers.
METHODS: This was an observational transversal study involving 40 healthy adults. They had preserved cognitive capacity and no chronic or acute pain. Participants were submitted to pressure pain threshold (PPT) assessment by two different algometers, 15 minutes apart: a digital device (Wagner Pain Test FPX) and an analogue one (Wagner Force Dial). Data collection involved 2 evaluators and occurred once a week. The muscles evaluated were teres major, upper trapezius, elevator scapulae, supraspinatus, infraspinatus, pectoralis, middle gluteus, paraspinal and deltoid.
RESULTS: Reliability between the measurements taken by the same evaluator (intra-rater reliability) or with the same device (inter-rater reliability) on different days was analyzed using the Intraclass Correlation Coefficient (ICC). When comparing the intra-rater reliability (evaluator 1, weeks 1 and 3), good or excellent reproducibility was observed in most of the sites, with both analogue and digital algometers, with statistical significance. The inter-device reliability (digital and analogue algometers) showed a significant and excellent correlation (r > 0.75) in all evaluated sites for both evaluators. The analysis of inter-rater reliability (2 different evaluators) for the digital algometer revealed good or excellent significant correlation in almost all sites, except for the left pectoralis major. For the analogue algometer, all evaluated sites exhibited good or excellent correlation with statistical significance.
CONCLUSION: The data highlight that digital and analogue algometry have good intra-rater reliability (reproducibility), inter-device reliability and inter-rater reliability in a sample of healthy young individuals.
Keywords: Evaluation study; Pain; Pain threshold; Reproducibility of results
RESUMO
JUSTIFICATIVA E OBJETIVOS: A algometria digital e a analógica têm sido amplamente utilizadas em estudos clínicos, mas uma investigação recente observou um erro sistemático entre os dispositivos, o que pode dificultar a comparação de dados de diferentes estudos. O objetivo deste estudo foi avaliar a reprodutibilidade e a confiabilidade de algômetros analógicos e digitais.
MÉTODOS: Este foi um estudo transversal observacional que envolveu 40 estudantes saudáveis. Eles tinham capacidade cognitiva preservada e não apresentavam dor crônica ou aguda. Os participantes foram submetidos à avaliação do limiar de tolerância à dor por pressão (LTDP) por dois algômetros diferentes, com 15 minutos de intervalo: um algômetro digital (Wagner Pain Test FPX) e um analógico (Wagner Force Dial). A coleta de dados envolveu dois avaliadores e ocorreu uma vez por semana. Os músculos avaliados foram o redondo maior, o trapézio superior, o levantador da escápula, o supraespinhal, o infraespinhal, o peitoral, o glúteo médio, o paraespinhal e o deltoide.
RESULTADOS: A confiabilidade entre as medidas realizadas pelo mesmo avaliador (confiabilidade intra-avaliador) ou com o mesmo aparelho (confiabilidade interavaliador), em dias diferentes, foi analisada por meio do Coeficiente de Correlação Intraclasse (CCI). Ao comparar a confiabilidade intra-avaliador (avaliador 1, semanas 1 e 3), observou-se reprodutibilidade boa ou excelente na maioria dos sítios, tanto com algômetro analógico quanto digital, com significância estatística. A confiabilidade interdispositivos (algômetro digital e analógico) apresentou correlação significativa e excelente (r > 0,75) em todos os locais avaliados e para ambos os avaliadores. A análise da confiabilidade interavaliadores (2 avaliadores diferentes) para o algômetro digital revelou correlação significativa boa ou excelente em quase todos os locais, exceto no peitoral maior esquerdo. Para o algômetro analógico, todos os locais avaliados apresentaram correlação boa ou excelente com significância estatística.
CONCLUSÃO: Os dados destacam que a algometria digital e a analógica apresentam boa confiabilidade intra-avaliador (reprodutibilidade), confiabilidade entre dispositivos e confiabilidade entre avaliadores em uma amostra de jovens saudáveis.
Descritores: Estudos de avaliação; Dor; Limiar da dor; Reprodutibilidade dos testes
HIGHLIGHTS
Digital and analogue algometry have good intra-rater reliability (reproducibility)
Digital and analogue algometry presented good inter-device reliability
Digital and analogue algometry exhibited good inter-rater reliability
INTRODUCTION
The evaluation of sensitivity to pain is and objective method to quantify the discomfort caused by a painful stimulus. Pressure algometry has been employed to this end as opposed to the palpation of the regions of interest1. It offers valuable insights on the nociceptive function and may assist early diagnosis and personalization of the treatment2.
Since the study3 that validated this technique and provided standard values for healthy individuals, algometry has been widely employed in various clinicals settings: low back pain4, knee osteoarthritis5, fibromyalgia6, neck pain7 and temporomandibular joint disorders8, among others. From that time on, devices (pressure gauges attached to a 1 cm2 rubber plunger) have gradually changed from analogue to digital monitors, both still co-existing and sharing preferences among researchers.
Some studies have evaluated reproducibility9 and reliability1, 10 of algometry, but a recent study observed a systematic error between digital and analogue devices: pressure pain thresholds (PPTs) of middle-aged subjects seemed to be higher when evaluated by the analogue device11. This may discourage the use of different devices in large trials, and hinder comparisons among data from studies with analogue and digital devices.
This type of quantitative sensory assessment is widely used in clinical practice and research in both patients and healthy individuals. The establishment of normative parameters in healthy populations is useful to provide references even for studies involving patients12. This has been exemplified by a recent study that evaluated the pressure pain threshold of healthy individuals to establish values for comparison to groups of patients with pain, allowing the identification of potential conditions of hypo- or hyperalgesia.
Algometry has already been studied in healthy individuals13, but as far as is known, no study has compared reproducibility and reliability of different devices in healthy individuals. Thus, the aim of the present study was to contribute to the discussion on reproducibility and reliability of analogue and digital algometers, by providing data on healthy adult subjects.
METHODS
This was an observational transversal study involving 40 healthy university students aged 18-35 years old. The protocol followed national and international ethics regulations and was reviewed and approved by the local Ethics Committee (under opinion number 1.221.945). Volunteers signed the Free and Informed Consent Term (FICT) prior to their participation in this study. They had preserved cognitive capacity and no chronic of infectious diseases. Exclusion criteria included the use of drugs for pain relief (anti-inflammatory or analgesic) in the 3 previous days from the assessments, surgery or traumas in the last 6 months, fever (viral or bacterial infection), severe posture disfunctions, presence of abdominal cramps, renal colic, pregnancy, pain or discomfort in the spine (pain perception>4 in a visual analogue scale ranging from 0 to 10).
Participants were randomly submitted to PPT assessment by two different algometers, 15 minutes apart: a digital device (Wagner Pain Test FPX, Greenwich CT, USA) and an analogue one (Wagner Force Dial, Greenwich CT, USA). Data collection involved 2 experienced evaluators, and occurred once a week, as shown in figure 1. The devices contain a 1 cm2 diameter rubber end. Pressure was applied at a constant rate of 1kg/s until the point at which the participant reported pain or discomfort. Readings were expressed in kgf. During the assessment, volunteers were instructed to say “stop” as soon as the pressure sensation transitioned from unpleasant to painful. The test was stopped as soon as the volunteer indicated the onset of pain, and the final amount of force applied was registered. Areas in the following muscles were evaluated: teres major, upper trapezius, levator scapulae, supraspinatus, infraspinatus, pectoralis, middle gluteus, paraspinal muscles (at L4 level, and at 2cm and 4cm from the medial line), and deltoid muscle. These regions have been previously described and assessed by a study3.
Individuals were asked to assume the positions of prone, supine, and seated. Evaluations occurred in afternoons in a reserved environment within a university clinic. This method was chosen because it has been widely employed by other studies since the 1980’s3, as well as in more recent studies conducted with healthy individuals15, 16, 17, 18.
Statistical analysis
Data were analyzed with descriptive statistics using the software SPSS v.27 for Windows. Reliability between the measurements taken by the same evaluator (intra-rater reliability) or with the same device (inter-rater reliability) on different days was analyzed using the Intraclass Correlation Coefficient (ICC) and categorized as follows: <0.4 - poor; 0.4-0.6 - moderate; >0.6-0.75 - good; >0.75-1.00 - excellent. The significance level (α) considered was 0.0514.
RESULTS
Volunteers enrolled in the present study were 50% females, predominantly right-handed (90%), physically active (65%) and eutrophic (Table 1).
When comparing the intra-rater reliability (evaluator 1, weeks 1 and 3), good or excellent reproducibility was observed in most of the sites, with both analogue and digital algometers, with statistical significance (Table 2). In the Supraspinatus points of the right (R) and left (L) sides, Pectoralis Major L, Gluteus Medius L, and Paraspinal at 4cm from the midline R and L, moderate but significant correlation was observed with the digital algometer. In the Upper Trapezius L, Supraspinatus R, and Pectoralis Major R sites assessed with the analogue algometer, there was also a moderate and significant correlation.
The inter-device reliability (digital and analogue algometers) showed a significant and excellent correlation (r > 0.75) in all evaluated sites for both evaluators (Table 3).
Inter-device intraclass correlation coefficient between analogue and digital algometers (evaluators 1 and 2)
The analysis of inter-rater reliability (2 different evaluators) for the digital algometer revealed good or excellent significant correlation in almost all sites, except for the L pectoralis major (r=0.585. p=0.001). On the other hand, for the analogue algometer, all evaluated sites exhibited good or excellent correlation with statistical significance (Table 4).
DISCUSSION
The aim of this study was to assess reproducibility and reliability of analogue and digital algometers, as quantifying painful experiences is crucial to monitor and diagnose chronic pain15. Intra-rater reliability (reproducibility) was good or excellent in most of the sites, with both analogue and digital algometers. Inter-device reliability was also excellent in all evaluated sites. The inter-rater reliability was considered good or excellent in almost all sites for the digital algometer. The analogue algometer produced good or excellent inter-rater reliability in all sites evaluated.
The present study enrolled a homogeneous sample of healthy individuals (university students) with no complaint of pain, so the presence of pain would not interfere in results. Two al-gometers were tested by two trained evaluators. The analogue algometer has been employed in several studies, e.g. in the assessment ofpain in women with dysmenorrhea16. The same is true for the digital device, which has been employed, for example, to study pressure pain threshold in healthy individuals submitted to hot and cold compresses17, and in healthy elderly persons18.
The digital algometer is recognized as the gold standard pain assessment method19,20 and has been employed in scientific practices over its analog counterpart due to its increased precision, ease of handling, and result reading. However, in clinical routine, the cost of the equipment may hinder its utilization20. For this reason, both algometers were subjected to an investigation in this study.
A recent study21 examined the reproducibility of digital algometers among experienced and novice evaluators, and found minor differences after 3 hours of practice, indicating good a reproducibility in determining PPT, like to the present study. In this investigation, intra-examiner reproducibility of both digital and analogue algometers revealed good to excellent reproducibility, underscoring the consistency of results upon repeated examinations. It is noteworthy that test reliability was measured over a 2-week period, a timeframe reasonably compatible with clinical practice assessments. Unlike a study22 who used a digital algometer to evaluate the medial part of the proximal tibia metaphysis of healthy individuals, the present study focused sites at the hip, spine, and shoulder regions. Nonetheless, both studies agree, since algometry performed with electronic devices provides good or excellent reliability. The data of this study also corroborates the aforementioned study since the high reliability of makes it a valuable tool for longitudinal assessments, providing a reliable means of tracking individuals over time.
Examining the accordance between devices, a notable and excellent correlation (above 0.75) was observed at all points. This robust correlation across different evaluators underscores the reliability of values between the two types of algometers, affirming the usability of both. This result is significant, instilling confidence when digital algometry is not feasible, and indicating that analogue algometers can be employed not only in clinical settings but also in scientific research. Regarding intra-evaluator reliability, results were highly positive, with values showing good to excellent correlation. This implies that examinations performed with both analogue and digital algometers can be conducted by different evaluators when necessary. This is crucial for monitoring a patient’s progress despite changes in the clinical environment or in evaluators/therapists, especially in multicenter studies, as emphasized by a study23.
The findings of this study align with a relevant study24, which evaluated intra-rater and inter-rater reliability of PPT measurement by a handheld algometer at various body locations. They found excellent intra-rater (ICC=0.81-0.99) and inter-rater reliability (ICC=0.92-0.95), supporting the usefulness of multiple trained evaluators in large cohort studies with standardized protocols.
It is worth noting that this study chose to evaluate young, healthy individuals, and this may be seen as a possible limitation, as it prevents the extrapolation of data to other populations. However, emerging studies indicate the applicability of digital algometry in clinical conditions such as stroke, where a study25, for instance, also demonstrated good to excellent reliability. Similarly, in cervical and low back pain, a study26 suggested that the method is important for detecting progress after interventions, and another study1 demonstrated that algometry is a suitable method for pain assessment in osteoarthritis patients, exhibiting good intra-rater and acceptable inter-rater reliabilities after brief training sessions. Algometry, a low cost and fast evaluation of PPT, should be encouraged in the clinical practice of healthcare professionals who deal with pain assessment. Besides allowing the monitoring of a disease and/or clinical condition under therapeutic intervention, the technique is reliable, whether conducted with a digital or an analogue algometer, and even if the patient is evaluated by another trained professional. Furthermore, it can assist professionals in quantifying pain and understanding conditions of hypo- or hyperalgesia in various clinical settings.
CONCLUSION
In conclusion, the data of this research highlight that digital and analogue algometry have good intra-rater reliability (reproducibility), inter-device reliability and inter-rater reliability in a sample of healthy young individuals. It is suggested that future studies are conducted with other populations, especially elderly persons, who are the most vulnerable group to chronic pain syndromes.
-
Sponsoring sources: none.
REFERENCES
- 1 Stausholm MB, Bjordal JM, Moe-Nilssen R, Naterstad IF. Pain pressure threshold algometry in knee osteoarthritis: intra- and inter-rater reliability. Physiother Theory Pract. 2023;39(3):615-22.
- 2 Coombes BK, Bisset L, Vicenzino B. Cold hyperalgesia associated with poorer prognosis in lateral epicondylalgia: a 1-year prognostic study of physical and psychological factors. Clin J Pain. 2015;31(1):30-5.
- 3 Fischer AA. Pressure algometry over normal muscles. Standard values. validity and reproducibility of pressure threshold. Pain. 1987;30(1):115-26.
- 4 Imamura M, Chen J, Matsubayashi SR, Targino RA, Alfieri FM, Bueno DK, Hsing WT. Changes in pressure pain threshold in patients with chronic nonspecific low back pain. Spine. 2013;38(24):2098-107.
- 5 Cristina de Oliveira N, Alfieri FM, Lima ARS, Portes LA. Lifestyle and Pain in Women With Knee Osteoarthritis. Am J Lifestyle Med. 2017;13(6):606-10.
- 6 King CD, Mano KE. Barnett KA. Pfeiffer M. Ting TV. Kashikar-Zuck S. Pressure pain threshold and anxiety in adolescent females with and without juvenile fibromyalgia: a pilot study. Clin J Pain. 2017;33(7):620.
- 7 Nunes AMP, Moita JPAM, Espanha MMMR, Petersen KK, Arendt-Nielsen L. Pressure pain thresholds in office workers with chronic neck pain: A systematic review and meta-analysis. Pain Pract. 2021;21(7):799-814.
- 8 Więckiewicz W, Woźniak K, Piątkowska D, Szyszka-Sommerfeld L, Lipski M. The diagnostic value of pressure algometry for temporomandibular disorders. Biomed Res Int. 2015;2015:575038.
- 9 Aweid O, Gallie R, Morrissey D, Crisp T, Maffulli N, Malliaras P, Padhiar N. Medial tibial pain pressure threshold algometry in runners. Knee Surg Sports Traumatol Arthrosc. 2014;22(7):1549-55.
- 10 Koh RG, Paul TM, Nesovic K, West D, Kumbhare D, Wilson RD. Reliability and minimal detectable difference of pressure pain thresholds in a pain-free population. Br J Pain. 2023;17(3):239-43.
- 11 Castien RF, Coppieters MW, Durge TSC, Scholten-Peeters GGM. High concurrent validity between digital and analogue algometers to measure pressure pain thresholds in healthy participants and people with migraine: a cross-sectional study. J Headache Pain. 2021;22(1):69.
- 12 Pan LH, Ling YH, Lai KL, Wang YF, Hsiao FJ, Chen SP, Liu HY, Chen WT, Wang SJ. The normative values of pain thresholds in healthy Taiwanese. Brain Behav. 2024;14(4):e3485.
- 13 Dissanayaka TD, Farrell M, Zoghi M, Egan GF, Jaberzadeh S. Test-retest reliability of subjective supra-threshold scaling of multiple pressure-pain sensations among healthy individuals: a study using hydraulic pressure algometry. Somatosens Mot Res. 2018;35(3-4):153-61.
- 14 Ciocchetti DV. Guidelines. criteria. and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1984;6(4):184-290.
- 15 Alfieri FM, Lima ARS, Oliveira NC, Portes LA. The influence of physical fitness on pressure pain threshold of elderly women. J Bodyw Mov Ther. 2017;21(3):599-604.
- 16 Santos GK, Silva NC, Alfieri FM. Effects of cold versus hot compress on pain in university students with primary dysmenorrhea. BrJP. 2020;3(1):25-8.
- 17 Vargas e Silva NCO, Rubio AL, Alfieri FM. Associations between skin surface temperature and pressure pain tolerance thresholds of asymptomatic individuals exposed to cryotherapy and thermotherapy. J Chiropr Med. 2019;18(3):171-9.
- 18 Vitorino CF, Oliveira NC, Alfieri FM. Skin surface temperature and pain tolerance threshold in young and elderly individuals. Thermol Int. 2023;33(2):27-32.
- 19 Egloff N, Klingler N, von Känel R, Cámara RJ, Curatolo M, Wegmann B, Marti E, Ferrari ML. Algometry with a clothes peg compared to an electronic pressure algometer: a randomized cross-sectional study in pain patients. BMC Musculoskelet Disord. 2011;12:174.
- 20 Imamura M, Alfieri FM, Filippo TR, Battistella LR. Pressure pain thresholds in patients with chronic nonspecific low back pain. J Back Musculoskelet Rehabil. 2016;29(2):327-36.
- 21 Reezigt RR, Slager GEC, Coppieters MW, Scholten-Peeters GGM. Novice assessors demonstrate good intra-rater agreement and reliability when determining pressure pain thresholds: a cross-sectional study. Peer J. 2023;11:e14565.
- 22 Pelfort X, Torres-Claramunt R, Sánchez-Soler JF, Hinarejos P, Leal-Blanquet J, Valverde D, Monllau JC. Pressure algometry is a useful tool to quantify pain in the medial part of the knee: an intra- and inter-reliability study in healthy subjects. Orthop Traumatol Surg Res. 2015;101(5):559-63.
- 23 Arendt-Nielsen L. Reliability of pressure pain threshold testing (PPT) in healthy pain free young adults. Scand J Pain. 2015;9(1):28-9.
- 24 Waller R, Straker L, O’Sullivan P, Sterling M, Smith A. Reliability of pressure pain threshold testing in healthy pain free young adults. Scand J Pain. 2015;9(1):38-41.
- 25 Zhang YH, Wang YC, Hu GW, Ding XQ, Shen XH, Yang H, Rong JF, Wang XQ, Intra-rater and inter-rater reliability of pressure pain threshold assessment in stroke patients, Eur J Phys Rehabil Med. 2022;58(4):549-57.
- 26 Zicarelli CAM, Santos JPM, Poli-Frederico RC, Silva RA, Barrilec F, Barrette G, Iida LM, Russo PP, Larangeira LLS, Fernandes MTP, Fernandes KBP. Reliability of pressure pain threshold to discriminate individuals with neck and low back pain. J Back Musculoskelet Rehabil. 2021;34(3):363-70.
Edited by
-
Associate editor in charge: Deyse Borge Machado 0000-0002-4305-4952
Publication Dates
-
Publication in this collection
04 Oct 2024 -
Date of issue
2024
History
-
Received
19 Apr 2024 -
Accepted
26 July 2024