Reproducibility of inhibitory control, working memory, and cognitive flexibility measures in older women
Artigo original - número: e225470 - publicado 20 de junho de 2023
DOI:
https://doi.org/10.33233/rbfex.v22i1.5470Keywords:
test-retest reliability, executive function, old people, neuropsychological testsAbstract
Introduction: Executive Function is expressed in day-to-day activities through inhibitory control, working memory, and cognitive flexibility. Despite the importance of evaluating these measures, there are disagreements about the reproducibility of the tests. Objective: To test the reproducibility of the Stroop Color-Word Test, Corsi Block-Tapping Test, and Trail Making Test in older women. Methods: Thirty-five older women performed the Stroop Color-Word Test (Inhibitory Control), Corsi Block-Tapping Test (Working Memory), and Trail Making Test (Cognitive Flexibility) within one week between the test and retest. The reproducibility of the tests was determined by the intraclass correlation coefficient, coefficient of variation, standard error of measurement, and visual inspection of the Bland-Altman graphs. Results: The Stroop Color-Word Test showed satisfactory reproducibility values only for congruent and incongruent measures, with excellent intraclass correlation coefficient values. Corsi Block-Tapping Test showed reproducible values with a moderate and good intraclass correlation coefficient for the sequence and composite score, respectively. The Trail Making Test showed reproducible values for parts A, B, and the ratio (B/A), with intraclass correlation coefficients between moderate and good. Visual inspection of the Bland-Altman plots showed low bias in all variables. Conclusion: The results of the Stroop Color-Word Test, for congruent and incongruent trials, the sequence and the composite score of the Corsi Block-Tapping Test, as well as the part A, B, and the ratio (B/A) of the Trail Making Test, are reproducible measurements for older women.
References
Diamond A. Executive Functions. Annu Rev Psychol. 2013;64:135-68. doi: 10.1146/annurev-psych-113011-143750
Diamond A. Why improving and assessing EF early in life is critical. In: Griffin JA, McCardle P, Freund LS, eds. Executive function in preschool-age children: Integrating measurement, neurodevelopment, and translational research. American Psychological Association 2016;11-43. doi: 10.1037/14797-002
Harada CN, Love MCN, Triebel KL. Normal cognitive aging. Clin Geriatr Med. 2013;29(4):737-52. doi: 10.1016/j.cger.2013.07.002
Ho H-T, Lin S-I, Guo N-W, Yang YC, Lin MH, Wang CS. Executive function predict the quality of life and negative emotion in older adults with diabetes: A longitudinal study. Prim Care Diabetes. 2022;16:537-42. doi: 10.1016/j.pcd.2022.05.002
Aron AR, Robbins TW, Poldrack RA. Inhibition and the right inferior frontal cortex: one decade on. Trends Cogn Sci. 2014;18(4):177-85. doi: 10.1016/j.tics.2013.12.003
Jonides J, Lewis RL, Nee DE, Lustig CA, Berman MG, Moore KS. The mind and brain of short-term memory. Annu Rev Psychol. 2008;59:193-224.
doi: 10.1146/annurev.psych.59.103006.093615
Donders FC. On the speed of mental processes. Acta Psychol (Amst). 1969;30:412-31. doi: 10.1016/0001-6918(69)90065-1
Servant M, Logan GD. Dynamics of attentional focusing in the Eriksen flanker task. Atten Percept Psychophys. 2019;81(8):2710-2721. doi: 10.3758/s13414-019-01796-3
Stroop JR. Studies of interference in serial verbal reactions. Journal of Experimental Psychology 1935;18:643-62. doi: 10.1037/h0054651
Verbruggen F, Logan GD. Response inhibition in the stop-signal paradigm. Trends Cogn Sci 2008;12:418-24. doi: 10.1016/j.tics.2008.07.005
Scarpina F, Tagini S. The stroop color and word test. Front Psychol 2017;8:1-8. doi: 10.3389/fpsyg.2017.00557
Strauss GP, Allen DN, Jorgensen ML, Cramer SL. Test-retest reliability of standard and emotional stroop tasks: an investigation of color-word and picture-word versions. Assessment. 2005;12(3):330-7. doi: 10.1177/1073191105276375
Periáñez JA, Lubrini G, García-Gutiérrez A, Ríos- Lago M. Construct validity of the stroop color-word test: influence of speed of visual search, verbal fluency, working memory, cognitive flexibility, and conflict monitoring. Arch Clin Neuropsychol. 2021;36(1):99-111. doi: 10.1093/arclin/acaa034
Ward N, Hussey E, Alzahabi R, Gaspar JG, Kramer AF. Age-related effects on a novel dual-task Stroop paradigm. PLoS ONE 2021;16:e0247923. doi: 10.1371/journal.pone.0247923
De Nardi T, Sanvicente-Vieira B, Prando M, Stein LM, Fonseca RP, Grassi-Oliveira R. Tarefa N-back Auditiva: Desempenho entre diferentes grupos etários. Psicol Reflex Crit. 2013;26(1). doi: 10.1590/S0102-79722013000100016
Gonçalves VT, Mansur LL. N-Back auditory test performance in normal individuals. Dement Neuropsychol. 2009;3(2). doi: 10.1590/S1980-57642009DN30200008
Nyberg L, Dahlin E, Stigsdotter Neely A, et al. Neural correlates of variable working memory load across adult age and skill: Dissociative patterns within the fronto-parietal network. Scand J Psychol. 2009;50(1):41-6. doi: 10.1111/j.1467-9450.2008.00678.x
Arce T, McMullen K. The Corsi Block-Tapping Test: Evaluating methodological practices with an eye towards modern digital frameworks. Computers in Human Behavior Reports [Internet]. 2021 [citado 2022 dez 12];4:100099. Disponível em: https://par.nsf.gov/servlets/purl/10292489
Corsi PM. Human memory and the medial temporal region of the brain [Internet]. Dissertation Abstracts International 1973;34(2-B): 891. Disponível em: https://psycnet.apa.org/record/1976-04900-001
White N, Flannery L, McClintock A, Machado L. Repeated computerized cognitive testing: Performance shifts and test–retest reliability in healthy older adults. Journal of Clinical and Experimental Neuropsychology 2019;41:179-191. doi: 10.1080/13803395.2018.1526888
Milner B. Some cognitive effects of frontal-lobe lesions in man. Philos Trans R Soc Lond B Biol Sci. 1982 Jun 25;298(1089):211-26. doi: 10.1098/rstb.1982.0083
Reitan RM. The relation of the Trail Making Test to organic brain damage. J Consult Psychol. 1955;19(5):393-4. doi: 10.1037/h0044509.
Miguel FK. Teste Wisconsin de Classificação de Cartas. Avaliação Psicológica 2005;4:203-4.
Suzuki H, Sakuma N, Kobayashi M, Ogawa S, Inagaki H, Edahiro A, e t al. Normative data of the Trail Making Test among urban community-dwelling older adults in Japan. Front Aging Neurosci. 2022;14:832158. doi: 10.3389/fnagi.2022.832158
Wang R-Y, Zhou J-H, Huang Y-C, Yang Y-R. Reliability of the Chinese version of the Trail Making Test and Stroop Color and Word Test among older adults. International Journal of Gerontology. 2018;12:336-9. doi: 10.1016/j.ijge.2018.06.003
Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuro-Psiquiatr. 2019;77(11). doi: 10.1590/0004-282X20190130
Nasreddine ZS, Phillips NA, Bédirian V, et al. The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-9. doi: 10.1111/j.1532-5415.2005.53221.x
Bowie CR, Harvey PD. Administration and interpretation of the Trail Making Test. Nat Protoc 2006;1:2277-81. doi: 10.1038/nprot.2006.390
Faul F, Erdfelder E, Buchner A, et al. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods. 2009;41:1149-60. doi: 10.3758/BRM.41.4.1149
Shieh G. Sample size requirements for the design of reliability studies: precision consideration. Behav Res Methods. 2014;46(3):808-22. doi: 10.3758/s13428-013-0415-1
Fontes AS, Santos MS, Almeida MB, Marín PJ, Silva DRP, Silva-Grigoletto MES. Inter-day reliability of the Upper Body Test for shoulder and pelvic girdle stability in adults. Brazilian Journal of Physical Therapy 2020;24:161-6. doi: 10.1016/j.bjpt.2019.02.009
Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine 2016;15:155-63. doi: 10.1016/j.jcm.2016.02.012
Martin Bland J, Altman Douglas G. Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet 1986;327:307-10. doi: 10.1016/S0140-6736(86)90837-8
Harvey PD. Domains of cognition and their assessment. Dialogues in Clinical Neurosci. 2019;21:227-37. doi: 10.31887/DCNS.2019.21.3/pharvey
Collie A, Maruff P, Darby DG, McStephen M. The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test–retest intervals. J Int Neuropsychol Soc. 2003;9(3):419-28. doi: 10.1017/S1355617703930074
Hoogendam YY, van der Lijn F, Vernooij MW, Hofman A, Niessen WJ, van der Lugt A, et al. Older age relates to worsening of fine motor skills: a population-based study of middle-aged and elderly persons. Front Aging Neurosci. 2014;6. doi: 10.3389/fnagi.2014.00259
Park S-Y, Schott N. The trail-making-test: Comparison between paper-and-pencil and computerized versions in young and healthy older adults. Appl Neuropsychol Adult. 2022;29(5):1208-20. doi: 10.1080/23279095.2020.1864374
Miller JB, Barr WB. The technology crisis in neuropsychology. Arch Clin Neuropsychol. 2017;32:541-54. doi: 10.1093/arclin/acx050
Rumpf U, Menze I, Müller NG, Schmicker M. Investigating the potential role of ecological validity on change-detection memory tasks and distractor processing in younger and older adults. Front Psychol. 2019;10:1046. doi: 10.3389/fpsyg.2019.01046
Zanini GAV, Miranda MC, Cogo-Moreira H, et al. An Adaptable, open-access test battery to study the fractionation of executive-functions in diverse populations. Front Psychol. 2021;12:627219. doi: 10.3389/fpsyg.2021.627219
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Alan Pantoja-Cardoso, José Carlos Aragão-Santos, Marcos Raphael Pereira Monteiro, Poliana de Jesus Santos, Ana Carolina Dos-Santos, Heloiana Faro, Juan Ramon Heredia-Elvar, Leonardo de Sousa Fortes, Marzo Edir Da Silva-Grigoletto
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish in this journal agree to the following terms: Authors retain the copyright and grant the journal the right of first publication, with the work simultaneously licensed under the Creative Commons Attribution License which allows the sharing of work with acknowledgment of authorship and initial publication in this magazine; Authors are authorized to assume additional contracts separately, for non-exclusive distribution of the version of the work published in this journal (eg, publish in an institutional repository or as a book chapter), with acknowledgment of authorship and initial publication in this journal; Authors are allowed and encouraged to publish and distribute their work online (eg, in institutional repositories or on their personal page) at any point before or during the editorial process, as this can generate productive changes as well as increase impact and citation of published work (See The Effect of Open Access).
