Acessibilidade / Reportar erro

Lexical quality measures in the assessment of reading proficiency in Brazilian university students

ABSTRACT

Purpose:

to assess the reading ability of university students using tasks to measure Lexical Quality (LQ) and evaluate the influence of socioeconomic status (SES) on both the reading performance and the components of Lexical Quality (LQ).

Methods:

44 students from two federal universities took online linguistic tests, 19 from the Federal University of the Great ABC Region (UFABC) and 25 from the Federal University of Ceará (UFC), Brazil. Two-ranked Mann-Whitney (Wilcoxon rank-sum test) and Pearson’s Correlation tests at p<0,05 were applied to analyze the data.

Results:

high and medium correlations were obtained among the different components of LQ, such as vocabulary and spelling recognition. In addition, significant differences were found between the performances of the two universities' students and their distinct socioeconomic levels.

Conclusion:

shorter reading times were correlated to higher accuracy in the Test of Word Reading Efficiency for Adults. The number of correct answers in the homonym test was correlated to the higher accuracy of the Test of Word Reading Efficiency for Adults, and both were correlated to the reaction time measures of these tests. The influence of socioeconomic status on reading performance and Lexical Quality components tasks was also found.

Keywords:
Reading; Higher Education; Young Adult; Literacy

RESUMO

Objetivos:

comparar o desempenho de alunos universitários brasileiros a partir de tarefas com habilidades de qualidade lexical e avaliar a influência do nível socioeconômico no desempenho da leitura e nos componentes que formam a qualidade lexical.

Métodos:

testes linguísticos on-line foram aplicados em 44 estudantes de duas universidades federais, sendo 19 da Universidade Federal do ABC e 25 da Universidade Federal do Ceará. Para análise foram utilizados os testes Mann-Whitney (Wilcoxon rank-sum test) de duas vias e a Correlação de Pearson com p<0,05.

Resultados:

foram obtidas correlações altas e médias entre os diferentes componentes da qualidade lexical, tais como vocabulário e reconhecimento ortográfico, além de terem sido encontradas diferenças significativas entre o desempenho dos alunos das duas universidades e de diferentes níveis socioeconômicos.

Conclusão:

menor tempo de leitura apresentou correlação com maior quantidade de acertos na leitura de palavras em voz alta, a quantidade de acertos no teste de homônimos correlacionou-se a quantidade de acertos no teste de leitura de palavras em voz alta e ambas correlacionaram-se com o tempo de resposta destes testes. Houve, também, influência do nível socioeconômico no desempenho da leitura e nos componentes que formam a qualidade lexical.

Descritores:
Leitura; Alfabetização; Adulto Jovem; Universidades

INTRODUCTION

Reading and writing have played an essential role in the history and development of humanity in its various fields of practice and learning, as through them, it has been possible to record, retrieve, accumulate, enjoy, and spread knowledge. As a cognitive resource, reading provides broader access to knowledge, work, and social integration. Consequently, it is a basic form of socialization for human beings, thus, when reading fails, it inflicts a heavy toll on society11. Rastle K. The place of morphology in learning to read in English. Cortex. 2019 jul;116:45-54. https://doi.org/10.1016/j.cortex.2018.02.008 PMID: 29605387.
https://doi.org/10.1016/j.cortex.2018.02...
.

According to the World Literacy Foundation (2022)22. Home - World Literacy Foundation [Webpage on the internet]. World Literacy Foundation. 2017 [accessed 2024 march 14]. Available at: https://worldliteracyfoundation.org/
https://worldliteracyfoundation.org/...
, illiteracy and low reading proficiency cost the global economy around 1.19 trillion annually, or 2% of the Gross Domestic Product (GDP) of developed countries, 1.5% of emerging countries, and 0.5% of developing countries in direct costs alone. Rastle11. Rastle K. The place of morphology in learning to read in English. Cortex. 2019 jul;116:45-54. https://doi.org/10.1016/j.cortex.2018.02.008 PMID: 29605387.
https://doi.org/10.1016/j.cortex.2018.02...
reports that the indirect costs are likely even higher since literacy gaps prevent people from clearly understanding hygiene, food, and safety information. The author also explains that low literacy is the most significant contributor to social inequality, further burdening the state with social security expenditures, health, and public safety. It is primarily responsible for keeping a large number of people dependent on welfare policies. Therefore, discussing proficiency in reading skills is more than discussing education, i.e., it is an economic program issue.

Entering the literate world is a multifaceted challenge. Research indicates that interaction with schooling institutions and the uses of writing are related to the quality of literacy33. Batista AAG, Ribeiro VM. Cultura escrita no Brasil: modos e condições de inserção. Educação & Realidade [journal on the internet]. 2004; 29(2). [accessed 2024 march 14]. Available at: https://seer.ufrgs.br/index.php/educacaoerealidade/article/view/25394
https://seer.ufrgs.br/index.php/educacao...
. In the Brazilian context, we see low performance in reading comprehension assessments in all grades, from elementary to secondary school. According to the Basic Education Assessment System (SAEB), performance in Portuguese has stagnated or evolved slowly over the last 10 years. It has fallen in all school grades over the previous two publications. The score goes from 0 to 500, and from 2019 to 2021, the score for the 5th grade dropped from 215 to 206; for the 9th grade, it fell from 260 to 258; and in high school, it lowered from 278 to 27544. Sistema de Avaliação da Educação Básica [Webpage on the internet]. Saeb-Inep. [accessed 2024 march 14]. Available at: https://download.inep.gov.br/institucional/apresentacao_saeb_ideb_2021.pdf
https://download.inep.gov.br/institucion...
.

Another indicator of reading proficiency, the Functional Illiteracy Indicator (INAF, 2018)55. Indicador de Alfabetismo Funcional [Webpage on the internet]. Inaf. [accessed 2024 march 14]. Available at: https://alfabetismofuncional.org.br/
https://alfabetismofuncional.org.br/...
, classifies proficiency in reading and comprehension into three categories and five levels. The first category includes Functional Illiteracy with the absence of reading skills (Illiterate level) and basic reading skills at the Rudimentary level. The second category has only one level, defined as Elementary, comprising the ability to read short texts and make some inferences. The third level, called Consolidated Literacy, is subdivided into two levels: the Intermediate level, characterized by the ability to spot information expressed literally and make inferences in texts of different levels, and the Proficient level, with complete reading skills. According to the INAF data, in 2018, in the Northeast, only 68% of university students were in the Consolidated Literacy or Proficiency in the Portuguese Language categories; this percentage is 70% in the Southeast. According to the INAF 2018 evaluation, only 52% of the secondary education students in the Southeast region fell in Consolidated Literacy, dropping to 35% in the Northeast region. These indicators suggest that many high school students' reading skills are insufficient. As they are the same students who will join the university, it can be inferred that many low-skilled readers are to be admitted to the university.

Da Silva and Novais66. da Silva MAM, Novais JO de S. O hábito de leitura dos estudantes do curso de letras. Leitura 2022; [journal on the internet]. 73(1):28-41. [accessed 2024 march 14]. Available at: https://www.seer.ufal.br/index.php/revistaleitura/article/download/13148/9904
https://www.seer.ufal.br/index.php/revis...
measured the reading fluency of university adults in the Psychology course at the Pontifical Catholic University of São Paulo (PUC-SP) in 2022. The study showed that a significant number of students had a reading automaticity rate below the expectation for their level of education. In 2016, Aniceto et al.77. Aniceto A, Alexandra C, Lucena E, Dantas J. Compreensão leitora e estratégias de estudo: estudo correlacional com universitários. Psicologia argumento. 2016;34(86). https://doi.org/10.7213/psicol.argum.34.086.AO03
https://doi.org/10.7213/psicol.argum.34....
conducted studies on the reading comprehension ability of college students from various universities in Paraíba, Brazil, and concluded that reading proficiency was low in the group studied. Therefore, it is crucial to assess the reading skills of university students to address this issue better. That can be achieved by evaluating adults' essential reading skills to perform proficient reading from the Lexical Quality Hypothesis (LQH) perspective.

Within the scope of the LQH of reading, Lexical Quality (LQ) is postulated as the quality of the representation of the word in the mental lexicon88. Perfetti C. Reading ability: Lexical quality to comprehension. Scientific Studies of Reading. 2007;11(4):357-83. https://doi.org/10.1080/10888430701530730
https://doi.org/10.1080/1088843070153073...
,99. Perfetti C, Harris L. Learning to read English. In: Verhoeven L, Perfetti C, editors. Learning to read across languages and writing systems. Cambridge: Cambridge University Press; 2017. p. 323-46.. A high LQ precisely delineates the linguistic features of the word being read: orthographic, phonological, morphosyntactic, and semantic. The highly skilled reader understands that the word has an identity based on the components that define it: the linguistic form, which includes phonology and morphosyntax; the orthographic form, which involves the structure of the word; and the conceptual form, applying semantics and the context of use88. Perfetti C. Reading ability: Lexical quality to comprehension. Scientific Studies of Reading. 2007;11(4):357-83. https://doi.org/10.1080/10888430701530730
https://doi.org/10.1080/1088843070153073...

9. Perfetti C, Harris L. Learning to read English. In: Verhoeven L, Perfetti C, editors. Learning to read across languages and writing systems. Cambridge: Cambridge University Press; 2017. p. 323-46.

10. Verhoeven L, Reitsma P, Elbro C, Perfetti CA, Hart L. The lexical quality hypothesis. In: Verhoeven L, Elbro C, Reitsma P, editors. Precursors of functional literacy. Amsterdam, England: J. Benjamins Publishing Company; 2002. p. 189-213.
-1111. Perfetti CA. Lexical quality revisited. In: Segers E, Broek P, editors, Developmental perspectives in written language and literacy: In honor of Ludo Verhoeven. Amsterdam, England: John Benjamins Publishing Company; 2017. p. 51-67.. That's how the word's identity in the mental lexicon is established, as an interaction between the precise components, but with redundant interaction to account for orthographic and phonological overlaps (homographs and homophones, for example). Furthermore, according to Perfetti, any failure in the representation or interaction of the word's components represents a threat to the lexical quality and retrieval of the word88. Perfetti C. Reading ability: Lexical quality to comprehension. Scientific Studies of Reading. 2007;11(4):357-83. https://doi.org/10.1080/10888430701530730
https://doi.org/10.1080/1088843070153073...

9. Perfetti C, Harris L. Learning to read English. In: Verhoeven L, Perfetti C, editors. Learning to read across languages and writing systems. Cambridge: Cambridge University Press; 2017. p. 323-46.

10. Verhoeven L, Reitsma P, Elbro C, Perfetti CA, Hart L. The lexical quality hypothesis. In: Verhoeven L, Elbro C, Reitsma P, editors. Precursors of functional literacy. Amsterdam, England: J. Benjamins Publishing Company; 2002. p. 189-213.
-1111. Perfetti CA. Lexical quality revisited. In: Segers E, Broek P, editors, Developmental perspectives in written language and literacy: In honor of Ludo Verhoeven. Amsterdam, England: John Benjamins Publishing Company; 2017. p. 51-67..

Perfetti1111. Perfetti CA. Lexical quality revisited. In: Segers E, Broek P, editors, Developmental perspectives in written language and literacy: In honor of Ludo Verhoeven. Amsterdam, England: John Benjamins Publishing Company; 2017. p. 51-67., through LQH, refers to the causal role of lexical knowledge in reading, implying individual differences in the speed and efficiency of word retrieval. Low LQ, in contrast to high quality, results from a non-synchronous relationship between the three components (linguistic, orthographic, and conceptual). A failure in the readiness and/or recovery of one of them impacts the process of recovering the identity of the word in a reader's memory. This event leads to less fluency in reading at the word level, requiring more processing time and the commitment of additional cognitive resources. Thus, low LQ might lead to less availability of resources for sentence-level processing in word integration and contextual comprehension.

The LQ has also been assessed using different cognitive skills, such as word recognition, vocabulary assessment, reading and comprehension, and pseudowords reading aloud1212. Andrews S, Veldre A, Clarke IE. Measuring lexical quality: The role of spelling ability. Behavior Research Methods. 2020;52(6):2257-82. https://doi.org/10.3758/s13428-020-01387-3
https://doi.org/10.3758/s13428-020-01387...
. In addition to evaluating the components of the LQ, more subjective proficiency measures can be applied. The author Recognition Test presents students with a 100-name list, from which they should discriminate authors' names. Scores are computed by subtracting the number of incorrect answers from correct ones. The task aims to gauge the individual's exposure to the written word1313. Taylor JN, Perfetti CA. Eye movements reveal readers' lexical quality and reading experience. Reading and Writing. 2016;29(6):1069-103. https://doi.org/10.1007/s11145-015-9616-6
https://doi.org/10.1007/s11145-015-9616-...
.

Andrews and colleagues1212. Andrews S, Veldre A, Clarke IE. Measuring lexical quality: The role of spelling ability. Behavior Research Methods. 2020;52(6):2257-82. https://doi.org/10.3758/s13428-020-01387-3
https://doi.org/10.3758/s13428-020-01387...

13. Taylor JN, Perfetti CA. Eye movements reveal readers' lexical quality and reading experience. Reading and Writing. 2016;29(6):1069-103. https://doi.org/10.1007/s11145-015-9616-6
https://doi.org/10.1007/s11145-015-9616-...

14. Andrews S, Hersch J. Lexical precision in skilled readers: Individual differences in masked neighbor priming. Journal of Experimental Psychology: General. 2010;139(2):299-318. https://doi.org/10.1037/a0018366
https://doi.org/10.1037/a0018366...

15. Andrews S, Lo S. Not all skilled readers have cracked the code: Individual differences in masked form priming. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2012;38(1):152-63. https://doi.org/10.1037/a0024953
https://doi.org/10.1037/a0024953...

16. Veldre A, Andrews S. Lexical quality and eye movements: Individual differences in the perceptual span of skilled adult readers. Quarterly Journal of Experimental Psychology. 2014;67(4):703-27. https://doi.org/10.1080/17470218.2013.826258
https://doi.org/10.1080/17470218.2013.82...
-1717. Veldre A, Andrews S. Parafoveal preview benefit is modulated by the precision of skilled readers' lexical representations. Journal of Experimental Psychology: Human Perception and Performance. 2015;41(1):219-32. https://doi.org/10.1037/xhp0000017
https://doi.org/10.1037/xhp0000017...
assessed individual differences in language processing using various proficiency measures. Throughout their published work, Andrews et al. sought a way to assess the core characteristics of Lexical Quality. The construct is vital because fast and precise word identification through visual word recognition requires the reader to extract the word's most relevant features by employing perceptual input and vision. These features allow the reader to retrieve the read word among the existing lexical representation in the reader's mental lexicon.

Andrews et al.1818. Veldre A, Andrews S. Parafoveal preview effects depend on both preview plausibility and target predictability. Quarterly Journal of Experimental Psychology. 2018;71(1):64-74. https://doi.org/10.1080/17470218.2016.1247894 point out that tests combining spelling dictation and orthographic recognition, applied together with tests that assess lexical proficiency, such as vocabulary reading comprehension, among other tasks, show that the readiness in spelling recognition can predict this unique variation1212. Andrews S, Veldre A, Clarke IE. Measuring lexical quality: The role of spelling ability. Behavior Research Methods. 2020;52(6):2257-82. https://doi.org/10.3758/s13428-020-01387-3
https://doi.org/10.3758/s13428-020-01387...

13. Taylor JN, Perfetti CA. Eye movements reveal readers' lexical quality and reading experience. Reading and Writing. 2016;29(6):1069-103. https://doi.org/10.1007/s11145-015-9616-6
https://doi.org/10.1007/s11145-015-9616-...

14. Andrews S, Hersch J. Lexical precision in skilled readers: Individual differences in masked neighbor priming. Journal of Experimental Psychology: General. 2010;139(2):299-318. https://doi.org/10.1037/a0018366
https://doi.org/10.1037/a0018366...

15. Andrews S, Lo S. Not all skilled readers have cracked the code: Individual differences in masked form priming. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2012;38(1):152-63. https://doi.org/10.1037/a0024953
https://doi.org/10.1037/a0024953...

16. Veldre A, Andrews S. Lexical quality and eye movements: Individual differences in the perceptual span of skilled adult readers. Quarterly Journal of Experimental Psychology. 2014;67(4):703-27. https://doi.org/10.1080/17470218.2013.826258
https://doi.org/10.1080/17470218.2013.82...

17. Veldre A, Andrews S. Parafoveal preview benefit is modulated by the precision of skilled readers' lexical representations. Journal of Experimental Psychology: Human Perception and Performance. 2015;41(1):219-32. https://doi.org/10.1037/xhp0000017
https://doi.org/10.1037/xhp0000017...

18. Veldre A, Andrews S. Parafoveal preview effects depend on both preview plausibility and target predictability. Quarterly Journal of Experimental Psychology. 2018;71(1):64-74. https://doi.org/10.1080/17470218.2016.1247894

19. Veldre A, Drieghe D, Andrews S. Spelling ability selectively predicts the magnitude of disruption in unspaced text reading. Journal of Experimental Psychology: Human Perception and Performance. 2017;43(9):1612-28. https://doi.org/10.1037/xhp0000425
https://doi.org/10.1037/xhp0000425...
-2020. Michelino MS, Macedo EC. Consciência fonológica, nomeação automática rápida e leitura em adultos analfabetos funcionais. CoDAS. 2021;33(1):e20190206. https://doi.org/10.1590/2317-1782/20202019206 PMID: 33886745.
https://doi.org/10.1590/2317-1782/20202...
. The authors emphasize that there is accumulated evidence that measures of lexical proficiency predict systematic variation in adult reading performance due to individual differences acquired in literacy and consolidated through reading experience.

The motivation for the present study was the need to produce an efficient assessment that captures the essential reading abilities of Brazilian adults. The instruments available in Portuguese for this population are scarce, and they are often not sensitive to differentiating reading performance among adult readers or are aimed at distinguishing clinical groups, such as dyslexia. Among the tests published in Brazil for the adult population are RAN (rapid automatized naming)2121. Dias NM, Mecca TP, de Oliveira PV, Pontes JM, de Macedo EC. Adult reading assessment tools: A psychometric study. Rev. CEFAC. 2016;18(5):1169-78. https://doi.org/10.1590/1982-0216201618523615
https://doi.org/10.1590/1982-02162016185...
, which evaluates lexical access, and Test of Word Reading Efficiency for Adults (TCLP-2)2222. Castro FM, Rodrigues AS, Costa FLP da. Right to read: What we can learn from neurosciences to augment childhood and literacy policies? Educ Pesqui. 2023;49:e249518. https://doi.org/10.1590/S1678-4634202349249518eng
https://doi.org/10.1590/S1678-4634202349...
, which assesses word recognition.

Therefore, the present study aimed to assess the reading ability of university students using tasks to measure Lexical Quality (LQ) and evaluate the influence of socioeconomic status (SES) on both the reading performance and the components of Lexical Quality (LQ).

METHODS

The Federal University of the Great ABC Ethics Committee, Brazil, issued a favorable opinion letter numbered 5.073.251 and a certified statement (CAAE) under number 44406721.6.1001.5594 in compliance with the National Health Board's administrative resolution 466/2012. All participants signed an informed consent form that was recommended for research with human beings.

For English, Andrews used form H of the Nelson Denny Test (NDT) to assess reading comprehension and vocabulary for the lexical quality construct1212. Andrews S, Veldre A, Clarke IE. Measuring lexical quality: The role of spelling ability. Behavior Research Methods. 2020;52(6):2257-82. https://doi.org/10.3758/s13428-020-01387-3
https://doi.org/10.3758/s13428-020-01387...
. The NDT consists of 80 vocabulary questions, where the participant is to choose from 5 alternatives, which can be synonyms/antonyms or the definition of the word that best matches a word presented. It also has a reading comprehension section, where 38 comprehension questions are asked based on 7 short texts on various subjects. This test also assessed the participants' reading speed in 1 minute. They also used the Spelling Recognition Test, which comprised 88 words, half of which were misspelled. The participants had to identify the incorrect spellings.

Based on these validated instruments for the English language, similar tests were created for the Portuguese Language. These tests are not a validation of a new instrument or a translation of the English tests but rather an attempt to approach the LQ construct from the perspective of Brazilian Portuguese. The premises are the same, and validation is a future step.

Participants

The data were collected for 44 students at two federal universities (UF), 19 from the Federal University of the Great ABC Region (UFABC) and 25 from the Federal University of Ceará (UFC), Brazil. The UFABC sample encompassed mainly neuroscience undergraduates and was heterogeneous regarding the course terms. The UFC sample comprised sixth-term undergraduates from the English Language and Literature course. The mean age of the participants was 23.51 years (SD = 4.07), with 52.83% of the sample female. All participants reported Portuguese as their mother tongue.

LQH assessment instruments

Spelling Recognition Test (SRT) (devised by the research group): 4 words were shown in one attempt: 3 were misspelled, and 1 was correct. The participant had to choose the word with the correct spelling from the alternatives. There were 7 questions, and performance was assessed based on the correct answers and response time measures.

Homonym Test (HT) (devised by the research group): Gapped sentences were presented, and after reading, the participant had to indicate which, between two alternatives of homonymous words with different meanings, was the correct word, semantically and orthographically. There were 25 questions in total. Performance was assessed based on correct answers and response time measures.

Reading Comprehension Test (RCT) (passages collected by the research group from existing texts): The students were asked to read a few short texts from the genres studied in primary and secondary schools. These texts were presented to the reader for comprehension, followed by 1 comprehension question. There were 7 texts in total. Performance was assessed by scoring the correct answers and the average reading times for all the texts.

Test of Word Reading Efficiency for Adults (TWRE) (devised by the research group): A list of low-frequency words was presented, and they were instructed to read them aloud as quickly and correctly as possible. The 126-word- list was divided into 5 pages, each containing two columns. The task was recorded. Later, it was transcribed, and performance was assessed by scoring correct pronunciation and reading speed rate.

Brazil Criterion (BARC): This socioeconomic questionnaire was devised by the Brazilian Association of Research Companies. It ranks participants into social classes by yielding different scores. It comprises education, occupation of the Family Head, as well as income and living conditions.

Procedure

Due to the incidence of the COVID-19 pandemic during the data gathering period, contacts and data gathering were made remotely. Participants were contacted and recruited in two ways. Students made appointments with the researcher via WhatsApp or email. The participants went through the procedure following a controlled sequence of tasks: half of the participants started with the multiple-choice questions on the JsPsych platform and then continued with the word reading task via Google Meet, and the other half of the participants followed the reverse order. Although the tasks were easy to understand, throughout the assessment, an examiner remained available on WhatsApp to answer any questions that might have arisen during the task administering. All the participants completed all the lexical quality tasks and the socioeconomic questionnaire.

Inferential statistical tests were conducted on the data using the two-way Mann-Whitney (Wilcoxon rank-sum test) and Pearson's correlation tests. An open-source statistical analysis program (JASP) analyzed the data. The significance value used was 0,05.

Both score and reaction time data resulting from the LQ components' assessment were examined for normality, which showed a non-parametric distribution (Shapiro-Wilk; p<0,001); therefore, non-parametric comparisons were adopted.

RESULTS

The student sample was initially ranked according to their socioeconomic classes for each university (UFABC and UFC), whose outcome is displayed in Figure 1. The students in the sample were from socioeconomic grades A to C2; however, most students from both universities were placed in grade B2.

Figure 1
Relative frequency graph of economic class in relation to the participants’ university. The socioeconomic classification was based on the 2019 Brazil criterion of the Brazilian Association of Research Companies (BARC).

The performance of students from both samples (UFC vs. UFABC) was compared for total scores (Correct) and reaction time measures (RT) in each of the tasks. The student groups showed statistically significant differences in some tests, especially concerning execution time measures. Federal University of Ceará students performed spelling and homonym recognition tasks in less time without impacting their level of accuracy. The score was statistically different only in the Reading and Comprehension task, with greater accuracy for the UFC group. All the means, medians, and standard deviations for each test are shown in Table 1.

Table 1
Descriptive Tests

Given the difference in performance, the groups were combined, and correlation analyses were carried out between the tasks to assess the relationship between the LQ component task. The results showed a negative correlation between reading rate and accuracy on the TWREA (r = -0.40; p < 0.01), which indicates that students whose reading rates were slower (longer time) also read less correctly (fewer correct answers). A high correlation was found between valid scores on the HT and SRT tasks (r = 0.484; p < 0.001) and the response time measures for these tasks (r = 0.739; p < 0.001), indicating that effective and rapid recognition of spelling correlates with correct and rapid vocabulary evaluation. In addition, a correlation between HT and TWREA (r = 0.46; p < 0.01) suggests a relationship between correct vocabulary and spelling recognition.

Figure 2
Scatterplots of significant correlations, with prediction interval at the green dotted line. The figure on the left shows SRT and HT correlation; the figure in the middle shows HT x TWREA correlation; the figure on the right shows TWREA x TWREA (rt).

Furthermore, correct HT scores showed a moderate correlation (r = 0.415; p < 0.05) with socioeconomic status, indicating that readers with sound vocabulary knowledge belong to the upper classes. The same trend was observed for the correlation of socioeconomic level and reaction time measures for RCT rt (r = 0.352), i.e., students with higher socioeconomic status tend to read a set of texts faster. The data are shown in Figure 3.

Figure 3
Scatterplot of homonym test and socioeconomic status significative correlations. 95% prediction intervals at the green dotted line. Only 29 students were counted in that correlation due to problems with filling out forms.

DISCUSSION

The present study used the assumptions of LQH and evaluated instruments to measure the components of Lexical Quality (LQ) in adult readers. Veldre and Andrews1717. Veldre A, Andrews S. Parafoveal preview benefit is modulated by the precision of skilled readers' lexical representations. Journal of Experimental Psychology: Human Perception and Performance. 2015;41(1):219-32. https://doi.org/10.1037/xhp0000017
https://doi.org/10.1037/xhp0000017...
stated the reliability of spelling recognition tests (orthographic, phonological, and morphological) in assessing LQH measures, and they reported a correlation between reading comprehension and reading time measures. This evidence was partially reproduced in the present research, showing important relations between the Test of Word Reading Efficiency for Adults, homonym tests (comprising vocabulary and spelling), and spelling recognition. Distinctively from what was expected regarding the results for the English language, positive correlations between accuracy and execution time measures were not found in the Brazilian sample of undergraduate readers. In other words, those who score higher in a task do so faster. A possible explanation might be that Portuguese is more transparent than English, implying that transparent language readers make fewer mistakes than opaque languages. Other potential causes might be investigated in further studies.

Overall, the tasks applied in this study showed evidence of assessing LQ components as essential skills that differentiate the level of reading proficiency in adults. There are currently no similar tests in Brazil for this population.

Another important finding is the relationship between socioeconomic class and scores in some LQ component tasks, specifically the homonym test and text reading rate tasks. Participants from higher socioeconomic classes showed better performance in these tasks. Since good performance in the homonym task and speed reading requires spelling and vocabulary knowledge, it can be hypothesized that those skills are deficient among low-income undergraduate students. Another study2222. Castro FM, Rodrigues AS, Costa FLP da. Right to read: What we can learn from neurosciences to augment childhood and literacy policies? Educ Pesqui. 2023;49:e249518. https://doi.org/10.1590/S1678-4634202349249518eng
https://doi.org/10.1590/S1678-4634202349...
has shown that previous deficits can be burdened since the initial literacy years. Students with poor reading experience, i.e., students who join the workforce to make their family's ends meet and/or because their families are experiencing food insecurity, have less free time for reading practice than those who are not compelled to work2323. Carnevale AP, Smith N. Balancing work and learning: Implications for low-income students [Webpage on the internet]. 2018. [accessed 2024 march 14]. Available at: https://cew.georgetown.edu/cew-reports/learnandearn/#resources
https://cew.georgetown.edu/cew-reports/l...
.

This revelation is critical; however, its interpretation is limited by class D and E sub-representation in the present study; nonetheless, it is consistent with recent research on the profile of undergraduates in Brazil. According to the 10th Map of the tertiary degree issued by the São Paulo state supporting college education authority group (Semesp)2424. Download - 10º Mapa do Ensino Superior - Instituto Semesp [Webpage on the internet]. Semesp. [accessed 2024 march 14]. Available at: https://www.semesp.org.br/mapa/edicao-10/download/
https://www.semesp.org.br/mapa/edicao-10...
, only 19% of the Brazilian population from D class, aged 18-24, attended college education in 2018. Just 5,4% of that total was enrolled in public institutions. Among class E members, only 10,5% attended higher education. The percentage of those attending a public university plunges to 4,2%. When comparing underprivileged classes to classes A, B, and C, 61,9%, 54,7%, and 30,1% were enrolled in the tertiary level, while 15,5%, 16,7%, and 6,8% of those classes attended public institutions. These data show that socioeconomic status strongly impacts youngsters joining a public university, and the present article complements this information, stating that students from underprivileged classes still strive against the adverse effects of their socioeconomic background, which are still apparent in their reading component measures. The effect of deficient academic performance on dropout rates still deserves a comprehensive examination.

The results of the present study are consistent with the LQH theory, which states that individuals with extensive lexical knowledge perform better in spelling recognition tests and word decoding tasks1010. Verhoeven L, Reitsma P, Elbro C, Perfetti CA, Hart L. The lexical quality hypothesis. In: Verhoeven L, Elbro C, Reitsma P, editors. Precursors of functional literacy. Amsterdam, England: J. Benjamins Publishing Company; 2002. p. 189-213.. In addition, the better performance of UFC students in the reading comprehension task may be explained by the more homogeneous same-term sample of language students compared to the heterogeneous sample of students from different UFABC course terms. It can also be hypothesized that the reading load of the language graduation courses is more consistent compared to neuroscience courses. According to Da Silva and Novais77. Aniceto A, Alexandra C, Lucena E, Dantas J. Compreensão leitora e estratégias de estudo: estudo correlacional com universitários. Psicologia argumento. 2016;34(86). https://doi.org/10.7213/psicol.argum.34.086.AO03
https://doi.org/10.7213/psicol.argum.34....
, many language and literature students do not maintain a frequent reading habit, yet this habit may be higher than that of neuroscience students.

This study has only provided initial evidence concerning the quality of reading in university students, a relevant topic lacking a detailed inquiry in Brazil. Some of the limitations of this study should be improved in future research, namely, the small sample size of participants and the lack of validated measures. Despite the small sample size, it was representative of two Brazilian states with different sociodemographic realities. The LQ instruments still lack sensitivity analyses to better portray Brazilian students' reading proficiency levels. The absence of other tests in the Brazilian market has prevented measures validation. Another unintentional bias encountered in this study was comparing two groups of students with different majors. However, the UFC group concentrates mainly on students majoring in Letters, while the UFABC group comprises students from distinct Neuroscience courses. Homogeneity should be sought in further investigations.

CONCLUSION

Shorter reading rates were correlated to higher accuracy in the Test of Word Reading Efficiency for Adults, the accuracy of the homonym tests was related to the accuracy in the Test of Word Reading Efficiency for Adults, and both were correlated to their reaction time measures. Evidence also revealed that socioeconomic status influenced reading performance and the outcome of the LQ components tasks.

REFERENCES

  • 1
    Rastle K. The place of morphology in learning to read in English. Cortex. 2019 jul;116:45-54. https://doi.org/10.1016/j.cortex.2018.02.008 PMID: 29605387.
    » https://doi.org/10.1016/j.cortex.2018.02.008
  • 2
    Home - World Literacy Foundation [Webpage on the internet]. World Literacy Foundation. 2017 [accessed 2024 march 14]. Available at: https://worldliteracyfoundation.org/
    » https://worldliteracyfoundation.org/
  • 3
    Batista AAG, Ribeiro VM. Cultura escrita no Brasil: modos e condições de inserção. Educação & Realidade [journal on the internet]. 2004; 29(2). [accessed 2024 march 14]. Available at: https://seer.ufrgs.br/index.php/educacaoerealidade/article/view/25394
    » https://seer.ufrgs.br/index.php/educacaoerealidade/article/view/25394
  • 4
    Sistema de Avaliação da Educação Básica [Webpage on the internet]. Saeb-Inep. [accessed 2024 march 14]. Available at: https://download.inep.gov.br/institucional/apresentacao_saeb_ideb_2021.pdf
    » https://download.inep.gov.br/institucional/apresentacao_saeb_ideb_2021.pdf
  • 5
    Indicador de Alfabetismo Funcional [Webpage on the internet]. Inaf. [accessed 2024 march 14]. Available at: https://alfabetismofuncional.org.br/
    » https://alfabetismofuncional.org.br/
  • 6
    da Silva MAM, Novais JO de S. O hábito de leitura dos estudantes do curso de letras. Leitura 2022; [journal on the internet]. 73(1):28-41. [accessed 2024 march 14]. Available at: https://www.seer.ufal.br/index.php/revistaleitura/article/download/13148/9904
    » https://www.seer.ufal.br/index.php/revistaleitura/article/download/13148/9904
  • 7
    Aniceto A, Alexandra C, Lucena E, Dantas J. Compreensão leitora e estratégias de estudo: estudo correlacional com universitários. Psicologia argumento. 2016;34(86). https://doi.org/10.7213/psicol.argum.34.086.AO03
    » https://doi.org/10.7213/psicol.argum.34.086.AO03
  • 8
    Perfetti C. Reading ability: Lexical quality to comprehension. Scientific Studies of Reading. 2007;11(4):357-83. https://doi.org/10.1080/10888430701530730
    » https://doi.org/10.1080/10888430701530730
  • 9
    Perfetti C, Harris L. Learning to read English. In: Verhoeven L, Perfetti C, editors. Learning to read across languages and writing systems. Cambridge: Cambridge University Press; 2017. p. 323-46.
  • 10
    Verhoeven L, Reitsma P, Elbro C, Perfetti CA, Hart L. The lexical quality hypothesis. In: Verhoeven L, Elbro C, Reitsma P, editors. Precursors of functional literacy. Amsterdam, England: J. Benjamins Publishing Company; 2002. p. 189-213.
  • 11
    Perfetti CA. Lexical quality revisited. In: Segers E, Broek P, editors, Developmental perspectives in written language and literacy: In honor of Ludo Verhoeven. Amsterdam, England: John Benjamins Publishing Company; 2017. p. 51-67.
  • 12
    Andrews S, Veldre A, Clarke IE. Measuring lexical quality: The role of spelling ability. Behavior Research Methods. 2020;52(6):2257-82. https://doi.org/10.3758/s13428-020-01387-3
    » https://doi.org/10.3758/s13428-020-01387-3
  • 13
    Taylor JN, Perfetti CA. Eye movements reveal readers' lexical quality and reading experience. Reading and Writing. 2016;29(6):1069-103. https://doi.org/10.1007/s11145-015-9616-6
    » https://doi.org/10.1007/s11145-015-9616-6
  • 14
    Andrews S, Hersch J. Lexical precision in skilled readers: Individual differences in masked neighbor priming. Journal of Experimental Psychology: General. 2010;139(2):299-318. https://doi.org/10.1037/a0018366
    » https://doi.org/10.1037/a0018366
  • 15
    Andrews S, Lo S. Not all skilled readers have cracked the code: Individual differences in masked form priming. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2012;38(1):152-63. https://doi.org/10.1037/a0024953
    » https://doi.org/10.1037/a0024953
  • 16
    Veldre A, Andrews S. Lexical quality and eye movements: Individual differences in the perceptual span of skilled adult readers. Quarterly Journal of Experimental Psychology. 2014;67(4):703-27. https://doi.org/10.1080/17470218.2013.826258
    » https://doi.org/10.1080/17470218.2013.826258
  • 17
    Veldre A, Andrews S. Parafoveal preview benefit is modulated by the precision of skilled readers' lexical representations. Journal of Experimental Psychology: Human Perception and Performance. 2015;41(1):219-32. https://doi.org/10.1037/xhp0000017
    » https://doi.org/10.1037/xhp0000017
  • 18
    Veldre A, Andrews S. Parafoveal preview effects depend on both preview plausibility and target predictability. Quarterly Journal of Experimental Psychology. 2018;71(1):64-74. https://doi.org/10.1080/17470218.2016.1247894
  • 19
    Veldre A, Drieghe D, Andrews S. Spelling ability selectively predicts the magnitude of disruption in unspaced text reading. Journal of Experimental Psychology: Human Perception and Performance. 2017;43(9):1612-28. https://doi.org/10.1037/xhp0000425
    » https://doi.org/10.1037/xhp0000425
  • 20
    Michelino MS, Macedo EC. Consciência fonológica, nomeação automática rápida e leitura em adultos analfabetos funcionais. CoDAS. 2021;33(1):e20190206. https://doi.org/10.1590/2317-1782/20202019206 PMID: 33886745.
    » https://doi.org/10.1590/2317-1782/20202019206
  • 21
    Dias NM, Mecca TP, de Oliveira PV, Pontes JM, de Macedo EC. Adult reading assessment tools: A psychometric study. Rev. CEFAC. 2016;18(5):1169-78. https://doi.org/10.1590/1982-0216201618523615
    » https://doi.org/10.1590/1982-0216201618523615
  • 22
    Castro FM, Rodrigues AS, Costa FLP da. Right to read: What we can learn from neurosciences to augment childhood and literacy policies? Educ Pesqui. 2023;49:e249518. https://doi.org/10.1590/S1678-4634202349249518eng
    » https://doi.org/10.1590/S1678-4634202349249518eng
  • 23
    Carnevale AP, Smith N. Balancing work and learning: Implications for low-income students [Webpage on the internet]. 2018. [accessed 2024 march 14]. Available at: https://cew.georgetown.edu/cew-reports/learnandearn/#resources
    » https://cew.georgetown.edu/cew-reports/learnandearn/#resources
  • 24
    Download - 10º Mapa do Ensino Superior - Instituto Semesp [Webpage on the internet]. Semesp. [accessed 2024 march 14]. Available at: https://www.semesp.org.br/mapa/edicao-10/download/
    » https://www.semesp.org.br/mapa/edicao-10/download/
  • A study conducted at the Universidade Federal do ABC, São Bernardo, São Paulo, Brazil and Universidade Federal do Ceará, Fortaleza, Ceara, Brazil.
  • This study was financed by Fundação de Amparo à Pesquisa do Estado de São Paulo, Finance Code 2020/15916-4.

Publication Dates

  • Publication in this collection
    08 July 2024
  • Date of issue
    2024

History

  • Received
    15 Sept 2023
  • Reviewed
    18 Nov 2023
  • Accepted
    10 Apr 2024
ABRAMO Associação Brasileira de Motricidade Orofacial Rua Uruguaiana, 516, Cep 13026-001 Campinas SP Brasil, Tel.: +55 19 3254-0342 - São Paulo - SP - Brazil
E-mail: revistacefac@cefac.br