Acessibilidade / Reportar erro

Psychometric validation of a tool that assesses safety culture in Primary Care

Abstract

Objective:

To analyze the reliability and validity of psychometric properties of the Brazilian version of the Survey on Patient Safety Culture in Primary Care.

Methods:

A quantitative cross-sectional study conducted with multidisciplinary team professionals working in Primary Health Care in a city in the Northwest region of Rio Grande do Sul State, Brazil. The tool used was “Pesquisa sobre Cultura de Segurança do Paciente para Atenção Primária à Saúde” (Survey on Patient Safety Culture in Primary Care).

Results:

Cronbach's alpha was considered satisfactory. Factorial analysis reached satisfactory loads in all its factors. The tool showed feasibility of application and potential structure assessment for which it is proposed.

Conclusion:

The Brazilian version of the questionnaire proved to be valid and reliable and could contribute to research on Patient Safety Culture in Primary Care in the country.

Keywords
Patient safety; Primary health care; Validation studies

Resumo

Objetivo:

Analisar a confiabilidade e validade das propriedades psicométricas da versão brasileira do instrumento para Pesquisa sobre Cultura de Segurança do Paciente para Atenção Primária à Saúde.

Métodos:

Estudo transversal quantitativo, realizado com profissionais da equipe multiprofissional atuantes na Atenção Primária à Saúde de um município da região noroeste do Estado do Rio Grande do Sul, Brasil. O instrumento utilizado foi “Pesquisa sobre Cultura de Segurança do Paciente para Atenção Primária à Saúde”.

Resultados:

O Alfa de Cronbach foi considerado satisfatório. A análise fatorial alcançou cargas satisfatórias no conjunto de seus fatores. O instrumento apresentou viabilidade de aplicação e potencial de avaliação da estrutura para a qual se propõe.

Conclusão:

A versão brasileira do questionário mostrou-se válida e confiável, podendo contribuir com pesquisas sobre a cultura de segurança do paciente na Atenção Primária à Saúde no país.

Descritores
Segurança do paciente; Atenção primária à saúde; Estudos de validação

Resumen

Objetivo:

Analizar la confiabilidad y validez de las propiedades psicométricas de la versión brasileña del instrumento “Encuesta sobre cultura de seguridad del paciente de Atención Primaria de Salud”.

Métodos:

Estudio transversal cuantitativo, realizado con profesionales del equipo multiprofesional que trabajan en la Atención Primaria de Salud de un municipio de la región noroeste del estado de Rio Grande do Sul, Brasil. El instrumento utilizado fue la “Encuesta sobre cultura de seguridad del paciente de Atención Primaria de Salud”.

Resultados:

El alfa de Cronbach fue considerado satisfactorio. El análisis factorial alcanzó cargas satisfactorias en el conjunto de sus factores. El instrumento presentó viabilidad de aplicación y potencial de evaluación de la estructura para la que se propone.

Conclusión:

La versión brasileña del cuestionario demostró ser válida y confiable, de esta forma puede contribuir con estudios sobre la cultura de seguridad del paciente en la Atención Primaria de Salud en el país.

Descriptores
Seguridad del paciente; Atención primaria de salud; Estudios de validación

Introduction

Currently, patient safety is recognized as free from harm or harm to both caregivers and assisted patients,(11. National Patient Safety Foundation (NPSF). Free from harm: accelerating patient safety improvement fifteen years after to err is human [Internet]. Boston, MA: NPFS; 2015. [cited 2018 Sep 22]. Available from: http://www.npsf.org/?page=freefromharm
http://www.npsf.org/?page=freefromharm...
) regarded as primary attribute for ensuring quality healthcare.(22. Reis CT, Martins M, Laguardia J. [Patient safety as a dimension of the quality of health care: a look at the literature]. Cien Saude Colet. 2013;18(7):2029-36. Portuguese.)

This theme has been the focus of discussion among leaders and managers from different countries, given the numerous Adverse Events (AEs) that occur during health care.(33. Gehring K, Schwappach DL, Battaglia M, Buff R, Huber F, Sauter P, et al. Safety climate and its association with office type and team involvement in primary care. Int J Qual Health Care. 2013;25(4):394–402.99. Romero MP. Gonz?lez RB, Calvo MS [Patient safety culture in Family practice residents of Galicia]. Aten Primaria. 2017;49(6):343–50. Spanish.) Discussions reflect organizations' efforts to adopt measures that enable coping and reduction of AEs, which are defined as incidents that result in damage when error reaches patients.(1010. World Health Organization (WHO). The Conceptual Framework for the International Classification for Patient Safety. Genève: World Health Organization; 2009.)

In health services there are conditions that involve increased risks of AEs. In Primary Health Care (PHC), this fact is related to the high demand of users affected by multiple chronic health conditions, with advanced age, polymedicated and living in socially vulnerable situation, thus representing a public health problem.(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.)

A pioneer study in Brazil, which measured incidents in 11,233 consultations at 13 Family Health Units (FHUs) in a microregion of Rio de Janeiro State identified 0.91% AEs, with prevalence of administrative errors, miscommunication, errors in treatment, performance of clinical and diagnostic tasks.(1212. Marchon SG, Mendes WV Jr, Pav?o AL. [Characteristics of adverse events in primary health care in Brazil]. Cad Saúde Pública. 2015; 31(11):1-16. Portuguese.)

A positive safety culture must be expressed in the services that make up the Health Care Network (RAS – Rede de Atenção à Saúde), with a view to reducing the occurrence of AEs and improving the safety climate, especially in PHC.(1313. Timm M, Rodrigues MC. Adaptação transcultural de instrumento de cultura de segurança para a Atenção Primária. Acta Paul Enferm. 2016;29(1):26–37.) PHC is understood as care coordinator of RAS, as well as a communicating center among health services.(1414. Brasil. Ministério da Saúde; Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Política Nacional de Atenção Básica. Brasília (DF): Ministério da Saúde; 2017. Disponível em: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html.
http://bvsms.saude.gov.br/bvs/saudelegis...
) Therefore, assessing patient safety culture in PHC is fundamental, as it allows identifying aspects that directly interfere with care provided to users.

In Brazil, so far, there are two validated tools that measure patient safety culture in PHC. There is the Safety Attitudes Questionnaire Ambulatory Version (SAQ-AV), created in 2007 in the United States of America (USA), translated and adapted for use in Brazil,(1515. Paese F, Dal Sasso GT. Cultura da segurança do paciente na atenção primária à saúde. Texto Contexto Enferm. 2013;22(2):302–10.); and the Survey on Patient Safety Culture in Primary Care, adapted and validated semantically for Brazil(1313. Timm M, Rodrigues MC. Adaptação transcultural de instrumento de cultura de segurança para a Atenção Primária. Acta Paul Enferm. 2016;29(1):26–37.) from the original MOSPSC, developed in the USA in 2007.(1616. Sorra J, Gray L, Famolaro T, Yount N, Behm J. AHRQ Medical Office Survey on Patient Safety Culture: User's Guide [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; June 2016. (AHRQ Publication No. 15(16)-0051-EF (Replaces 08(09)-0059). [cited 2018 Aug 13]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/medical-office/userguide/mosurveyguide.pdf
https://www.ahrq.gov/sites/default/files...
)

MOSPSC stands for Medical Office Survey on Patient Safety Culture, and has been translated, validated linguistically and psychometrically in Spain,(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.), Yemen,(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) and Portugal.(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.) In Brazil, the tool was translated, adapted and validated, with semantic analysis and assessment of item clarity and comprehension,(1313. Timm M, Rodrigues MC. Adaptação transcultural de instrumento de cultura de segurança para a Atenção Primária. Acta Paul Enferm. 2016;29(1):26–37.) making it necessary to perform psychometric validation.

A valid, reliable and consistent measurement tool for the measurement of safety culture in PHC provides relevant evidence to ensure the reliability of study results, assisting in the overall analysis, with support for establishing strategic planning for improvement. quality of services, as well as providing comparisons of national and international surveys.

Therefore, the objective of the study was to analyze reliability and validity of psychometric properties of the Brazilian version of the Survey on Patient Safety Culture in Primary Care.

Methods

A quantitative cross-sectional study conducted in 17 Family Health Units (FHUs), located in a municipality in Rio Grande do Sul State, Brazil. Data collection took place from December 2017 to April 2018. In the month prior to collection, FHUs had 228 professionals from the multidisciplinary team. Participants were selected by convenience sampling.

Inclusion criteria were being a professional of the multidisciplinary team that provided direct and indirect assistance to patient, working in the unit for at least 30 days and working at least 20 hours per week. This established time and workload allows employees to gain insight into individual and group values, attitudes, perceptions, and competencies that determine patient safety commitment and proficiency in the institution in which they operate.(1919. Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44.) The exclusion criteria were: being on sick leave or other type of leave during the data collection period.

After applying these criteria, 24 professionals were excluded because they were on maternity or health leave and 10 because they had not worked in the unit for at least 30 days, resulting in 194 professionals. Of these, six refused to participate. 188 professionals participated, including physicians, dentists, nurses, nursing assistants/technicians, community health agents, nutritionists, pharmacists, psychologists, physiotherapists, occupational therapists, dental assistants, social workers, physical educators and administrative assistants.

To perform data collection, initially, the researched institution was requested a list with the names of employees and their respective work shifts. Unit managers were contacted to define the best time and date to apply the questionnaire. Data collection was performed in the professionals' work environment by a researcher during the team meeting. All participants received information regarding the research, such as objective, justification, risks and benefits, as well as legal and ethical issues. After agreeing to participate, they received an envelope containing the questionnaire accompanied by the Free and Informed Consent Term (FICT), in two copies. Respondents privacy was assured.

The researcher remained in the room in order to answer questions, if any, and receive the questionnaire answered. The time taken by professionals to complete the questionnaire ranged from 20 to 45 minutes. The Brazilian version of the Survey on Patient Safety Culture in Primary Care, which assesses patient safety culture in PHC, was used as a tool.(1313. Timm M, Rodrigues MC. Adaptação transcultural de instrumento de cultura de segurança para a Atenção Primária. Acta Paul Enferm. 2016;29(1):26–37.)

The original tool consists of 51 questions that measure 12 dimensions of patient safety construct, which include Communication Openness, Communication About Error, Information Exchange with Other Institutions, Office Process and Standardization, Organizational Learning, Overall Perceptions of Patient Safety and Quality, Owner/Managing partner/Leadership Support for Patient Safety, Patient Care Tracking/Follow-up, Patient Safety Issues and Quality, Staff Training, Teamwork and Work Pressure and Pace.(1616. Sorra J, Gray L, Famolaro T, Yount N, Behm J. AHRQ Medical Office Survey on Patient Safety Culture: User's Guide [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; June 2016. (AHRQ Publication No. 15(16)-0051-EF (Replaces 08(09)-0059). [cited 2018 Aug 13]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/medical-office/userguide/mosurveyguide.pdf
https://www.ahrq.gov/sites/default/files...
) MOSPSC questionnaire was translated, adapted and semantic validated for Brazil, and the tool consisted of 12 constructs that measure patient safety culture.(1313. Timm M, Rodrigues MC. Adaptação transcultural de instrumento de cultura de segurança para a Atenção Primária. Acta Paul Enferm. 2016;29(1):26–37.)

To assess Patient Safety Culture in population in which the questionnaire was applied, a positive perception was considered as the dimension where Patient Safety Indicators (PSI) was> 3 and a clearly positive perception when PSI was ≥ 4.(99. Romero MP. Gonz?lez RB, Calvo MS [Patient safety culture in Family practice residents of Galicia]. Aten Primaria. 2017;49(6):343–50. Spanish.)

Data were organized in the Epi-Info® 6.04 program, with independent double entry. After correcting errors and inconsistencies, statistical analysis was performed using the Statistical Package for Social Sciences (SPSS®), version 18.0 for Windows. Categorical variables are expressed as absolute frequencies and proportions, and quantitative variables are described by measures of central tendency (mean or median) and dispersion (standard deviation or interquartile range) according to the normality distribution assessed by the KolmogorovSmirnov test.

To perform a comparative analysis of all dimensions that make up the questionnaire, the original response scale for sections A (Patient Safety and Quality Issues) and B (Information Exchange with Other Institutions), which have six response categories, was transformed into a rating scale 1 through 5, like the rest of the sections, by applying the Original Scale Assigned Score (PEO - Pontuação Atribuída na Escala Original) formula x (4/5) + 0.2. In this process, it was taken into account that the questionnaire used contains questions posed positively and others negatively. The reverse questions of the tool refer to items C3, C6, C8, C10, C12, C14, D4, D7, D10, E1, E2, E4, F3, F4 and F6. After these transformations, a specific synthesis score of each dimension was calculated by averaging the scores assigned to the questions that make up the corresponding dimension.

PSI was defined as the mean score of all questions that make up the 12 dimensions analyzed. In all cases, the range was 1 to 5. Relative frequencies of each question were calculated and the composite indicators of each dimension were measured by the following formula:(99. Romero MP. Gonz?lez RB, Calvo MS [Patient safety culture in Family practice residents of Galicia]. Aten Primaria. 2017;49(6):343–50. Spanish.)

Σ ( positive , neutral and negative ) answers in items of one dimension Number of total responses on items in one dimension

Internal consistency of the MOSPSC scale was investigated by Cronbach's alpha internal coefficient, calculated separately for each domain. In addition, the reverse items were adjusted for Cronbach's alpha calculation. To validate the tool, it was tested for its factorial structure, using the exploratory factor analysis technique by the main component method and a factorial analysis by the principal axis extraction method, Varimax rotation.

Research project was approved by the Research Ethics Committee, under the Opinion 2,413,567 of 4th December 2017, respecting all ethical standards recommended by Resolution 466/2012.

Results

The population surveyed for psychometric validation of the tool was mostly female (87.8%), with a predominant age of 31 to 50 years (58%). The most frequent educational levels were high school (42.8%) and graduate (31,6%). Work time periods prevailed in the unit of more than 11 years (27.8%) and from 6 to 10.9 years (25.1%). Regarding the hours worked per week, most professionals worked over 32 hours (91.0%).

The assessed health team generally had a positive perception regarding patient safety culture (PSI=3.64) in most domains, including: Patient Safety and Quality (4.12); Information Exchange with Other Institutions (4.11); Staff Training (3.40); Office Process and Standardization (3.64); Communication About Error (3.89); Owner/Managing partner/Leadership Support for Patient Safety (3.19); Organizational Learning (3.87); Overall Perceptions of Patient Safety and Quality (3.72); Overall Patient Safety Assessment (3.48); and Overall Quality Assessment (3.45) (Table 1).

Table 1
Mental tendency measures and variability for the Medical Office Survey on Patient Safety Culture (MOSPSC) domains

Considering the MOSPSC scale's original structure, consistency was investigated by Cronbach's alpha (αC). Estimates pointed to satisfactory reliability (αC≥0.700) in Patient Safety and Quality list (αC=0.848), Information Exchange with Other Institutions (αC=0.853), Owner/Managing partner/Leadership Support for Patient Safety (αC=0.703) and Overall Quality Assessment (αC=0.829) (Table 1).

Regarding acceptable reliability (0.600≤ αC <0.700), there were Teamwork (αC=0.603), Pressure and Work Pace (αC=0.683), Staff Training (αC=0.603), Communication Openness (αC=0.676), Patient Care Tracking/Follow-up (αC=0.660) and Overall Perceptions of Patient Safety and Quality (αC=0.620). Additionally, Office Process and Standardization (αC = 0.477) and Communication About Error (α=0.416) showed reliability below the acceptable minimum (Table 1).

For reliability analysis, the MOSPSC tool was tested for the factorial structure to identify item distribution in each domain, and it was similar to the preestablished structure. The MOSPSC scale showed significant adjustment represented by the Kais test (Kaiser-Meyer-Olkin) of 0.835 and the significant Bartlett sphericity test [c2(1596) = 1914.773; p<0.001], which attested to the possibility of performing the factor analysis. The anti-image matrix corroborates tool items' sample adequacy for the use of factor analysis, presenting all the high values in its diagonal, between 0.885 (in the variable “D11”) and 0.977 (in the variable “A2”), suggesting the inclusion of all variables for factor analysis.

The latent underlying criterion or eigenvalue was met, where only eigenvalues ≥ 1 were considered significant. The Guttman-Keiser criterion estimated that 14 latent variables should be extracted, where the first had an eigenvalue of 5.232, carrying about 9.386% variance, while in the last factor (F14) the eigenvalue was 1.235, which managed explain 2.551% of variance. The factorial model reached a 63,444% explained variance ratio (Table 2).

Table 2
Extraction of rotational matrix factors, eigenvalues and explained variance ratio for MOSPSC scale

In the information regarding the items that made up each of the latent variables, it was initially found that the commonalities had the lowest contribution to explain the factorial structure in item A10 (0.528), while the item that contributed the most was C11 (0.783).

According to the results in Table 2, Factor 1, responsible for the greatest explanatory power on the scale (9.386%), grouped “Patient Safety and Quality Issues”. These items made up the most important factor to explain the scale. Following, there is:

  • Factor 2 (7.695%): Overall Quality and Safety Assessment (G1A, G1B, G1C, G1D, G1E);

  • Factor 3 (5.316%): Communication Openness (D1, D2, D4, D10);

  • Factor 4 (5.167%): Office Process and Standardization (C8, C9, C12, C15);

  • Factor 5 (4.624%): Teamwork (C1, C2, C5, C13);

  • Factor 6 (4.502%): Work Pressure and Pace (C3, C6, C11, C14);

  • Factor 7 (4.281%): Information Exchange with Other Institutions (B1, B2, B3, B4);

  • Factor 8 (3.874%): Staff Training (C4, C7, C10);

  • Factor 9 (3.589%): Owner/Managing partner/ Leadership Support for Patient Safety (E1, E2, E3, E4);

  • Factor 10 (3.230%): Patient Care Tracking/ Follow-up (D3, D5, D6, D9);

  • Factor 11 (3.197%): Overall Patient Safety Assessment

  • Factor 12 (3.120%): Communication About Error (D7, D8, D11, D12);

  • Factor 13 (2.912%): Organizational Learning (F1, F5, F7);

  • Factor 14 (2.551%): Overall Perceptions of Patient Safety and Quality (F2, F3, F4, F6).

It is noteworthy that scale factors where there was compromised reliability estimated by Cronbach's alpha presented satisfactory factor loads in the set of their factors. Hence, the maintenance of these items will not compromise the scale results (Table 3).

Table 3
Varimax rotation factor analysis matrix and 14-factor Keiser normalization for the MOSPSC scale

Moreover, respecting the results obtained in the reliability and factorial validation of MOSPSC scale in this sample, there is evidence that the pre-established structure for this tool was reached. The tool showed feasibility of application and potential structure assessment for which it is proposed. Results were considered reliable due to the exploratory factor analysis model fit obtained through adequate free asymmetric distribution methods in order to estimate ordinal categorical items with nonparametric distribution.

Discussion

The tool was reliable and satisfactory for use in the Brazilian population, given its similarity to validation studies conducted in other countries.(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.,1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) It should be noted that, in the mentioned dimensions, the possibility of discarding items with low correlations would not significantly change the domains' alpha and the scale composition, which would go from 0.974 to 0.943 in the total scale composition, from 0.477 to 0.498 in the domain “Office Process and Standardization”, 0.416 to 0.663 in “Communication About Error”. Such changes are not justified because there is no way to guarantee that deleting the items would not impair content validity. (2020. Pasquali L, organizador. Técnicas de exame psicológico - TEP Manual, Fundamentos das técnicas psicológicas. São Paulo: Casa do Psicólogo; 2001.)

When compared with validation studies conducted in different countries, tool use with all components of the scale yielded no harm to the safety culture assessment. Cronbach's α values obtained are similar to those reported by the Agency for Health Research and Quality (AHRQ), in most dimensions, which are considered adequate.(2121. SOPS™ Medical Office Survey Items and Composites. Version 1.0. [Internet]. [cited 2019 Jul 3]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/sops/quality-patient-safety/patientsafetyculture/medofficeitemscompositesrevised.pdf
https://www.ahrq.gov/sites/default/files...
)

The adaptation of MOSPSC in Spain(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) obtained an overallα of 0.96. In this adaptation, questions were added and, when assessing a for each dimension, unsatisfactory value was obtained for Staff Training and Patient Care Tracking/Follow-up. When validating for the Arabic version,(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) α ranged from 0.20 to 0.70, and Information Exchange with Other Institutions and List of questions on patient safety and quality due to high non-response and non-response rates were excluded. applicability. Similar results were found in the validation to Portuguese,(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.) where α ranged from 0.52 to 0.88, and for the same reasons cited in the previous study both dimensions were excluded.

According to the results of the on-screen investigation, the factor responsible for the greatest explanatory power on the scale (9.386%) grouped Patient Safety and Quality Issues. In studies conducted in Yemen(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) and Portugal,(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.) this dimension was excluded by the high rate of non-response and non-applicability, contrary to the present study, which obtained 97% response rate. This high response rate is due to researcher availability to remain in the referred units. A study that assesses safety culture recommends that the maximum possible participation of professionals in safety culture assessments is obtained, because the higher the response rate, the more appropriate is its representation.(1616. Sorra J, Gray L, Famolaro T, Yount N, Behm J. AHRQ Medical Office Survey on Patient Safety Culture: User's Guide [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; June 2016. (AHRQ Publication No. 15(16)-0051-EF (Replaces 08(09)-0059). [cited 2018 Aug 13]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/medical-office/userguide/mosurveyguide.pdf
https://www.ahrq.gov/sites/default/files...
)

The second largest factor (7.695%) was the Overall Quality Assessment (G1A, G1B, G1C, G1D, G1E). In the Arabic validation study(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.), this domain also kept five questions, same as the original tool. In the Spanish version,(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) this dimension presents six questions, which included the question related to Overall Patient Safety Assessment (G2).

In the Spanish(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) and Arabic studies(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.), factor 3 (5,316%), Communication Openness (D1, D2, D4, D10) remained present and with the same questions as the original tool. Factor 4 (5.167%), which refers to the Office Process and Standardization (C8, C9, C12, C15), also remained with the same questions in the Arabic study.(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) However, in the Spanish validation(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) an issue has been incorporated into this dimension (C19).

The results for Factor 5 (4.624%) for Teamwork (C1, C2, C5, C13) and for Factor 6 (4.502%), Working Pressure and Rate (C3, C6, C11, C14) had no modified questions in the Spanish(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) and Arabic validation studies.(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.)

Information Exchange with Other Institutions (B1, B2, B3, B4) relates to factor 7 (4,281%). In Yemen(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) and Portugal validation studies,(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.) this dimension was excluded by the high rate of non-response and non-applicability. In the Spanish study,(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) this dimension had an excluded question (B5), which was contained in the original MOSPSC tool, which refers to a question that could be described by the respondent, specifying the contact sector.

Staff Training (C4, C7, C10) is identified as factor 8 (3.874%) of the scale. In the Spanish version,(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) this dimension had duplicate questions for assistant and non-assistant professionals and had added questions (C16, C17, C17, C19). In an Arabic study,(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) this domain remained with the same issues as the original tool. N these countries,(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.,1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) factor 9 (3.589%), Owner/Managing partner/Leadership Support for Patient Safety (E1, E2, E3, E4), and factor 10 (3.230%), Patient Care Tracking/Follow-up (D3, D5, D6, D9) did not have modified questions. Factor 11 (3,197%), related to G2 Overall Patient Safety Assessment, it was not separately measured in the other validation studies.(1111. Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.,1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.,1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.)

Communication About Error (D7, D8, D11, D12) relates to factor 12 (3.120%), and the Spanish study version(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) had questions incorporated in the factorial solution (D13, D14). In the Arabic version,(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.) the tool was kept with the same questions as the original tool. Finally, factor 13 (2.912%), referring to Organizational Learning (F1, F5, F7), and factor 14 (2.551%), referring Overall Perceptions of Patient Safety and Quality (F2, F3, F4, F6) had no modified questions in Spanish(1717. Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.) and Arabic validation studies.(1818. Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.)

This study shows that professionals interviewed had a positive safety culture. In organizations provided with a culture of positive security, this is through communication based on mutual trust, shared understandings of the importance of security, and confidence in preventive effectiveness measures.(1616. Sorra J, Gray L, Famolaro T, Yount N, Behm J. AHRQ Medical Office Survey on Patient Safety Culture: User's Guide [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; June 2016. (AHRQ Publication No. 15(16)-0051-EF (Replaces 08(09)-0059). [cited 2018 Aug 13]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/medical-office/userguide/mosurveyguide.pdf
https://www.ahrq.gov/sites/default/files...
) A positive safety culture means service leaders and managers work to ensure care is delivered safely and quality, using different tools to identify gaps and create safer health processes.(2222. Astier-Peña MP, Torijano-Casalengua ML, Olivera-Cañadas G, SilvestreBusto C, Agra-Varela Y, Maderuelo-Fernández JÁ. Are Spanish primary care professionals aware of patient safety? Eur J Public Health. 2015;25(5):781–7.)

This study was conducted in a city in Rio Grande do Sul State, which may be a limitation for results generalization. Nevertheless, the results obtained in this research contribute to the dissemination of knowledge on the subject, as there is still little data in the literature.

It is noteworthy that this study of psychometric validation is unprecedented in Brazil, setting as a starting point for future investigations that can be performed in other Brazilian regions.

Conclusion

The Survey on Patient Safety Culture in Primary Care presented valid and reliable psychometric properties when applied to a municipality in the southern Brazilian region. Patient safety culture was positive in most of the tool domains, except for Work Pressure and Pace. The obtained results are fundamental for the tool application in studies that intend to assess patient safety culture in PHC in different regions of the country. Future studies can be developed with a psychometrically validated tool for Brazil, in order to know the present safety culture, thus recommending tool validation with professionals from other places, expressing the work process culture for patient safety and quality in their microregional spaces.

Referências

  • 1
    National Patient Safety Foundation (NPSF). Free from harm: accelerating patient safety improvement fifteen years after to err is human [Internet]. Boston, MA: NPFS; 2015. [cited 2018 Sep 22]. Available from: http://www.npsf.org/?page=freefromharm
    » http://www.npsf.org/?page=freefromharm
  • 2
    Reis CT, Martins M, Laguardia J. [Patient safety as a dimension of the quality of health care: a look at the literature]. Cien Saude Colet. 2013;18(7):2029-36. Portuguese.
  • 3
    Gehring K, Schwappach DL, Battaglia M, Buff R, Huber F, Sauter P, et al. Safety climate and its association with office type and team involvement in primary care. Int J Qual Health Care. 2013;25(4):394–402.
  • 4
    Mendes CM, Barroso FF. [Promoting a culture of safety in primary health care]. Rev Port Saude Publica. 2014;32(2):197-205. Portuguese.
  • 5
    Cogollo RR, Alvarado IR, Flores TG, Villar JI, Ruiz SC. [Patient safety culture in family and community medicine residents in Aragon]. Rev Calid Asist. 2014;29(3):143–9. Spanish.
  • 6
    Parker D, Wensing M, Esmail A, Valderas JM. Measurement tools and process indicators of patient safety culture in primary care. A mixed methods study by the LINNEAUS collaboration on patient safety in primary care. Eur J Gen Pract. 2015;21(Suppl):26–30.
  • 7
    Pohlman KA, Carroll L, Hartling L, Tsuyuki R, Vohra S. Attitudes and opinions of doctors of chiropractic specializing in pediatric care toward patient safety: a cross-sectional survey. J Manip Physiol Ther. 2016;39(7):487-93.
  • 8
    Martinez W, Lehmann LS, Thomas EJ, Etchegaray JM, Shelburne JT, Hickson GB, et al. Speaking up about traditional and professionalism-related patient safety threats: a national survey of interns and residents. BMJ Qual Saf. 2017;26(11):869–80.
  • 9
    Romero MP. Gonz?lez RB, Calvo MS [Patient safety culture in Family practice residents of Galicia]. Aten Primaria. 2017;49(6):343–50. Spanish.
  • 10
    World Health Organization (WHO). The Conceptual Framework for the International Classification for Patient Safety. Genève: World Health Organization; 2009.
  • 11
    Ornelas MD, Pais D, Sousa P. Patient safety culture in portuguese primary health care. Qual Prim Care. 2016;24(5):214–8.
  • 12
    Marchon SG, Mendes WV Jr, Pav?o AL. [Characteristics of adverse events in primary health care in Brazil]. Cad Saúde Pública. 2015; 31(11):1-16. Portuguese.
  • 13
    Timm M, Rodrigues MC. Adaptação transcultural de instrumento de cultura de segurança para a Atenção Primária. Acta Paul Enferm. 2016;29(1):26–37.
  • 14
    Brasil. Ministério da Saúde; Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Política Nacional de Atenção Básica. Brasília (DF): Ministério da Saúde; 2017. Disponível em: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
    » http://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
  • 15
    Paese F, Dal Sasso GT. Cultura da segurança do paciente na atenção primária à saúde. Texto Contexto Enferm. 2013;22(2):302–10.
  • 16
    Sorra J, Gray L, Famolaro T, Yount N, Behm J. AHRQ Medical Office Survey on Patient Safety Culture: User's Guide [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; June 2016. (AHRQ Publication No. 15(16)-0051-EF (Replaces 08(09)-0059). [cited 2018 Aug 13]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/medical-office/userguide/mosurveyguide.pdf
    » https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/medical-office/userguide/mosurveyguide.pdf
  • 17
    Casalengua ML, Olivera-Cañadas G, Astier-Peña MP, MaderueloFernández JÁ, Silvestre-Busto C. [Validation of a questionnaire to assess patient safety culture in spanish primary health care professionals]. Aten Primaria. 2013;45(1):21–37. Spanish.
  • 18
    Webair HH, Al-Assani SS, Al-Haddad RH, Al-Shaeeb WH, Bin Selm MA, Alyamani AS. Assessment of patient safety culture in primary care setting, Al-Mukala, Yemen. BMC Fam Pract. 2015;16:136.
  • 19
    Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44.
  • 20
    Pasquali L, organizador. Técnicas de exame psicológico - TEP Manual, Fundamentos das técnicas psicológicas. São Paulo: Casa do Psicólogo; 2001.
  • 21
    SOPS™ Medical Office Survey Items and Composites. Version 1.0. [Internet]. [cited 2019 Jul 3]. Available from: https://www.ahrq.gov/sites/default/files/wysiwyg/sops/quality-patient-safety/patientsafetyculture/medofficeitemscompositesrevised.pdf
    » https://www.ahrq.gov/sites/default/files/wysiwyg/sops/quality-patient-safety/patientsafetyculture/medofficeitemscompositesrevised.pdf
  • 22
    Astier-Peña MP, Torijano-Casalengua ML, Olivera-Cañadas G, SilvestreBusto C, Agra-Varela Y, Maderuelo-Fernández JÁ. Are Spanish primary care professionals aware of patient safety? Eur J Public Health. 2015;25(5):781–7.

Publication Dates

  • Publication in this collection
    02 Dec 2019
  • Date of issue
    Nov-Dec 2019

History

  • Received
    19 Jan 2019
  • Accepted
    11 July 2019
Escola Paulista de Enfermagem, Universidade Federal de São Paulo R. Napoleão de Barros, 754, 04024-002 São Paulo - SP/Brasil, Tel./Fax: (55 11) 5576 4430 - São Paulo - SP - Brazil
E-mail: actapaulista@unifesp.br