Validity and reliability of the Brazilian Primary Care Assessment Tool: Oral Health of Adults

Validade e confiabilidade da Ferramenta Brasileira de Avaliação da Atenção Básica: Saúde Bucal de Adultos

ABSTRACT:

Objective:   To test the factorial validity and reliability of the Primary Care Assessment Tool adapted to Oral Health, adult patient version, an instrument used to verify the presence and extent of attributes in Primary Health Care services.

Methods:   Population-based cross-sectional study using conglomerate random sample carried out in Primary Health Care Dental services in Porto Alegre between 2011 and 2013. We interviewed 407 adult patients who used Primary Health Care Dental services. Construct validity was tested through factorial validity and reliability of the Primary Care Assessment Tool, that comprises 81 items distributed throughout Primary Health Care attributes. Equamax orthogonal rotation method was used in the factorial analysis; and, in order to assess reliability of each component, we used the item-total correlation and the ratio of success of the scale.

Results:   In the factorial analysis, 10 factors were retained, explaining 53.3% of the total variation. This result demonstrates the multidimensional structure of the instrument. The reliability assessment showed Cronbach’s alpha values ranging from 0.39 to 0.89. For the success of the scale most of the results (eight of nine attributes) were greater than 85%.

Conclusions:   The instrument is valid for the assessment of oral health services in Primary Health Care from the perspective of adult patients, as well as for monitoring and evaluation of oral health services in Primary Health Care attributes and comparative studies.

Keywords: Primary health care; Oral health; Health services evaluation; Dental health services

RESUMO:

Objetivo:   Testar a validade fatorial e a confiabilidade do Instrumento de Avaliação da Atenção Básica (Primary Care Assessment Tool - PCATool) adaptado à Saúde Bucal, versão do paciente adulto, que é um instrumento utilizado para verificar a presença e a extensão de atributos nos serviços de Atenção Primária à Saúde.

Métodos:   Estudo transversal de base populacional, utilizando amostra aleatória de conglomerados realizada nos serviços de Atenção Primária à Saúde Bucal de Porto Alegre entre 2011 e 2013. Foram entrevistados 407 pacientes adultos que utilizavam os serviços de saúde bucal da Atenção Primária à Saúde. A validade de construto foi testada por meio da validade fatorial e confiabilidade do PCATool, que compreende 81 itens distribuídos pelos atributos da Atenção Primária à Saúde. O método de rotação ortogonal Equamax foi utilizado na análise fatorial e, para avaliar a confiabilidade de cada componente, foi utilizada a correlação item-total e a razão de sucesso da escala.

Resultados:   Na análise fatorial, foram retidos 10 fatores, explicando 53,3% da variação total. Esse resultado demonstra a estrutura multidimensional do instrumento. A avaliação da confiabilidade mostrou valores de alfa de Cronbach variando de 0,39 a 0,89. Para a razão de sucesso da escala, a maioria dos resultados (oito de nove atributos) foi superior a 85%.

Conclusão:   O instrumento é válido para a avaliação dos serviços de saúde bucal na Atenção Primária à Saúde na perspectiva de pacientes adultos, bem como para o monitoramento e a avaliação dos atributos dos serviços de saúde bucal na Atenção Primária à Saúde e estudos comparativos.

Palavras-chave: Atenção primária a saúde; Saúde bucal; Pesquisa sobre serviços de saúde; Serviços de saúde bucal

INTRODUCTION

Primary Health Care is the first level of any health system. It is defined by its core attributes: “First contact access”, “Continuity”, “Comprehensiveness” and “Coordination of care”, and ancillary domains: “Family-centeredness”, “Community orientation” and “Cultural competence”¹. Even though these are closely related to the practice of services, such attributes can be assessed separately². Therefore, a primary care service is best assessed, in the quality of a primary care provider, when it presents the four core attributes and improves its capability of interaction with families and communities while also showing the ancillary domains².

The attributes of Primary Health Care are acknowledged in international literature as the structuring axes of Primary Health Care, being associated with the quality of services³, effectiveness⁴, and efficiency⁵ of their interventions. An instrument that measures their presence and extension, which is the general version of Primary Care Assessment Tool, was developed^6,7, with versions for adults, children, health professionals and managers⁸. The general version of Primary Care Assessment Tool is an instrument capable of assessing the quality of primary care provided, based on the measurement of the range of the Primary Health Care attributes, hence producing a score for each attribute, a score for core attributes, and a general score on the quality of care. It is useful to make a comparative assessment of the degree of success of services when it comes to achieving excellence in the practice of Primary Health Care.

In Brazil, the versions for adult patients, the longer⁹ and shorter ones¹⁰, for children² and health professionals¹¹ have been translated, adapted and validated. Some countries offer oral health care as part of their primary care systems, including the United Kingdom and Brazil^12,13. In Brazil, one of the strategies used for the restructuring of health assistance was the Family Health Program, currently known as Family Health Strategy¹⁴. From 2000 onwards, Oral Health Teams comprising a dentist and an dental assistant, with or without the presence of an dental technician, were included as part of the Family Health Strategy, consolidating oral health care for the population in the Primary Health Care setting¹⁵.

The first Oral Health Teams were implemented in March 2001 in 32 municipalities and, in July 2015, 24,444 Oral Health Teams were part of the Family Health Strategy, covering 38% of the population of the country¹⁶. Even though the number of cities covered by Oral Health Teams has increased noticeably, there was an absence of studies in the literature or validated instruments to assess the presence and extent of Primary Health Care attributes in these dental health services¹⁷. The objective of this study was to test the factorial validity, internal consistency and reliability of the Primary Care Assessment Tool adapted to Oral Health, adult patient version, an instrument used to verify the presence and extent of attributes in Primary Health Care services.

METHODS

DESIGN AND CONTEXT

A population-based cross-sectional study with adults assigned to Primary Health Care services who were users of Primary Care Dentistry in Porto Alegre, Rio Grande do Sul, Brazil, was carried out between October 2011 and May 2013. Primary Care Dentistry Services works under different organizational approaches in Porto Alegre: Family Health Strategy, Traditional Primary Health Services and Primary Health Care Services of the Grupo Hospitalar Conceição.

PARTICIPANTS

We interviewed adult patients (18 years of age or more), users of Primary Care Dentistry Services, that used the service at least once during the 24 months prior to the study. Patients who reported never having used the Primary Health Care service for dental appointments, were excluded.

SAMPLE

A conglomerate random sample was used. The first step was to define the Health Units of the three types of service that would participate in the study. The inclusion criteria used were having an Oral Health Team with a dentist and dental assistant or with a dentist, a dental assistant and a dental technician in the service for at least two years; have a dental office in the service, and the dentist working full time in the service. From all the Primary Health Care services in Porto Alegre, only five of the Family Health Strategy met the inclusion criteria and were automatically included. Of the 78 Traditional Health Services and 11 Primary Health Care Services of the Grupo Hospitalar Conceição that met the inclusion criteria, 5 of each were drawn, using a list that was randomly generated on the computer. During data collection, one dentist working in a Family Health Strategy was relocated and the service was removed and replaced by Primary Health Care Services of the Grupo Hospitalar Conceição service selected randomly.

Then, based on the maps of the territories assigned to the services, census tracts were drawn. Within each census sector, homes were drawn, with a random start, and a patient who fulfilled the inclusion criteria was interviewed. If there was more than one adult who met the inclusion criteria, one of them was drawn. In order to achieve the goals of validation, the sample was estimated at 405 individuals (5 respondents per item of the Primary Care Assessment Tool)⁸.

Throughout the data collection period, there was an attempt to contact 1,943 homes. Of these, 81 were visited 3 times and no one was found at home, 6 refused to participate and 1,449 had never accessed Primary Health Care services for dental care. Thus, the total sample comprised 407 individuals interviewed.

VARIABLES AND SOURCES OF DATA/MEASUREMENT

The interviews were conducted, as part of home visits, by 17 properly trained dental students, aged between 20 and 25 years, using a structured questionnaire. In order to assess the training, a pilot field trip was held, in pairs, in which one researcher applied the questionnaire to a patient, while the other was assessing him. Data from the pilot study were not used.

The adult patients general version of Primary Care Assessment Tool⁸ comprises 87 items distributed throughout core domains (“First contact access”, “Continuity”, “Comprehensiveness” and “Coordination of care”) and ancillary domains (“Family-centeredness” and “Community orientation”), in addition to items of “Affiliation with the Health Service”. It was initially developed to measure the presence and extension of Primary Health Care services attributes. The answers to the items are presented in Likert-like scales, with values that vary from 1 = “certainly not” to 4 = “absolutely”, and the option 9 = “I don’t know/don’t remember”. Based on these responses, it becomes possible to calculate a score for each attribute of Primary Health Care, a score for core attributes and an overall score¹⁸. The items of the attribute cultural competence were not included in this study, since it has not been validated in Brazil on the versions for adult patients, children and health professionals.

The score for the attributes is the average of the scores of the core attributes and the degree of affiliation to the service. The overall score, in addition to these, includes the ancillary domains. The values of the scores are standardized to fit into a scale that ranges from 0 to 10. A high score is regarded as one whose value is equal or greater than 6.6⁶.

ADAPTATION OF THE PRIMARY CARE ASSESSMENT TOOL: ADULT PATIENT, ORAL HEALTH VERSION

As a basis for the adaptation of the attributes “First contact access”, “Continuity”, “Coordination of care”, “Family-centeredness” and “Community orientation”, a mirror of the general version of Primary Care Assessment Tool Brazil was used, changing the term “doctor/nurse” by “dentist/dental service”. The only exception was the attribute “Comprehensiveness”, since this is referent to the range of services available, and these are different and specific to the field of oral health. To address the need for the assessment of the presence and extension of the attributes of Primary Health Care, also with regard to “Comprehensiveness” in Oral Health, version for patients, this attribute was adapted by Fontanive¹⁹.

For the adaptation of the “Comprehensiveness” in Oral Health, version for patients, Delphi Technique²⁰ was used to reach a consensus among experts (36 dentists who work in different areas of Primary Health Care, assistance, research and management) of the five regions of the Brazil considering which items should be taken regarding “Comprehensiveness” in Oral Health Care. This methodology consists of, a systematic and repetitive process that differs from the collective methods of consensus, which use a face-to-face interaction, decreasing the effect of contamination between participants and providing feedback based on the statistics generated in each round of participation. It took a total of 5 rounds to achieve the stability of the 35 items that are part of the attribute¹⁹. The extension of “Comprehensiveness” ended up with 26 items in the subdimension “Available Services” and 9 items in the subdimension “Services Provided”. The adaptation of the instrument comprised 81 items distributed in the 9 subscales attributes of Primary Health Care, plus the questionnaire of affiliation to the service (three items).

STATISTICAL ANALYSIS

To check the factorial validity, an exploratory factorial analysis with extraction of the main components was carried out using the Equamax orthogonal rotation method. A factorial load of 0.35 was considered as minimally acceptable²¹. The theoretical distribution of the items in the attributes (or components) of Primary Dental Care was contemplated in the definition when establishing the factorial loads.

The reliability of this instrument was observed using the internal consistency and the ratio of success of the scale. In order to assess internal consistency of each component, the item-total correlation was used, with items with a value above 0.30 being considered adequate and Cronbach’s alpha coefficient, equal to or greater than 0.70²¹. Regarding the ratio of success of the scale, we verified the proportion between the number of times that correlations between the items of an attribute were higher than the correlations of each of those items with other attributes, and the total of correlations carried in this attribute. High values for this measurement indicate a greater discrimination of the attribute. The data analysis for this paper was carried out using SAS software. Copyright^©2009, SAS Institute Inc. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc., Cary, NC, USA.

ETHICAL ASPECTS

This study was approved by the Ethics Committee of the Municipal Government of Porto Alegre and of the Grupo Hospitalar Conceição, Register: 554, Number: 001.043203.10.8. The interviews with the patients of the services were carried out after reading and signing the Informed Consent Form (ICF) and were performed according to the ethical principles established in the Declaration of Helsinki and Brazilian legislation.

RESULTS

The sample comprised 407 individuals interviewed in the areas assigned to Primary Health Care services of Porto Alegre (four Family Health Strategy, five Traditional Primary Health Services and six Primary Health Care Services of the Grupo Hospitalar Conceição) who reported as their preferred health service or professional of reference one of these services/professionals providers of Primary Dental Care. In relation to the access Primary Health Care services for dental care, 23.3% (n = 95) of the users reported Family Health Strategy; 37.1%, Primary Health Care Services of the Grupo Hospitalar Conceição (n = 151); and 39.6% (n = 161) reported that they used Traditional Health Services.

In relation to internal consistency, taken into account the item-total correlation, the attribute “First contact access - Accessibility” showed correlation values below the ones considered adequate for the items: about phone support when the service is closed, on the care provided by someone from the service during the weekends or at night, about a waiting time greater than 30 minutes to be seen by the dentist, and about having to be absent from work or school to go to a health service (Supplementary Table 1).

For the attribute “Continuity”, questions related to the care provided by the same dentist at all times and advise by phone provided by the dentist had correlation values below the ones considered adequate. The three items of the Coordination - Information systems - the items on tooth restoration, tooth extraction and application of fluoride -in the attribute “Comprehensiveness - Available services” and the dental examination for “Comprehensiveness - services provided” also presented the correlation values below the ones considered adequate. On the other hand, for the components “First Contact Access - Utilization”, “Coordination of care”, “Family-centeredness” and “Community Orientation”, all items showed proper correlation values (Supplementary Table 1). Three items were excluded after the factorial analysis, for the attribute “Comprehensiveness - Available services”, because they didn’t present an adequate value correlation. The factor loadings for each item are presented in Supplementary Table 1.

In the factorial analysis, 10 factors were retained explaining 53,3% of the total variation (Table 1). These factors accounted for more homogeneous attributes, which allow the measurement of the presence and extent of Primary Health Care (Table 1). Moreover, the internal consistency, using as a parameter the Cronbach’s alpha coefficient, presented an insufficient coefficient value that was observed for the Coordination-Information Systems (alpha = 0.39) and moderate for Family-centeredness (alpha = 0.58); on the other hand, all others attributes presented an adequate Cronbach’s alpha coefficient (Table 2). For the ratio of the success of the scale, all results were greater than 85%, with the exception of the component “Coordination - Information Systems” (ratio of success of the scale = 56%) (Table 2).

Table 1.
Distribution of items and explained variation of attributes in factors obtained by factorial analysis.

Factor	Number of items	Primary Health Care attributes	Variation explained (%)	Variation explained accumulated (%)
1	12	First contact access - Utilization Continuity	6.55	6.55
2	9	Coordination Comprehensiveness	6.44	12.00
3	13	Comprehensiveness - Available services	6.397	19.38
4	10	First contact access - Accessibility Community orientation	6.20	25.58
5	10	Comprehensiveness - Provided services Family-centeredness	5.71	31.30
6	3	Comprehensiveness - Available services	5.62	39.91
7	7	First contact access - Accessibility Comprehensiveness - Available services	5.14	42.05
8	4	Continuity Coordination - Information Systems	4.62	46.67
9	5	First contact access - Accessibility Coordination - Information Systems	4.41	51.07
10	7	Comprehensiveness - Available services Comprehensiveness - Provided services	4.25	53.33

Table 2.
Reliability measures for the seven attributes of Primary Care Assessment Tool - Oral Health Brazil.

Primary Health Care attributes	Cronbach’s alpha	Ratio of success of the scale (%)
First contact access - Utilization	0.72	100
First contact access - Accessibility	0.71	93
Continuity	0.81	94
Coordination	0.89	100
Coordination - Information Systems	0.39	56
Comprehensiveness - Available services	0.89	96
Comprehensiveness - Provided services	0.80	99
Family-centeredness	0.58	85
Community orientation	0.80	100

DISCUSSION

This study addressed the validity and reliability of the Primary Care Assessment Tool - Brazil - Adult Oral Health version, in Primary Health Care services of the municipality of Porto Alegre. The results show that the instrument was capable of measuring the presence and extent of the attributes of Primary Health Care, hence being able to evaluate the quality of services. The attributes of Primary Health Care were retained in the Adult Oral Health version of the instrument, therefore representing the first developed and validated instrument, and one that allows an evaluation of the degree and presence of its attributes. The use of this scale may represent an extremely valuable instrument, both for evaluative research and for the organization of dental health services in the context of Primary Health Care.

Regarding the factorial validity, its 6 attributes were captured by 10 factors, hence identifying the multidimensional nature of the construct. This phenomenon is also found in the versions for adult patients, children and health care professionals of the general version of Primary Care Assessment Tool validated in Brazil^2,9,11. The attribute “First contact access” was captured by factor 1, which also retained items of the attribute “Continuity”, and, in turn, the attribute “Continuity” also had its items found in factor 8, which also captured some items of the attribute “Coordination”. Such interrelationship of items obtained from different attributes, retained by common factors, proves that the complex and dynamic nature of the services of Primary Health Care is represented by the instrument, since, according to the concept of Primary Health Care, the attributes can be didactically divided, but are closely related to the practice of services¹¹. 

In relation to the three items that were excluded after the factorial analysis, for the attribute “Comprehensiveness - Available services”, the item “emergency care in cases of ­pain/­bleeding or trauma/accident” is actually an item that represents the access to the service. The other, “Advice on nutrition and diet”, is represented by the item “Guidelines on habits that can be harmful to the mouth and teeth”, present in the attribute “Comprehensiveness - Services provided”. Lastly, the item “treatment and guidelines on oral health for disabled patients” was also excluded since Primary Health Care services provide universal access and cases of serious disability, which cannot be treated by the Primary Health Care, should be referred to Specialized Dental Care Services¹⁵.

The results provided by the analysis of reliability indicate a consistency of the attributes “First contact access”, “Continuity”, “Comprehensiveness” and “Community Orientation”. On the other hand, internal consistency was regarded as moderate for “Family-centeredness” and insufficient for “Coordination”. Nonetheless, a decision was made to keep the items, since they represent the concept of Primary Health Care of Starfield¹, and to maintain the comparability with other versions of Primary Care Assessment Tool. The results of the ratio of success of the scale indicate that each item is properly allocated in its conceptual attribute, given that they are more related to the items of their original component than to those of other attributes, hence confirming the reliability of the instrument.

The general adult version of Primary Care Assessment Tool is a Primary Health Care evaluation tool already used in many countries, such as Canada²², China²³, Argentina²⁴, the United States⁶, Hong Kong²⁵, among others. Different versions are developed to contribute to its use in the local management of services²⁶. A study that utilized the general adult version of Primary Care Assessment Tool to assess the impact of the general practitioner team service in community health centers found that primary care policies, which include the attributes of Primary Health Care, coordinating care and long-term provider-patient relationships, could contribute to improving the quality of care in Primary Health Care²⁷.

A recent study, using the general version of Primary Care Assessment Tool for adults users and dental professionals from two public oral health services in primary care setting, found better scores ascribed to Primary Health Care attributes in the Family Health Strategy model, both among users and dentists in comparison to “conventional” healthcare services¹⁷. However, it is important to highlight that this study used the general Primary Care Assessment Tool with questions related to physician and nurse care, and not to dental care as proposed in the current study. Considering this, the validation of the instrument Primary Care Assessment Tool - Oral Health of Adults provides a tool that contemplates several aspects of oral health care and from its results can contribute to the orientation and elaboration of oral health public policies aimed at the organization and improvements in the performance of oral health in the Primary Health Care setting.

The Primary Care Assessment Tool - Oral Health of Adults captured the key attributes of Primary Health Care in oral health services and presented acceptable measures of validity and reliability, regarding the experience of adult users. It can be helpful to managers, since it emphasizes the weaknesses in the presence and extension of attributes, allowing them to take proper measures to qualify the services of oral health care in Primary Health Care.

REFERENCES

• ¹ Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: UNESCO; Ministério da Saúde; 2002. 726 p.
• ² Harzheim E, Starfield B, Rajmil L, Alvarez-Dardet C, Stein AT. Internal consistency and reliability of Primary Care Assessment Tool (PCATool-Brasil) for child health services. Cad Saúde Pública 2006; 22(8): 1649-59.
• ³ Shi L, Starfield B, Politzer R, Regan J. Primary care, self-rated health, and reductions in social disparities in health. Health Serv Res 2002; 37(3): 529-50. https://doi.org/10.1111/1475-6773.t01-1-00036
  » https://doi.org/https://doi.org/10.1111/1475-6773.t01-1-00036
• ⁴ Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy 2002; 60(3): 201-18. https://doi.org/10.1016/s0168-8510(01)00208-1
  » https://doi.org/https://doi.org/10.1016/s0168-8510(01)00208-1
• ⁵ Macinko J, Starfield B, Shi L. The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970-1998. Health Serv Res 2003; 38(3): 831-65. https://doi.org/10.1111/1475-6773.00149
  » https://doi.org/https://doi.org/10.1111/1475-6773.00149
• ⁶ Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pr 2001; 50(2): 161-75.
• ⁷ Cassady CE, Starfield B, Hurtado MP, Berk RA, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4 Pt. 2): 998-1003.
• ⁸ Brasil. Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasília: Ministério da Saúde; 2010. 80 p.
• ⁹ Harzheim E, Duncan BB, Stein AT, Cunha CRH, Goncalves MR, Trindade TG, et al. Quality and effectiveness of different approaches to primary care delivery in Brazil. BMC Health Serv Res 2006; 6: 156. https://dx.doi.org/10.1186%2F1472-6963-6-156
  » https://doi.org/https://dx.doi.org/10.1186%2F1472-6963-6-156
• ¹⁰ de Oliveira MMC, Harzheim E, Riboldi J, Duncan BB. PCATool-ADULT-BRAZIL: a reduced version. Rev Bras Med Fam Comunidade 2013; 8(29): 256-63. https://doi.org/10.5712/rbmfc8(29)823
  » https://doi.org/https://doi.org/10.5712/rbmfc8(29)823
• ¹¹ Hauser L, de Castro RCL, Vigo Á, da Trindade TG, Gonçalves MR, Stein AT, et al. Translation, adaptation, validity and reliability of the Instrument for Assessment of Primary Health Care (PCATool) in Brazil: version of health professionals. Rev Bras Med Fam Comunidade 2013; 8(29): 244-55. http://dx.doi.org/10.5712/rbmfc8(29)821
  » https://doi.org/http://dx.doi.org/10.5712/rbmfc8(29)821
• ¹² National Health Service. The Future Oral and Dental Workforce for England. England: Health Education England; 2019. 80 p.
• ¹³ Brasil. A Saúde Bucal no Sistema Único de Saúde. Brasília: Ministério da Saúde ; 2018. 354 p.
• ¹⁴ Brasil. Política Nacional de Atenção Básica. Brasília: Ministério da Saúde, Secretaria de Atenção à Saúde, Departamento de Atenção Básica; 2012.
• ¹⁵ Brasil. Diretrizes da Política Nacional de Saúde Bucal. Brasília: Ministério da Saúde ; 2004.
• ¹⁶ Brasil. Sala de Apoio à Gestão Estratégica [Internet]. Ministério da Saúde; 2015 [cited on Sept. 1, 2015]. Available from: Available from: http://sage.saude.gov.br/#
  » http://sage.saude.gov.br/#
• ¹⁷ Nascimento AC, Moysés ST, Werneck RI, Gabardo MCL, Moysés SJ. Assessment of public oral healthcare services in Curitiba, Brazil: a cross-sectional study using the Primary Care Assessment Tool (PCATool). BMJ Open 2019; 9: e023283. http://doi.org/10.1136/bmjopen-2018-023283
  » https://doi.org/http://doi.org/10.1136/bmjopen-2018-023283
• ¹⁸ Harzheim E, de Oliveira MMC, Agostinho MR, Hauser L, Stein AT, Gonçalves MR, et al. Validation of the Primary Care Assessment Tool: PCATool-Brazil for adults. Rev Bras Med Fam Comunidade 2013; 8(29): 274-84. https://doi.org/10.5712/rbmfc8(29)829
  » https://doi.org/https://doi.org/10.5712/rbmfc8(29)829
• ¹⁹ Fontanive LT. Adaptação Instrumento Primary Care Assesment Tool - Brasil Versão Usuário Dirigido à Saúde Bucal [dissertation]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2011.
• ²⁰ Balasubramanian R, Agarwal D. Delphi technique-A review. Int J Public Heal Dent 2012; 3(2): 16-25.
• ²¹ Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Multivariate Data Analysis. 6ª ed. Porto Alegre: Bookman; 2009.
• ²² Carroll JC, Talbot Y, Permaul J, Tobin A, Moineddin R, Blaine S, et al. Academic family health teams: Part 1: patient perceptions of core primary care domains. Can Fam Physician 2016; 62(1): e23-e30.
• ²³ Wei X, Li H, Yang N, Wong SYS, Owolabi O, Xu J, et al. Comparing quality of public primary care between Hong Kong and Shanghai using validated patient assessment tools. PLoS One 2015; 10(3): e0121269. https://doi.org/10.1371/journal.pone.0121269
  » https://doi.org/https://doi.org/10.1371/journal.pone.0121269
• ²⁴ Berra S, Hauser L, Audisio Y, Mántaras J, Nicora V, de Oliveira MMC, et al. Validez y fiabilidad de la versión argentina del PCAT-AE para evaluar la atención primaria de salud. Rev Panam Salud Publica 2013; 33(1): 30-9.
• ²⁵ Wong SYS, Kung K, Griffiths SM, Carthy T, Wong MCS, Lo SV, et al. Comparison of primary care experiences among adults in general outpatient clinics and private general practice clinics in Hong Kong. BMC Public Health 2010; 10: 397. https://doi.org/10.1186/1471-2458-10-397
  » https://doi.org/https://doi.org/10.1186/1471-2458-10-397
• ²⁶ D’Avila OP, Pinto LF da S, Hauser L, Goncalves MR, Harzheim E. The use of the Primary Care Assessment Tool (PCAT): an integrative review and proposed update. Ciên Saúde Coletiva 2017; 22(3): 855-65. https://doi.org/10.1590/1413-81232017223.03312016
  » https://doi.org/https://doi.org/10.1590/1413-81232017223.03312016
• ²⁷ Yin J, Wei X, Li H, Jiang Y, Mao C. Assessing the impact of general practitioner team service on perceived quality of care among patients with non-communicable diseases in China: a natural experimental study. Int J Qual Heal Care 2016; 28(5): 554-60. https://doi.org/10.1093/intqhc/mzw075
  » https://doi.org/https://doi.org/10.1093/intqhc/mzw075

• Financial support: Fundação de Amparo à Pesquisa do Estado do Rio Grande do Sul (FAPERGS).

Publication Dates

• Publication in this collection
  06 July 2020
• Date of issue
  2020

History

• Received
  11 Jan 2019
• Reviewed
  30 Jan 2020
• Accepted
  20 May 2020