Acessibilidade / Reportar erro

Population-based study of the epidemiology of diagnostic test ordering

Abstracts

OBJECTIVE: To identify type of service, frequency, and individual patient determinants associated with diagnostic test ordering in medical appointments. METHODS: A population-based study included 3,100 adults aged 20 years or older, living in the city of Pelotas, Southern Brazil. Sampling was carried out in multiple stages. Information were collected by means of a questionnaire, administered between October and December 2003. Multivariate analyses were carried out using Poisson Regression, based on a conceptual model. A sub-study was also conducted based on the test requests received during one workday in all laboratories in the city processing requests from both the public and private sectors. RESULTS: Fifty-five percent of subjects reported having had medical appointments during the three-month period investigated. Of these, 60% reported more than one appointment, generating a total 4,167 appointments, most of which were paid for by health plans (38%). Diagnostic test were requested in 55% of appointments. Women and diabetic patients were more likely to have tests ordered. The greater the age (p<0.001) the higher the socioeconomic level (p=0.04), and the number of medical appointments (p<0.001), the greater the proportion of appointments leading to test requests. Mean waiting time between test request and sample collection was six days for the private sector and 21 days for the public sector (p<0.001). The mean number of tests per request was 4.4. CONCLUSIONS: The proportion of appointments leading to the request for some type of diagnostic test was in accordance with Brazilian recommendations. The waiting time before sample collection indicates an excessive number of tests per request and/or insufficient financial resources to fulfill the demand for tests.

Diagnostics services; Diagnostics tests, routine; Health services; Medical examination


OBJETIVO: Identificar os tipos de serviços de saúde utilizados, a freqüência e os determinantes individuais do paciente associados à solicitação de exames complementares em consultas médicas. MÉTODOS: Estudo de base populacional com 3.100 adultos com idade igual ou maior a 20 anos, moradores de Pelotas, RS. A amostragem foi feita em múltiplos estágios. As informações foram coletadas por meio de questionário, de outubro a dezembro de 2003. Análises multivariadas foram realizadas pela regressão de Poisson, baseadas em modelo conceitual. Foi realizado um subestudo, com as requisições de exames de um dia de trabalho, nos laboratórios da cidade que atendessem o setor privado e público. RESULTADOS: Em três meses, 55% dos indivíduos tiveram consulta médica. Destes, 60% tiveram mais que uma consulta, num total de 4.167, sendo a maior proporção realizada por meio de convênios ou planos de saúde (38%). A solicitação de algum exame ocorreu em 55% das consultas. Mulheres e diabéticos apresentaram maiores probabilidades de terem um exame solicitado. Quanto maior a idade (p<0,001), o nível socioeconômico (p=0,04) e o número de consultas realizadas (p<0,001), maior a proporção de consultas com solicitação de exames. Em média, a espera entre o pedido do exame e a coleta foi de seis e 21 dias para o setor privado e público, respectivamente (p<0,001). O número de exames por requisição foi em média de 4,4. CONCLUSÕES: A proporção de consultas que gerou solicitação de algum exame complementar obedeceu às recomendações brasileiras. A espera na coleta indicou número excessivo de exames por solicitação ou teto financeiro insuficiente frente à demanda ou ambos.

Serviços de diagnósticos; Teste diagnósticos de rotina; Serviços de saúde; Exames médicos


ORIGINALS ARTICLES

Population-based study of the epidemiology of diagnostic test ordering

Marcelo F Capilheira; Iná S Santos

Programa de Pós-Graduação em Epidemiologia. Universidade Federal de Pelotas. Pelotas, RS, Brasil

Correspondence Correspondence: Marcelo F. Capilheira Av. Duque de Caxias, 250 3º andar 96030-002 Pelotas, RS, Brasil E-mail: capilheira@brturbo.com

ABSTRACT

OBJECTIVE: To identify type of service, frequency, and individual patient determinants associated with diagnostic test ordering in medical appointments.

METHODS: A population-based study included 3,100 adults aged 20 years or older, living in the city of Pelotas, Southern Brazil. Sampling was carried out in multiple stages. Information were collected by means of a questionnaire, administered between October and December 2003. Multivariate analyses were carried out using Poisson Regression, based on a conceptual model. A sub-study was also conducted based on the test requests received during one workday in all laboratories in the city processing requests from both the public and private sectors.

RESULTS: Fifty-five percent of subjects reported having had medical appointments during the three-month period investigated. Of these, 60% reported more than one appointment, generating a total of 4,167 appointments, most of which were paid for by health plans (38%). Diagnostic test were requested in 55% of appointments. Women and diabetic patients were more likely to have tests ordered. The greater the age (p<0.001) the higher the socioeconomic level (p=0.04), and the number of medical appointments (p<0.001), the greater the proportion of appointments leading to test requests. Mean waiting time between test request and sample collection was six days for the private sector and 21 days for the public sector (p<0.001). The mean number of tests per request was 4.4.

CONCLUSIONS: The proportion of appointments leading to the request for some type of diagnostic test was in accordance with Brazilian recommendations. The waiting time before sample collection indicates an excessive number of tests per request and/or insufficient financial resources to fulfill the demand for tests.

Keywords: Diagnostics services. Diagnostics tests, routine, statistics and numerical data. Health services. Medical examination.

INTRODUCTION

Diagnostic tests are intended to confirm the information obtained through anamnesis and physical examination during the medical appointment. Test ordering is influenced by factors related to characteristics of health care organization, physician, and patient,1,14 and by the interaction between these groups.

Current health care technology offers an array of diagnostic tests, which have become very popular among patients and physicians.11 Even though these tests have proven to be of great use, one must to consider certain risks, related not only to the procedure itself (e.g., allergic reaction to contrast media), but also to the practice of exaggerating in the number and indication of diagnostic tests. The latter include the financial cost to both patient and system; the anxiety generated by the possibility of an unfavorable outcome; the undervaluation of clinical examination; the crowding of laboratories and other diagnostic services due to excessive demand; delays in diagnosis in cases where clinical evidence would suffice; and finally, misdiagnosis, since diagnostic tests show varying proportions of false-positive and false-negative results.

This subject has been investigated by research groups from several countries, 3,4,8,15,16 and studies have focused on the reasons for test ordering, the conducts based on test results, and strategies for the reduction of unnecessary testing. In Brazil, few studies address the subject directly. The extant data are either restricted to a very select population,9 or are concerned essentially with financial aspects.6 Data from the Brazilian Ministry of Health are also available, but these are restricted to the public network, and do not represent the universe of medical appointments and test orders.13

According to data from the Secretariat of Health of the municipality of Pelotas, Southern Brazil, the municipality's primary network, comprising 50 healthcare units, provides in average 120 thousand appointments per month. The network's referral outpatient facilities register a monthly average of 14 thousand appointments. Diagnostic tests are requested in about 50% of medical appointments. In one month, 55 thousand laboratory tests are performed, a proportion within the upper limit defined by the parameters of the Ministry of Health's Sistema Único de Saúde (Unified Health System - SUS). According to these parameters, 30 to 50% of outpatient appointments should lead to laboratory test ordering.13

The above scenario indicates the need that healthcare managers reflect about the issue and further acquaint themselves with the factors involved in the apparently simple act of requesting diagnostic tests. Such acquaintance may be helpful for making decisions regarding the allocation of resources. The present study aims at clarifying some of these aspects, especially those concerning patients.

METHODS

The municipality of Pelotas, located in the extreme South of Brazil, has 320 thousand inhabitants, 93% of which live in the urban area.10

We carried out a cross-sectional, population-based study of subjects aged 20 years or older. We excluded institutionalized persons or those incapable of responding to the questionnaire used. Fieldwork took place between October and December 2003.

The following parameters were used to calculate sample size: 10% prevalence of medical appointments and diagnostic test ordering; 95% confidence interval; and an acceptable error of 2 percentage points. A further 10% were added to cover potential losses. The sample size obtained was multiplied by 1.5 due to the design effect of using a cluster sample. Thus, the sample would require 1,425 subjects with medical appointments and test requests in the three-month period. Since the present study was conducted as a consortium involving other researchers, the final sample exceeded the calculated sample size, leading to a sample with 95% power to detect prevalence ratios equal to or greater than 1.03.

Sampling was carried out in multiple stages, based on data from the 2000 Brazilian Population Census, conducted by the Instituto Brasileiro de Geografia e Estatística (Brazilian Institute for Geography and Statistics).10 All 404 urban census sectors in the municipality were listed in decreasing order of mean income (head of household), and 144 sectors were systematically drawn. In the following stage, all households of each selected sector were visited, and residential and commercial buildings were identified. Based on the list of households, we carried out a systematic random selection proportional to sector size, selecting about 10 households from each sector (n=1,530 households). The selected households were visited, and household members, after receiving information about the nature of the investigation, responded to questionnaires previously tested in a pilot study carried out in a census sector excluded from the final sample.

Interviewers were trained, were all female, and had at least secondary education. Interviewers were blinded as to the aims and hypotheses of the study. For quality control purposes, about 10% of interviews were repeated by supervisors using a shorter version of the questionnaire for. Data were entered twice, and inconsistencies and amplitudes were checked using Epi Info v. 6.04 software.

Dependent variables were self-referred by subjects. Variables investigated were presence of medical appointments in the three months preceding the interview, diagnostic test orders, and information on the types of tests requested in the last three places of appointment.

Independent variables included sex, age (complete years), schooling (complete years), skin color (classified as white and nonwhite by the interviewer), marital status (married or with partner; single or without partner; separated; partner deceased), and economic class. The latter was based on the classification proposed by the Associação Brasileira de Empresas de Pesquisa (Brazilian Association of Research Companies - ABEP),1 1 Available on-line from: http://www.abep.org/codigosguias/ABEP_CCEB.pdf [6 Feb 2006] which divides subjects into classes A, B, C, D, and E, in decreasing order of wealth. For analysis purposes, this variable was recoded into classes AB, C, and DE, due to the small number of subjects in the extreme classes.

We also obtained information on health-related independent variables, including place and number of appointments in the last three months, hospital admissions in the last year, physician-diagnosed Diabetes Mellitus (DM) or systemic arterial hypertension (SAH), smoking (smokers defined as those that smoked at least one cigarette a day for more than one month, and former smokers defined as those that had quit smoking for at least one month), and Body Mass Index (BMI) in kg/m2. We also included self-perceived health status, divided into three categories: (1) excellent or very good; (2) good; and (3) regular or poor.

The following places of appointment were considered: among public services, the Centro de Atenção Psicossocial (Centers for Psychosocial Care - CAPS), health centers, emergency rooms, hospital outpatient facilities, and university outpatient facilities. The CAPS are specific secondary health care facilities for patients with psychosocial diseases, and include psychiatrists, psychologists, social workers, and nurses. Services considered as private were divided into health plans, private appointments, and company or union outpatient facilities. The category "other places of appointment" included chemotherapy and radiotherapy clinics, emergency services of private clinics, and home visits. These places were not included into the remaining categories due to the limitations of the questionnaire regarding the identification of the type of care provided (emergency care, chemotherapy or radiotherapy follow-up appointments) or the nature of the service (public or private).

In the analysis of the types of tests ordered, patients with multiple tests were considered as a different group. The category "other types of test" included nuclear medicine, Pap smears, electroencephalograms, and electromyographies, among others.

Data on laboratory tests were obtained by means of a sub-study conducted in the municipality's nine clinical analysis laboratories that receive requests from both the private and public sectors. The aim of this sub-study was to identify the laboratory tests most frequently ordered, the mean number of tests per request, and the waiting time between the request and sample collection. Information were obtained from all test requests collected during a single workday between November 2003 and January 2004, after obtaining authorization from the laboratory manager.

The analysis model was constructed using the hierarchical approach. Thus, the effect of each variable was controlled only for variables in the same or higher hierarchical levels. The first level of determination (most distal) comprised variables 'sex, age, skin color, and number of appointments'. The latter was included in this level to avoid confounding, since subjects with more appointments would have greater probability of having had a diagnostic test requested. The level immediately below (second level) comprised variables 'schooling, marital status, and economic class'. The third level comprised variables 'SAH, DM, BMI, and smoking'. The fourth level (most proximal) comprised variables 'hospital admission in last year, and self-perceived health status'.

Since ours was a frequent outcome, we used Poisson regression for multivariate analysis,1 performed using Stata v. 8.0 software. All analysis considered the clustered sampling design.

RESULTS

Losses and refusals amounted to 3.5%, leading to a total 3,100 interviewed subjects, of which 1,707 had had at least one medical appointment in the three months preceding the interview. This generated a total 4,167 appointments. Of the appointments, 55.1% (95% CI: 53.6%-56.6%) led to the ordering of at least one diagnostic test. Regardless of the number of appointments, tests were ordered for 67.6% of subjects with medical appointments.

The most frequent places of appointment and the proportion of diagnostic test ordering are shown in Figure 1. Regarding the type of service, 50.6% of appointments took place in the public network. The proportion of appointments in the public and private networks resulting in test ordering were 56.4% and 53.2%, respectively (p=0.04).


Of the patients with more than one medical appointment, 25.6% sought health care in more than one place. This proportion equaled 16.3% for patients with two appointments, 23.1% for patients with three appointments, and 41.7% for patients with four or more appointments. Patients with two or more appointments and who had sought more than one health care provider showed a 13% higher crude probability of having had diagnostic tests requested (PR=1.13; 95% CI: 1.11-1.16).

Figure 2 shows the proportion of subjects reporting each or the diagnostic tests investigated. Irrespective of the number of appointments, most subjects (71.8%) reported the collection of blood samples.


Table 1 presents the results of the analysis of the association between sociodemographic factors and diagnostic test ordering. Women showed 3% higher probability of having tests ordered. Older age was also associated with greater number of test requests, showing a direct linear relationship with the outcome (p<0.001). There was also a linear association with economic class, with the probability of having tests requested increasing from poorer to wealthier classes. This relationship was very strong in crude analysis, but became weaker after adjustment, approaching borderline significance. Marital status and skin color did not show associations with test ordering. However, the latter was on the threshold for statistical significance (p=0.05) in crude and adjusted analyses.

Regarding health care aspects (Table 2), test ordering was significantly associated only with the number of appointments (p<0.001) and with DM diagnosis (p<0.001). Hospitalization in the last year or hypertension did not lead to greater test ordering. BMI and self-perceived health status showed linear associations with the outcome only in crude analysis, the number of requests increasing as BMI increased and self-perceived health status worsened.

The results of the sub-study involving the city's clinical analysis laboratories are presented in Table 3. Over one-half of test requests received by the laboratories included hemogram and fasting glucose. The majority of requests were from women (68.6%), and mean age was 42 years. The mean number of tests per request was 4.4 (SD: 3.1). Requests from the public network accounted for 59.7% of all orders (p<0.001). Mean number of tests per requisition was 4.9 in the public sector and 3.7 in the private sector (p<0.001). Mean waiting time between request and sample collection was six days for requests originating from the private sector and 21 days for those originating from the public sector (p<0.001).

DISCUSSION

Medical appointments have been the subject of study of many different authors, under various approaches related to financial aspects, demand, or usage.5,14 The present study, unlike those of other authors,3,8 provides population-based data on the demand for diagnostic tests generated by medical appointments, allowing for the identification of user-related factors.

The limitations of the present study include a potential lack of precision due to poor recall, given that the inquired information was related to a three-month period; reverse causality, which is inherent to cross-sectional design; and the absence of an investigation of the reasons for the appointments, although the study was not designed to obtain such information.

The major limitation of the sub-study is the fact that information was collected during a single workday. Moreover, requests may vary according to the scheduling routine of each laboratory and to seasonal variation (vacation periods, in which a percentage of physicians and patients may have been away from home). However, the proportion of women in the sub-study (69%) and in the population-based sample (66.4%) were similar (p=0.3), indicating consistency of information. The same is observed with the proportion of tests generated by the public sector: 59.7% in the sub-study and 55.1% in the population-based sample (p=0.06). Another limitation was the failure to cover all of the city's laboratories (only those providing services to both the public and private sectors were included), which gave us only a partial view of the municipal scenario.

The prevalence of medical appointments found in the present study was similar to that reported by Dias da Costa & Facchini5 (1997) for the same city in 1992 (56.5%). A study conducted in Spain8 using secondary data estimated a frequency 54.5 medical appointments per 100 inhabitants/year, and a rate of 5.6 test requests/100 appointments/year. Comparatively, the present results indicate a higher percentage (55.1% in three months) although study design and the level of healthcare differed between the two studies.

In Pelotas, about one-half of appointments led to requests for some sort of diagnostic test. This is similar to the proportion of appointments that should generate laboratory tests according to Ministry of Health recommendations,2 2 Ministério da Saúde. Portaria 1101/GM, de 12 de junho de 2002:Parâmetros Assistenciais do SUS. Available online from http://dtr2001.saude.gov.br/sas/PORTARIAS/Port2002/Gm-1101.htm [25 Aug 2003] (p=0.3), although these recommendations include other types of tests. Nationwide data generated by SUS13 show that, in Brazil, between 52% and 76% of appointments lead to test ordering.

Regarding the place of appointment, emergency rooms showed the greatest proportion of test ordering, possibly due to tests performed on location. These were followed by hospital outpatient facilities, university outpatient facilities, private clinics, and "others", which did not differ significantly among themselves. The proportion of appointments generating test requests was similar regardless of whether the appointment took place in public primary health centers or if it was covered by health plans (p=0.1), both values being within the parameters recommended by the Ministry of Health. The prevalence of test ordering observed in hospital and university outpatient facilities may be related to the greater complexity of the health care provided at these facilities.

The greater proportion of test requests in the public system (56.4%) when compared to the private sector is possibly due to tests requested during emergency care. Moreover, even though the difference between the two sectors is significant, from the perspective of service management and planning this difference is to small to be of any practical relevance.

The types of tests most frequently requested were clinical analyses (blood and urine), in proportions similar to those reported in the public healthcare system's official database.13

The high proportion of requests by health service users may be related to the exaggerated use of medical appointments, or to the fact that physicians may be evaluating patients by means of serial tests (one type of test per appointment). It should be noted, however, that the process of medical care often involves long periods of follow-up. In this case, one appointment would generate the test request, and the next appointment would be dedicated to evaluating the results obtained, incorporating findings into the diagnosis process, and to defining the treatment regime to be adopted.

A third hypothesis is that a fair share of these tests may actually be for the same patients, but requested from different laboratories. The importance of test repetition has been emphasized a North American study,2 which found 28% prevalence of tests repeated before the recommended time interval in hospitalized patients. A Dutch study3 found 38% prevalence of test repetition in an eight-month period among outpatients. Approximately 35% of repeated tests were requested by a different physician than that which requested the initial test.

A fourth possibility is that some patients may have needed appointments in more than one place in order to obtain a request for a given test. This hypothesis is supported by the fact that number of appointments was the independent variable most strongly associated to the outcome.

Given the strong association between test ordering and the number of medical appointments, the entire analysis was controlled for the latter variable. The sociodemographic factors that remained associated with the outcome after adjusted analysis were female gender, older age, and higher socioeconomic status. The results of a Spanish study8 showed that test requests for women accounted for 60.1% of the sample. Another study3 indicated greater test ordering for older subjects.

Of the health-related characteristics investigated, only diagnosed DM showed a significant association with the outcome. This is probably related to the greater number of appointments required for diabetes patients. Furthermore, current Ministry of Health guidelines recommend laboratory control every three months for patients with stable diabetes and at shorter intervals for those with uncontrolled disease.3 3 Ministério da Saúde. Hipertensão Arterial Sistêmica e Diabetes Mellitus - Protocolo. Brasília (DF); 2001. This hypothesis is supported by the results of the sub-study, which indicated fasting blood glucose as the second most requested test. Another study reported fasting blood glucose as the most commonly requested test in a sample of about 40 thousand test requests.3 Similar results were not found for SAH, possibly because laboratory control is recommended on a yearly basis.7

The types of tests most frequently requested were those recommended for the diagnosis and/or follow-up of patients with DM and/or SAH.8 However, most requests included a hemogram, which is unusual, since hemograms are not included in any of the test protocols. A Dutch study4 showed no requests for complete hemograms, only for its separate fractions. This leads to the question of whether physicians would be ordering tests based on evidence or only following a "routine test ritual".

The findings of our sub-study were similar to those reported in the literature. Women accounted for most of the requests (60.1% in the Spanish study8 and 68.6% in the present study). The mean number of tests per request was eight in the Spanish study and four in the present study.

The difference in mean waiting time between test request and sample collection between the private and public sectors (six and 21 days, respectively) may be explained by the logistics of the financing system. The allocation of public resources for diagnostic tests to laboratories associated to SUS is based on a monthly limit (information obtained from the managers of each of the laboratories visited). In this system, when a laboratory meets the upper limit defined by the government, i.e., when the demand for tests is greater than the available resources, patients are oriented to schedule their tests for the following month. The excess tests may be a consequence either of exaggerated test ordering or of an exceedingly low financial limit.

Another possibility is that the period between having the appointment and seeking a laboratory for the test may differ between patients of the private and public sectors. Public sector users may be financially restricted with respect to transportation, even within the urban area.

Since the proportion appointments leading to test requests is within the parameters recommended by the Brazilian Ministry of Health, we can only conclude that the number of tests included in each request is likely to be excessive. The Ministry of Health does not establish a limit for the number of test per request, which may a be desirable measure.

The data in the present study do not allow for an evaluation of the number of tests per request, but given the excessive waiting time for sample collection, we question the financial limit defined for fulfilling the demand generated by the public sector.

Finally, we indicate the need for further investigation aimed at evaluating the different factors involved in the complex causal network behind diagnostic test ordering. This is important for both the patient, who is exposed to risk and suffers the adverse effects of testing,11,12 and for the healthcare system. The quantitative adequacy of test ordering in Pelotas is at odds with the long waiting time for the actual performance of tests within the public sector. The definition of a limit for the number of tests per request by health authorities would be desirable. This limit should be supported by strong evidence regarding its adequacy.

We therefore reinforce the need for studies to further investigate this issue and for the rapid adoption of health policies aimed as making it easier for patients to use a single facility. The Programa de Saúde da Família (Family Health Program),4 4 Ministério da Saúde. Programa Saúde da Família. Brasília (DF); 2001. may provide an important strategy in the prevention of this problem.

REFERENCES

Received: 12/4/2004. Reviewed: 8/12/2005. Approved: 12/2/2005.

MFC received a fellowship grant from Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES).

Based on the Master's dissertation presented at the Universidade Federal de Pelotas in 2004.

  • 1. Barros AJ, Hirakata VN. Alternatives for logistic regression in cross-sectional studies: an empirical comparison of models that directly estimate the preference ratio. BMC Med Res Methodol 2003;3(1):21-34.
  • 2. Bates DW, Boyle DL, Rittenberg E, Kuperman GJ, Ma'Luf N, Menkin V, et al. What proportion of common diagnostic tests appear redundant. Am J Med 1998;104(4):361-8.
  • 3. Branger PJ, Van Oers RJ, Van der Wouden JC, Van der Lei J. Laboratory services utilization: a survey of repeat in investigations in ambulatory care. Neth J Med 1995;47(5):208-13.
  • 4. Cohen O, Hahan E, Zalewski S, Kitai E. Medical investigations requested by patients: how do primary care physicians react? Fam Med 1999;31(6):426-31.
  • 5. Costa JSD, Facchini LA. Utilização de serviços ambulatoriais em Pelotas: onde a população consulta e com que freqüência. Rev Saúde Pública 1997;31(4):360-9.
  • 6. Costa JSD, Fuchs SC, Olinto MTA, Gigante DP, Menezes AMB, Macedo S, et al. Cost-effectiveness of hypertension treatment: a population-based study. Rev Paul Med 2002;120(4):100-4.
  • 7. Duncan BB, Schmidt MI, Giugliani ERJ. Medicina ambulatorial: condutas clínicas em atenção primária. Porto Alegre: Artes Médicas; 1996.
  • 8. Gracia Gomis MC, Pérez Royo A, Hernández Aguado I, Berbegal J, Arrese R. Análisis de la demanda de pruebas de laboratorio desde atención primaria en un área de salud. Aten Primaria 1999;23(1):26-31.
  • 9. Halal IS, Sparrenberger F, Bertoni AM, Ciacomet C, Seibel CE; Lahude FM, et al. Avaliação da qualidade de assistência primária à saúde em localidade urbana da região sul do Brasil. Rev Saúde Pública 1994;28(2):131-6.
  • 10. Instituto Brasileiro de Geografia e Estatística IBGE. Censo Demográfico 2000. Rio de Janeiro; 2001.
  • 11. Kloetzel K. Usos e abusos de exame complementar. Diagn Tratamento 2001;6(4):19-27.
  • 12. McDonald IG, Daly J, Jelinek VM, Panetta F, Gutman JM. opening Pandora's box: the unpredictability of reassuranke by a normal test result. BMJ 1996;313(7053):329-32.
  • 13. Rede Interagencial de Informações para a Saúde - RIPSA. Indicadores básicos de saúde no Brasil: conceitos e aplicações. Brasília (DF): Organização Pan-Americana de Saúde; 2002.
  • 14. Sackett D, Haynes RB, Guyatt GH, Tugwell P. Clinical epidemiology: a basic science for clinical medicine. Ontario: Little, Brown; 1991.
  • 15. Sherwood P, Lyburn I, Brown S, Ryder S. How are abnormal results for liver function tests dealt with in primary care?: audit of yield and impact. BMJ 2001;322(7281):276-8.
  • 16. Van der Weijden T, Van Velsen M, Dinant GJ, Van Hasselt CM, Grol R. Unexplained complaints in general practice: prevalence, patients' expectations, and professionals' test-ordering behavior. Med Decis Making 2003;23(3):226-31.
  • Correspondence:
    Marcelo F. Capilheira
    Av. Duque de Caxias, 250 3º andar
    96030-002 Pelotas, RS, Brasil
    E-mail:
  • 1
    Available on-line from:
  • 2
    Ministério da Saúde. Portaria 1101/GM, de 12 de junho de 2002:Parâmetros Assistenciais do SUS. Available online from
  • 3
    Ministério da Saúde. Hipertensão Arterial Sistêmica e Diabetes Mellitus - Protocolo. Brasília (DF); 2001.
  • 4
    Ministério da Saúde. Programa Saúde da Família. Brasília (DF); 2001.
  • Publication Dates

    • Publication in this collection
      16 Aug 2006
    • Date of issue
      Apr 2006

    History

    • Received
      04 Dec 2004
    • Reviewed
      12 Aug 2005
    • Accepted
      02 Dec 2005
    Faculdade de Saúde Pública da Universidade de São Paulo Avenida Dr. Arnaldo, 715, 01246-904 São Paulo SP Brazil, Tel./Fax: +55 11 3061-7985 - São Paulo - SP - Brazil
    E-mail: revsp@usp.br