Open-access Multidisciplinary electronic protocol for collection of clinical and surgical data on chronic venous insufficiency

Abstract

Background  Use of electronic protocols for data collection and storage enables clinical research to be conducted dynamically, contributing to medical advances.

Objectives  To create an electronic data base for collection of clinical and surgical data on chronic venous insufficiency (CVI), to facilitate production of scientific studies.

Methods  Initially, a database was constructed by means of a bibliographic review of text books and relevant scientific articles for all vascular diseases and then a database on CVI was extracted. These data were computerized using the Integrated Electronic Protocols System (SINPE©) and then assessed in a pilot project.

Results  The multidisciplinary electronic protocol for vascular diseases covered the following items: history taking, physical examination, work-up tests, types of treatment, and progression. Using these items, a master protocol was created containing 6,145 items, and then a CVI-specific protocol containing 2,877 items was compiled. The protocol’s functionality was tested in a pilot project, collecting data from medical records. The information collected was analyzed and illustrated graphically.

Conclusions  It proved possible to create an electronic protocol for collection of clinical and surgical data on CVI. The protocol was incorporated into the SINPE©, greatly facilitating production of scientific research in the area.

Keywords:  chronic venous insufficiency; electronic protocols; vascular surgery

Resumo

Contexto  A utilização de protocolos eletrônicos para coleta e armazenamento de dados permite a realização de pesquisas clínicas de forma dinâmica, contribuindo com a evolução da medicina.

Objetivos  Criar uma base eletrônica de coleta de dados clínicos e cirúrgicos referente à insuficiência venosa crônica (IVC) para auxiliar na realização de estudos científicos.

Métodos  Inicialmente, criou-se uma base de dados de todas as doenças vasculares e, em seguida, de IVC, por meio da revisão bibliográfica de livros-texto e de artigos científicos relevantes. A informatização desses dados foi realizada pelo programa Sistema Integrado de Protocolos Eletrônicos (SINPE©) e avaliada por um projeto piloto.

Resultados  O protocolo eletrônico multiprofissional de doenças vasculares abrangeu os itens anamnese, exame físico, exames complementares, tipos de tratamento e evolução. Com isso, criou-se um protocolo mestre contendo 6.145 itens, e após gerou-se um protocolo específico de IVC totalizando 2.877 itens. A funcionalidade do protocolo foi testada com um projeto piloto, coletando-se dados de prontuários. Realizou-se o cruzamento das informações coletadas, que foram demonstradas na forma de gráficos.

Conclusões  Foi possível criar um protocolo eletrônico para coleta de dados clínicos e cirúrgicos referente à IVC. Esse protocolo foi incorporado ao SINPE©, facilitando imensamente a realização de pesquisas científicas nessa área.

Palavras-chave:  insuficiência venosa crônica; protocolos eletrônicos; cirurgia vascular

INTRODUCTION

The benefits of using IT resources in medicine have been irrefutably proven in the following situations: data capture and storage, production of scientific research, and distribution of medical literature.1,2

Studies with large numbers of patients guide changes in management of clinical cases, standardizing treatments, and improving the results obtained. This is the foundation of progress in medicine.3-5

Moreover, use of electronic patient records can improve interpretation and understanding of records of patient history, physical examinations, and diagnostic tests, in addition to providing rapid access to this information, facilitating production of scientific studies.6

Use of IT is also important for legal aspects, because of improved medical and laboratory record-keeping and significant reductions in medical prescription errors. Avoidable medical errors are responsible for more than 50,000 deaths per year in the United States. It will only be possible to reduce this alarming number by simultaneous adoption of several measures. However, one measure in particular did significantly reduce the number of errors in the medications administered to patients: substituting manual prescriptions for an electronic prescription system.7-9

Development of electronic protocols with the capacity for collection, structured storage, and processing of clinical data facilitates access and retrieval of this information. These protocols are therefore extremely useful tools for production of high-quality medical literature, when the objective is to expand production of prospective studies in shorter time frames.10

Many different electronic protocols have already been developed, focused on other diseases and in a variety of different branches of medicine.11-14 However, there are no similar publications for chronic venous insufficiency (CVI).

The multidisciplinary electronic protocol for CVI covers data from the patient history, including symptoms, risk factors, and lifestyle habits that affect development of the condition; describes in detail the important elements of the physical examination; presents the possible abnormal findings of work-up tests that lead to diagnosis of CVI; provides the clinical, etiology, anatomy, and pathophysiology classification (CEAP) and its scores, so that cases studied can be stratified; lists the different forms of treatment, ranging from clinical and surgical treatment through endovascular approaches; in addition to covering the important elements of disease progression after treatment. The objective of this study was to create an electronic protocol for clinical and surgical data collection focused on CVI, in order to support production of scientific studies of the disease.

METHODS

Initially, a master protocol was created, entitled the “Multidisciplinary Vascular Diseases Protocol”, was subdivided into seven major areas: venous thromboembolism, chronic venous insufficiency, aneurysmal diseases, acute arterial occlusion, chronic arterial ischemia of upper limbs and supra-aortic trunks, chronic visceral ischemia, and chronic arterial ischemia of lower limbs.

Information on these different diseases was organized and input under the following headings: history taking, physical examination, work-up tests, diagnosis, treatment, and progression. Next, these items were imported to the Integrated Electronic Protocols System (SINPE© - Sistema Integrado de Protocolos Eletrônicos). This software program was developed by Prof. Dr. Osvaldo Malafaia, professor of Surgery at the Health Sciences Department of the Universidade Federal do Paraná (UFPR). Ownership of the intellectual property rights to this program were registered with the Brazilian patents and trademarks office (INPI - Instituto Nacional de Propriedade Industrial), run by the country’s ministry for industry, foreign trade and services, under registration number RS 06056-1, on February 17, 2009.

Once the items had been imported to SINPE, the entire content was available for viewing. The master protocol comprised 6,145 items and was used to generate a CVI-specific protocol containing 2,877 items.

The Multidisciplinary Electronic Protocol for Collection of Clinical and Surgical Data on Chronic Venous Insufficiency (MEPCCSD-CVI) is a descriptive study with methodology divided into five phases:

  1. 1

    Creation of the theoretical foundation for clinical and surgical data on CVI by reviewing the specialized literature. Five text books were used for this process: Tratado de Flebologia e Linfologia (Treatise on Phlebology and Lymphology),15 Doenças Vasculares Periféricas (Peripheral Vascular Diseases),16 Vascular Surgery,17 Cirurgia Vascular: Cirurgia Endovascular – Angiologia (Vascular Surgery: Endovascular Surgery – Angiology),18 and Cirurgia Vascular (Vascular Surgery),19 in addition to relevant scientific articles;20-25

  2. 2

    Computerization of the theoretical foundation data following the standard methodology of the “Computerized Protocols” research project run by the Postgraduate Program Surgery at the Health Sciences Department of the Universidade Federal do Paraná (UFPR). This research project incorporates the SINPE©, which is capable of storing and manipulating the data that comprises a theoretical foundation. The version used was developed in the C# software language, using Microsoft®.net Framework technology. This version offers user management, the capability for multi-center use, and support for manipulation of multimedia content. The program is distributed on CD-ROM. It can therefore be run on any computer, in different locations, as long as the minimum system requirements are met: Microsoft Windows 98® operating system, 32 megabytes of RAM memory, and a hard drive with at least 500 megabytes free space;

  3. 3

    Application of the CVI-specific protocol using data from the patient records of people who underwent surgical treatment for lower limb varicose veins (International Classification of Diseases code I-83) provided by the vascular surgery service at the Hospital das Clínicas da Universidade Federal do Paraná (HC-UFPR) from 2000 to 2007. These data were collected in the form of a retrospective cross-sectional study of a series of 50 non-consecutive cases chosen at random. The inclusion criteria were: legible handwriting and complete descriptions of history taking, physical examination, surgery, and postoperative progression. The exclusion criteria were: indecipherable handwriting, missing details of symptoms from clinical history, failure to mention relevant risk factors, no CEAP classification, details missing from description of surgery, and failure to mention recovery or complications after treatment. Since the incidence of CVI is high, the number of cases analyzed was the minimum recommended by the information technology specialists who developed the SINPE© program. This pilot project was approved by the Human Research Ethics Committee and registered under registration number 2283.177/2010-07, with the objective of testing the functionality of the protocol. According to the ethics committee, there was no need to obtain free and informed consent;

  4. 4

    Interpretation of the results obtained from the pilot project data collection employing the SINPE© Analyzer module, which offers rapid viewing of the information in the SINPE© electronic protocols. This module was used to plot several graphs illustrated in the results of the study;

  5. 5

    Analysis of the results obtained from the pilot project data collection, presenting the incidence rates of certain items from patient histories, such as symptoms, lifestyle habits, elements of personal history listed as risk factors, elements of family history, abnormal color Doppler ultrasonography findings, CEAP classification and venous insufficiency score, types of surgical treatment performed, and postoperative progression. These analyses were illustrated in graphs, followed by explanations to aid in understanding them.

RESULTS

The results were analyzed in two phases:

  • phase 1: development of the MEPCCSD-CVI;

  • phase 2: application of the MEPCCSD-CVI.

In phase 1, results are shown as figures illustrating the screens displayed on the computer. The items cataloged were Patient history (Anamnese), Physical examination (Exame físico), Work-up tests (Exames complementares), Diagnosis (Diagnóstico), Treatment (Tratamento), and Progression (Evolução). The protocol comprised a total of 2,877 items (Figure 1).

Figure 1
Specific protocol for chronic venous insufficiency.

In phase 2, a pilot project was conducted, registering patients on the protocol.

A total of 50 patient records were analyzed, from patients with CVI who underwent surgical treatment for varicose veins of the lower limbs, selected according to the criteria described in the methods section.

After registration of the patients, data on the specific items and subitems of the protocol were input from the patient medical records.

The study was then conducted. The results were displayed on the screen, showing the number of records located for each of the parameters chosen. the parameters of the item chosen, in this case smoking, can be observed in the example below. Nine records were located containing this item (Figure 2).

Figure 2
Example of the search screen for the parameter selected.

The SINPE© Analyzer module was used to present the results of application of the MEPCCSD-CVI. This module analyzes the incidence of the items collected and plots graphs showing the results. For example, the item smoking is illustrated in the graph in Figure 3.

Figure 3
Example graph for the item selected: smoking.

In addition to smoking, several other items were identified and illustrated graphically. We observed that 43 patients (86%) were female and 7 (14%) were male (Figure 4). The mean age was 53 years, varying from 28 to 69 years (Figure 5).

Figure 4
Graph for patients by sex.
Figure 5
Graph for patients by age group.

With regard to incidence of CEAP clinical classifications, the most prevalent was Class 3, with 26 records, accounting for 45.61% of cases, followed by Class 2, with 11 records, accounting for 19.3% of cases, and Class 4, with 10 records, accounting for 17.54% of cases. There were eight Class 5 records, accounting for 14.04% of cases, and just two Class 6 records, accounting for 3.51%. There were no records with CEAP Class 0 or Class 1. This graph illustrates a total of 57 items, because the program counts one record for patients who had the same classification for both limbs and two records for patients with different classifications for the left and right legs (Figure 6).

Figure 6
Graph for patients by CEAP clinical classification.

The types of surgical treatment performed were recorded separately for the great and small saphenous veins of the right and left lower limbs.

Figure 7 illustrates the example of the right great saphenous vein:

Figure 7
Graph for procedures performed on the right great saphenous vein.
  • four cases of re-exploration and ligature of residual stump;

  • two cases of total scaled resection;

  • two cases of distal saphenectomy;

  • eight cases of proximal saphenectomy; and

  • nine cases of total saphenectomy.

Items on progression of cases evaluate postoperative progression in terms of presence or absence of complications, which complications occurred and improvement of symptoms.

Complications observed on the seventh day after operating included two cases of lymphedema, two cases of lymphocele, and two cases of nerve damage (Figure 8).

Figure 8
Graph for postoperative complications.

DISCUSSION

Computerization of clinical data

Use of handwritten patient records for scientific research makes data collection much more difficult because, in general, these medical records are not filled out completely, are written by several different professionals, and may contain illegible handwriting. Additionally, extracting these data is very time-consuming. All of these factors are barriers to conducting high-quality research.26,27

Using electronic patient records offers countless advantages over manual patient records, including: reduced need for physical space and number of people to store documents; legibility of information; and ease of data storage and retrieval. Additionally, they can also provide support for multimedia resources, such as photographs, films, and digitalized examinations and test results. Another advantage is the fact that patients’ medical records can be accessed by several professionals simultaneously.28

Application of electronic protocols for data collection offers similar benefits to use of electronic patient records, with the advantage of standardization and hierarchization of the data collected. Electronic protocols increase the precision of records, enabling prospective and multicenter studies, in addition to increasing the accuracy of scientific research.29-31

However, use of the electronic protocol is in no way a substitute for patient medical records. The main difference between the two is that the protocol contains sources of information on a specific group of diseases, in contrast with patient medical records, which are specific to an individual patient and do not follow rigid completion criteria. They should continue to be filled out for follow-up and to provide a legal record of patient management. In common with research protocols, patient records are being moved over to electronic format with increasing frequency. The aim of this gradual change is to rationalize the time spent in medical consultations and facilitate retrieval of patients’ histories.29-31

Construction of the MEPCCSD-CVI

Construction of the MEPCCSD-CVI started with extensive research in text books and scientific articles, correlating the items of greater importance.

This theoretical foundation was then computerized using SINPE©, which offers several tools for maintaining confidentiality and data protection. Differentiation of users and provision of different levels of authorization, the inability to alter a protocol (after one data collection has been conducted), and the inability to edit completed data collections are all features intended to prevent inadvertent changes to protocols.

Application of the MEPCCSD-CVI

In order to assess the protocol’s functionality, it was applied to collection of data from the medical records of 50 patients with CVI who had undergone surgery for varicose veins. Limitations observed due to the fact that the analysis was retrospective included difficulties reading handwriting and missing information on history taking and physical examination on some patient medical records. The statistical significance of the data collected was not considered.

Data collected in the SINPE© are entered by mouse clicks. Although the process is objective and practical, it was necessary to train the data collector to ensure he took care with the items entered on the protocol, since, after each record was collected, it could not be edited.

The principles of navigating SINPE© are similar to those of Microsoft Windows®. It can be run over the internet and using handheld computers. These features were not tested in the pilot project, but they are very useful for prospective studies. There is also the option to print out the protocol for paper-based data-collection, if necessary.

The SINPE© Analyzer module was then used for statistical analysis of the data collected, identifying items collected and automatically plotting graphs. This module is very rapid and effective for use in scientific studies.

SINPE© has been approved by the health professionals who have used it, increasing scientific output and reducing the time spent on clinical trials by 50%. The current version allows protocols to be used via intranet or internet and to be updated on the system for data collection at any time, regardless of what institution is using the protocol.32

The objective of the MEPCCSD-CVI is to increase production of scientific research, since it offers security and uniformity for data storage, facilitating collection and analysis. It thus reduces the time taken to produce research and increases its credibility.

CONCLUSIONS

The MEPCCSD-CVI was constructed from a theoretical foundation of clinical data relevant to the disease, input on the SINPE© computer program. Its functionality was tested by collecting data from patient medical records, which were then analyzed using the SINPE© Analyzer module. It is therefore concluded that the MEPCCSD-CVI is an excellent resource for data collection and storage, facilitating future research in the area.

  • How to cite: Mottin CC, Stahlke Junior HJ, Malafaia O. Multidisciplinary electronic protocol for collection of clinical and surgical data on chronic venous insufficiency. J Vasc Bras. 2020;19:e20190127. https://doi.org/10.1590/1677-5449.190127
  • Financial support: None.
  • The study was carried out at Setor de Ciências da Saúde, Departamento de Pós-graduação em Clínica Cirúrgica, Universidade Federal do Paraná (UFPR), Curitiba, PR, Brazil.

References

  • 1 Haux R, Ammenwerth E, Herzog W, Knaup P. Health care in the information society: a prognosis for the year 2013. Int J Med Inform. 2002;66(1-3):3-21. http://dx.doi.org/10.1016/S1386-5056(02)00030-8 PMid:12453552.
    » http://dx.doi.org/10.1016/S1386-5056(02)00030-8
  • 2 Doebbeling BN, Chou AF, Tierney WM. Priorities and strategies for the implementation of integrated informatics and communications technology to improve evidence-based practice. J Gen Intern Med. 2006;21(2, Suppl 2):s50-7. http://dx.doi.org/10.1007/s11606-006-0275-9 PMid:16637961.
    » http://dx.doi.org/10.1007/s11606-006-0275-9
  • 3 Atallah AN. A incerteza, a ciência e a evidência. Diagn Tratamento. 2004;9:27-8.
  • 4 Blettner M, Sauerbrei W, Schlehofer B, Scheuchenpflug T, Friedenreich C. Tradicional reviews, meta-analyses and pooled analyses in epidemiology. Int J Epidemiol. 1999;28(1):1-9. http://dx.doi.org/10.1093/ije/28.1.1 PMid:10195657.
    » http://dx.doi.org/10.1093/ije/28.1.1
  • 5 Liang L. The gap between evidence and practice. Health Aff. 2007;26(2, Suppl1):w119-21. http://dx.doi.org/10.1377/hlthaff.26.2.w119 PMid:17259192.
    » http://dx.doi.org/10.1377/hlthaff.26.2.w119
  • 6 Embi PJ, Yackel TR, Logan JR, Bowen JL, Cooney TG, Gorman PN. Impacts of computerized physician documentation in a teaching hospital: perceptions of faculty and residents physicians. J Am Med Inform Assoc. 2004;11(4):300-9. http://dx.doi.org/10.1197/jamia.M1525 PMid:15064287.
    » http://dx.doi.org/10.1197/jamia.M1525
  • 7 Leape LL, Berwick DM. Safe health care: are we up to it? BMJ. 2000;320(7237):725-6. http://dx.doi.org/10.1136/bmj.320.7237.725 PMid:10720335.
    » http://dx.doi.org/10.1136/bmj.320.7237.725
  • 8 Bates DW. Using information technology to reduce rates of medication errors in hospitals. BMJ. 2000;320(7237):788-91. http://dx.doi.org/10.1136/bmj.320.7237.788 PMid:10720369.
    » http://dx.doi.org/10.1136/bmj.320.7237.788
  • 9 Christakis NA. Don’t just blame the system. BMJ. 2008;336(7647):747. http://dx.doi.org/10.1136/bmj.39534.461134.59 PMid:18390523.
    » http://dx.doi.org/10.1136/bmj.39534.461134.59
  • 10 Malafaia O, Borsato EP, Pinto JSP. Gerenciamento do conhecimento em protocolos eletrônicos de coleta de dados. In: Anais do III Simpósio Internacional de Gestão do Conhecimento; 2003; Curitiba, PR, Brasil. Curitiba: PUC-PR; 2003.
  • 11 Oliveira M, Moraes RS, Matias JE, et al. Análise informatizada dos resultados obtidos pela aplicação de protocolo eletrônico na microcirurgia endoscópica transanal (TEM). ABCD. 2010;23(1):29-34. http://dx.doi.org/10.1590/S0102-67202010000100008
    » http://dx.doi.org/10.1590/S0102-67202010000100008
  • 12 Aranha AA Jr, Campos AC, Pinto JS, Agulham MA, Scheferbecker ME, Branco AB. Protocolo eletrônico para coleta estruturada de dados clínicos para pacientes pediátricos em terapia nutricional utilizando o SINPE© (Sistema Integrado de Protocolos Eletrônicos). Rev Col Bras Cir. 2009;36(1):73-7. http://dx.doi.org/10.1590/S0100-69912009000100013 PMid:20076871.
    » http://dx.doi.org/10.1590/S0100-69912009000100013
  • 13 Kalil-Filho FA, Campos AC, Tambara EM, et al. Physiotherapeutic approaches and the effects on inspiratory muscle force in patients with chronic obstructive pulmonary disease in the pre-operative preparation for abdominal surgical procedures. ABCD. 2019;32(2):e1439. http://dx.doi.org/10.1590/0102-672020190001e1439 PMid:31460599.
    » http://dx.doi.org/10.1590/0102-672020190001e1439
  • 14 Ribeiro CG, Moreira AT, Pinto JS, Malafaia O. Multiprofissional electronic protocol in ophtalmology with enfasis in strabismus. Rev Col Bras Cir. 2016;43(3):171-7. http://dx.doi.org/10.1590/0100-69912016003009 PMid:27556541.
    » http://dx.doi.org/10.1590/0100-69912016003009
  • 15 Thomaz JB, Belczak CEQ. Tratado de flebologia e linfologia. Rio de Janeiro: Livraria e Editora Rubio; 2006.
  • 16 Maffei FU, Lastória S, Yoshida WB, Rollo HA, Giannini M, Moura R. Doenças vasculares periféricas. 4. ed. Rio de Janeiro: Guanabara Koogan; 2008.
  • 17 Rutherford RB. Vascular surgery. 6th ed. Philadelphia: WB Sauders; 2005.
  • 18 Brito CJ, Duque A, Merlo I, Murilo R, Fonseca VL Fo. Cirurgia vascular: cirurgia endovascular: angiologia. 2. ed. Rio de Janeiro: Revinter; 2008.
  • 19 Haimovici H, Ascher E, Hollier LH, et al. Cirurgia vascular. 5. ed. Rio de Janeiro: Revinter; 2006.
  • 20 Rabe E, Pannier F. Clinical, aetiological, anatomical and phatological classificacion (CEAP): gold standard and limits. Phebology. 2012;27(Suppl 1):114-8.
  • 21 Silva MC. Chronic venous insufficiency of the lower limbs and its socio-economic significance. Int Angiol. 1991;10(3):152-7. PMid:1765717.
  • 22 Scuderi A, Raskin B, Al Assal F, et al. The incidence of venous disease in Brazil based on the CEAP classification. Int Angiol. 2002;21(4):316-21. PMid:12518109.
  • 23 Vascular Society. The national vascular database report. London: Vascular Society of Great Britain & Ireland; 2009.
  • 24 Meissner MH, Natiello C, Nicholls SC. Performance of the venous clinical severity score. J Vasc Surg. 2002;36(5):889-95. http://dx.doi.org/10.1067/mva.2002.128637 PMid:12422097.
    » http://dx.doi.org/10.1067/mva.2002.128637
  • 25 Eklöf B, Rutherford RB, Bergan JJ, et al. Revision of the CEAP classification for chronic venous disorders: consensus statement. J Vasc Surg. 2004;40(6):1248-52. http://dx.doi.org/10.1016/j.jvs.2004.09.027 PMid:15622385.
    » http://dx.doi.org/10.1016/j.jvs.2004.09.027
  • 26 Dick IRS. The computer-based patient record: an essential technology for health care. Washington: Institute of Medicine/National Academy Press; 1991.
  • 27 Rind DM, Kohane IS, Szolovits P, Safran C, Chueh HC, Barnett GO. Maintaining the confidentiality of medical records shared over the Internet and the World Wide Web. Ann Intern Med. 1997;127(2):138-41. http://dx.doi.org/10.7326/0003-4819-127-2-199707150-00008 PMid:9230004.
    » http://dx.doi.org/10.7326/0003-4819-127-2-199707150-00008
  • 28 Massad E, Marin HF, Azevedo RS No. O prontuário eletrônico do paciente na assistência, informação e conhecimento médico. São Paulo: Universidade Federal de São Paulo; 2003.
  • 29 Erzinger FL, Malafaia O, Timi JRR. Base eletrônica de dados dos aneurismas arteriais. J Vasc Bras. 2014;13(4):294-305. http://dx.doi.org/10.1590/1677-5449.0100
    » http://dx.doi.org/10.1590/1677-5449.0100
  • 30 Brandão ABF, Timi JRR, Malafaia O. Protocolo eletrônico de coleta de dados clínicos da isquemia visceral crônica. J Vasc Bras. 2017;16(1):35-42. http://dx.doi.org/10.1590/1677-5449.006916 PMid:29930621.
    » http://dx.doi.org/10.1590/1677-5449.006916
  • 31 Nejm CS Jr, Timi JRR, Amaral VB. Base eletrônica de dados clinicos e cirúrgicos em isquemia crônica de membros inferiores. J Vasc Bras. 2013;12(3):207-15. http://dx.doi.org/10.1590/jvb.2013.042
    » http://dx.doi.org/10.1590/jvb.2013.042
  • 32 Borsato EP, Pinto JSP, Malafaia O. Um repositório de metadados para protocolos de pesquisa na área médica. In: Anais do IX Congresso Brasileiro de Informática em Saúde (CBIS'2004); 2004; Ribeirão Preto. Ribeirão Preto: SBIS; 2004.

Publication Dates

  • Publication in this collection
    31 July 2020
  • Date of issue
    2020

History

  • Received
    09 Dec 2019
  • Accepted
    15 May 2020
location_on
Sociedade Brasileira de Angiologia e de Cirurgia Vascular (SBACV) Rua Estela, 515, bloco E, conj. 21, Vila Mariana, CEP04011-002 - São Paulo, SP, Tel.: (11) 5084.3482 / 5084.2853 - Porto Alegre - RS - Brazil
E-mail: secretaria@sbacv.org.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Acessibilidade / Reportar erro