Quality of randomized clinical trials published by plastic surgeons: a long-term follow-up study

▪ ABSTRACT

Introduction:

In two previous studies, the quality of randomized clinical trials (RCTs) with the participation of at least one plastic surgeon was assessed in two periods: from 1966 to 2003 and from 2004 to 2008. The objective is to evaluate the evolution of the quality of RCTs published by plastic surgeons in the subsequent five-year period, from 2009 to 2013.

Methods:

RCTs published from 2009 to 2013, in English, with the participation of at least one plastic surgeon, were identified by an electronic search and classified according to allocation concealment by two independent evaluators. The quality of the studies with adequate allocation concealment was evaluated by two evaluators using the Delphi List and the Jadad Scale.

Results:

Of the 6,997 identified studies, 261 were classified according to allocation concealment. Of these, 43 (16.47%) had adequate allocation concealment. According to an assessment conducted using the Delphi List, there was an improvement in the items “most important characteristics of the prognosis” (p < 0.001), “use of an independent evaluator” (p = 0.0029), and “measures of variability and estimation of points for the primary variable” (p = 0.0057) compared to the 1966-2003 assessment ; there was no difference in the assessment of the same items from 2004-2008. Regarding the Jadad Scale, there was an increase in the scores from 2009 to 2013 compared to the 1996-2003 period (p < 0.0004); however, there was no significant difference in the 2004-2008 period. Conclusion: There was no difference in the quality of the RCTs published by plastic surgeons in the 2009-2013 period compared to the previous five-year period (2004 to 2008). However, both periods indicated higher quality compared to the 1966-2003 period.

Keywords:
Randomized controlled trials as a subject; Evidencebased medicine; Statistical analysis; Random distribution; Plastic surgery

▪ RESUMO

Introdução:

Em dois estudos prévios, avaliou-se a qualidade dos ensaios clínicos aleatórios (ECAs) com a participação de pelo menos um cirurgião plástico, em dois períodos: 1966 a 2003 e 2004 a 2008. O objetivo é avaliar a evolução da qualidade das publicações de ECAs por cirurgiões plásticos no período subsequente de cinco anos, de 2009 a 2013.

Métodos:

ECAs publicados de 2009 a 2013, em língua inglesa, com a participação de pelo menos um cirurgião plástico, foram identificados por busca eletrônica e classificados quanto ao sigilo de alocação, por dois avaliadores independentes. Os estudos com sigilo de alocação adequado tiveram a qualidade avaliada por dois avaliadores, utilizando-se a Lista de Delphi e a Escala de Qualidade de Jadad.

Resultados:

Dos 6.997 estudos identificados, 261 foram classificados quanto ao sigilo de alocação. Destes, 43 (16,47%) tinham sigilo de alocação adequado. Segundo a avaliação pela Lista de Delphi, houve melhora, em relação a 1966-2003, nos itens “características mais importantes do prognóstico” (p < 0,001), “uso de avaliador independente” (p = 0,0029) e “medidas de variabilidade e estimativa de pontos para a variável primária” (p = 0,0057); não houve diferença em relação a 2004-2008. Quanto à Escala de Qualidade de Jadad, houve um aumento dos escores em relação a 1996-2003 (p < 0,0004), mas também sem diferença significante em relação ao período 2004-2008.

Conclusão:

Não houve diferença na qualidade das publicações de ECAs por cirurgiões plásticos no período de 2009 a 2013, em relação aos cinco anos anteriores (2004 a 2008). Entretanto, ambos os períodos apresentaram maior qualidade quando comparados ao período de 1966 a 2003.

Descritores:
Ensaios clínicos controlados aleatórios como assunto; Medicina baseada em evidências; Análise estatística; Distribuição aleatória; Cirurgia plástica

INTRODUCTION

A randomized clinical trial (RCT) is a prospective study design that compares the effect of interventions on humans in one or more groups against a control group. RCTs are the best source of evidence for health interventions. Evidence-based medicine (EBM) is defined as the use of the best existing scientific evidence, provided by appropriately designed and conducted RCTs results, combined with individual clinical expertise and patient preferences and values, for deciding on individual patient care¹-⁴.

EBM became popular in the 1980s and impacted all fields of medicine, including Plastic Surgery5. The application of EBM principles can not only determine the best treatment for the patient but can also reduce the costs of healthcare systems². However, particularly in the surgical areas, there are challenges to overcome, including the belief that the application of EBM could reduce the autonomy of surgeons, and that the best scientific evidence does not always exceed the best practices. This concern is even greater in Plastic Surgery, in which the results are measured not only by the occurrence of complications and need for reintervention, but mainly by patient satisfaction with aesthetic results⁶.

Nevertheless, the EBM practice in Plastic Surgery is no longer a trend, it is a reality⁶. Information obtained from research with methodological rigor has become the key point of EBM and translation of knowledge⁷. Therefore, the results of well-conducted RCTs can have a significant impact on medical care by contributing to the establishment of solid scientific evidence that will serve as basis for clinical care protocols and interventions⁸.

Research in Plastic Surgery will have a much greater influence on clinical practice if studies with greater impact are published9,10. Thus, the identification and systematic evaluation of the RCTs conducted by plastic surgeons, and their impact on the specialty, allow the implementation of evidence-based practice, with direct benefits for patients¹¹,¹².

Several studies have indicated that plastic surgeons recognize the need to improve the level of evidence of research in Plastic Surgery, and this recognition reflects in the continuous increase in publications of clinical trials by this specialty²,⁸,¹²-¹⁷.

A previous study identified RCTs with properly described allocation concealment, published by plastic surgeons between 1966 and 2003, and evaluated their quality¹⁸. Subsequently, in another study, the evolution was assessed over a subsequent five-year period (2004 to 2008), and a quantitative and qualitative increase in the RCTs published by plastic surgeons were observed⁸. This study aimed to test whether there was a quantitative and qualitative improvement in the RCTs in Plastic Surgery in another five-year period (2009 to 2013) compared to previously studied periods.

OBJECTIVES

To evaluate the evolution of randomized clinical trials in Plastic Surgery with adequately described allocation concealment, published between 2009 and 2013, compared to previously studied periods (1966-2003 and 2004-2008).

METHODS

The project was approved by the Research Ethics Committee of the Federal University of São Paulo – Paulista School of Medicine (UNIFESP - EPM), under the number 842.388, CAAE 37661814.8.0000.5505. The cases were selected by convenience, consisting of all the recovered RCTs that met the study eligibility criteria, published over a five-year period (January 2009 to December 2013)

Electronic searches were performed to identify the largest number of RCTs that were published by plastic surgeons in English. Specific search strategies were developed for each studied database, CCTR (Cochrane Central Register of Controlled Trials), LILACS (Latin American and Caribbean Health Science Literature), EMBASE (Excerpta Medica Database), and MEDLINE (MEDLARS- Medical Literature Retrieval System - online).

The abstracts of all retrieved articles were read by an evaluator and those that met the eligibility criteria (possible RCTs in which at least one plastic surgeon participated and published in English between 2009 and 2013) were selected for the reading of their full texts. Studies that were not conducted by plastic surgeons or without the participation of at least one plastic surgeon, and those published in a language other than English, were excluded. At this stage, whenever there was any doubt, the study was selected for reading in its entirety.

The full texts of the articles which had their abstracts selected were read by an evaluator to confirm the eligibility criteria. Subsequently, two independent evaluators classified the selected articles according to their allocation concealment¹⁹, and the disagreements were resolved in a consensus meeting. The RCTs published by plastic surgeons, with adequately described allocation concealment, were selected and constituted the sample of this study.

The selected RCTs were then evaluated for their quality. The evaluation was conducted independently by two evaluators, followed by a consensus meeting. Two validated instruments were used for quality assessment: the Delphi List²⁰ and the Jadad Scale²¹.

The Delphi List is a list of generic criteria for quality evaluation of clinical trials that should be used in combination with other instruments. It does not use scores and all items have two answer choices: “yes” or “no” (Chart 1)²⁰.

Chart 1
Delphi List Items²⁰

1.a.	Were the patients randomly allocated to the treatment groups?
1.b.	If individuals were randomly allocated to the treatment groups, was concealment allocation maintained?
2	Were the groups comparable in terms of the most important characteristics of the prognosis?
3	Were the inclusion and exclusion criteria specified?
4	Did an independent evaluator evaluate the results?
5	Did the caregiver wear a mask?
6	Did the patient wear a mask?
7	Were the measures of variability and the estimation of the points presented for the primary variable?
8	Did the study include an analysis by intention to treat (all allocated patients)?

The Jadad Scale is based on scores: one point is given for each “yes” answer, and a zero point for each “no” answer. Points counted for the first two items (randomization and double blinding) depend not only on how they are described, but also on the use of appropriate methods for this purpose. If the methods are described and appropriate, an additional point is given for each item. If the methods used to generate the randomization sequence or create the blinding conditions are described but inappropriate, the item will receive a zero point. Therefore, the scale encompasses scores from 0 to 5. The study will be considered of poor quality if it receives two or fewer points (Chart 2)²¹.

Chart 2
Jadad Scale Items²¹

1.a.	Was the study described as randomized (use of words such as “random” and “randomized")?
1.b.	Was the method appropriate?
2.a.	Was the study described as double-blind?
2.b.	Was the method appropriate?
3.	Were the losses and exclusions described?

The results were compared to those obtained in the two previous studies that used the same method to evaluate the quality of the RCTs published by plastic surgeons in the 1966-2003 and 2004-2008 periods⁸,¹⁸.

Statistical analysis

Kappa and McNemar tests were used to analyze the concordances and disagreements between the evaluators. The Chi-square test was applied to compare the categorical variables evaluated in the three periods (1966-2003, 2004-2008, and 2009-2013). Kruskal-Wallis analysis of variance was used to compare the Jadad scores in the three periods. The Kolmogorov-Smirnov test was applied to compare, two by two, the Jadad scores in the studied periods²².

Statistical analysis was performed using the BioEstat 5.3 program (Instituto Mamirauá, Pará and Amazonas, Brazil). In all tests, the level of significance used was 0.05 or 5%.

RESULTS

The electronic search identified 6,997 articles in the analyzed databases. One evaluator selected 616 articles, excluding 6,381 that were clearly not RCTs, were repeated in different databases, or did not include the participation of at least one plastic surgeon.

After reading the full texts of the 616 publications, the evaluator excluded 336 articles for the following reasons: one article was published in a language other than English (Russian); 219 did not include the participation of at least one plastic surgeon; 116 were not RCTs. Of the 280 remaining articles, 19 were repeated within the same database. Thus, the final selection comprised 261 studies.

Two evaluators independently classified the 261 selected studies according to their allocation concealment¹⁹. The kappa coefficient of agreement (kw) between the two evaluators was 0.94 (p = 0.000). After a consensus meeting, 43 RCTs published in English, with the participation of at least one plastic surgeon, and with adequately described allocation concealment were selected.

The comparison of the Delphi list items between the 2009-2013 period and previous study periods (1966-2003 and 2004-2008) is shown in Table 1. A significant improvement in scores was observed when comparing the items “Groups were comparable in terms of the most important characteristics of the prognosis” (p < 0.001), “Inclusion and exclusion criteria were specified” (p = 0.0029), and “Measures of variability and estimation of points were presented for the primary variable” (p = 0.0057) in the 1966-2003 and 2004-2008 periods.

Table 1
Quality assessment using the Delphi List after consensus meeting and comparison with the 1966-2003 and 2004-2008vperiods.

	1966-2003		2004-2008		2009-2013		Chi-square test
	Yes n (%)	No n (%)	Yes n (%)	No n (%)	Yes n (%)	No n (%)
1.a. Were the patients randomly allocated to the treatment groups?	34 (100.0)	0	28 (100.0)	0	43 (100.0)	0	-
1.b. If individuals were randomly allocated to the treatment groups, was concealment allocation maintained?	34 (100.0)	0	28 (100.0)	0	43 (100.0)	0	-
2. Were the groups comparable in terms of the most important characteristics of the prognosis?	14 -41.2	20 -58	27 -96.4	1 -3.6	30 -69.8	13 -30.2	χ2 = 21.6 p < 0.0001
3.Were the inclusion and exclusion criteria specified?	17 (50.0)	17 (50.0)	19 (67.9)	9 (32.1)	37 (86.0)	6 (14.0)	χ2 = 11.7 p = 0.0029
4.Did an independent evaluator evaluate the results?	17 -50	17 -50	18 -64.3	10 -35.7	21 -48.9	22 -51.1	χ2 = 1.85 p = 0.3964
5.Did the caregiver wear a mask?	11 -32.4	23 -67.6	9 -32.1	19 -67.9	16 -37.2	27 -62.8	χ2 = 0.28 p = 0.8709
6. Did the patient wear a mask?	20 -58.8	14 -41.2	14 -50	14 -50	24 -55.8	19 -44.2	χ2 = 0.49 p = 0.7814
7. Were the measures of variability and the estimation of the points presented for the primary variable?	15 -44.1	19 -55.9	19 -67.9	9 -32.1	34 -79	9 -21	χ2 = 10.32 p = 0.0057
8. Did the study include an analysis by intention to treat (all allocated patients)?	13 -38.2	21 -61.8	9 -32.1	19 -67.9	18 -41.8	25 -58.2	χ2 = 0.68 p = 0.7120

The kappa coefficient of agreement (kw) between the two evaluators in the evaluation of the 43 RCTs for Jadad scores²¹ was 0.67 (p = 0.0000). Table 2 shows the distribution of the RCTs according to Jadad scores.

Table 2
Quality Scale scores after consensus meeting.

SCORES	1966-2003		STUDIES 2004-2008		2009-2013
	n	%	n	%	n	%
0	4	11.8	0	0	0	0
1	1	2.9	0	0	0	0
2	15	44.1	4	14.2	4	9.3
3	7	20.6	11	39.3	17	39.5
4	4	11.8	2	7.1	6	13.9
5	3	8.8	11	39.3	16	37.2
Total	34	100	28	100	43	100
Kruskal-Wallis analysis of variance: p = 0.0001 1966-2003 < 2004-2008 and 2009-2013 Kolmogorov-Smirnov test: Maximum differences between the cumulative proportions: 1966 - 2003 vs. 2004 -2008: χ2 = 12.18; p = 0.0023 1966 - 2003 vs. 2009 - 2013: χ2 = 18.63; p < 0.0001 2004 - 2008 vs. 2009 - 2013: χ2 = 0.16; p = 0.9192

DISCUSSION

The present study evaluated the evolution of the quality of RCTs published by plastic surgeons since 1966. The long follow-up period of 47 years, using the same method, facilitated a clear analysis of the evolution of studies over this period.

Considering the growing demand for specialized treatments and the limitation of health resources, there has been a growing interest in the practice of so-called “evidence-based medicine,”¹²,¹⁴,²³,²⁴ and the qualitative and quantitative increase of publications of RCTs by plastic surgeons evaluated in the 47 years confirms this interest.

Conducting RCTs in surgical areas is accompanied by many difficulties and challenges, which includes ethical issues that make it impossible to use placebo procedures or even all procedures, compared to a surgical intervention; the impossibility of blinding the surgeon; learning curves; technical differences between surgeons, among others²⁵,²⁶. Thus, the production of RCTs in this field has been slower compared to other medical specialties²⁴,²⁷-³¹.

Despite the difficulties in conducting a randomized clinical trial in plastic surgery, evidence-based medicine is the key to the progress of this specialty¹⁵. Thus, the clinical trials that are effectively conducted should follow strict quality standards and methodological rigor, so that they may have more impact on clinical practice¹¹,¹²,³².

In order to improve the quality of RCTs, a group of researchers and editors elaborated the CONSORT (Consolidated Standards of Reporting Trials) Statement, initially published in 1996 and updated in 2001³¹,³². From the review on the use of the CONSORT Statement, published in 2010, which comprises a checklist and a flow diagram, it became popular and was adopted by most medical journals as the standard for describing RCTs³³.

The use of the CONSORT Statement has contributed to an increase in the quality level of the published RCTs. An important limitation of the present study was the lack of use of the CONSORT checklist to assess the quality of published RCTs. However, it should be noted that the checklist, in its current form, was not available when the two previous studies were designed and conducted, and this study aimed to strictly use the same method as the two previous studies, thus, allowing a long-term evolution assessment.

A progressive increase in the number of RCTs published by plastic surgeons was observed over time. No RCT appropriately describing allocation concealment was published by plastic surgeons from 1966 to 1983. The first RCT with these characteristics was published in 1984, comparing the occurrence of capsular contracture after the use of saline implants or silicone gel for breast reconstruction³⁴. From then on, a progressive increase was observed, following the popularization of EBM from the 1980 decade⁶, but with a substantial increase only from the 2000s onwards.

In the present study, a higher concentration of publications was observed in Europe and North America, following a trend described in the other two periods for comparison (1966-2003 and 2004-2008). Momeni et al.¹¹, when evaluating RCTs in three major plastic surgery journals from 1990 to 2005, also observed a higher number of publications in Europe and North America.

The Delphi List²⁰, used in this study, evaluates three dimensions of the quality of an RCT: internal validity (degree of validity of the study for the assessed sample), external validity (degree of validity of the study in extrapolating its results to the population), and statistical analysis. The comparison of the Delphi List items between the present study (2009-2013) and the first studied period (1966-2003)²⁰ indicates a greater number of responses, with statistical significance, for the items: “The groups were comparable in terms of the most important characteristics of the prognosis,” “The inclusion and exclusion criteria were specified,” and “Measures of variability and estimation of points were presented for the primary variable.” This shows an increase in the quality of RCTs published in the current period regarding these items. However, there was no change in the quality of the studies when the 2009-2013 period was compared to the previous fiveyear period (2004 to 2008).

The Jadad Scale is a short, Yesple, reliable, valid, and widely used instrument²¹,³⁵. Originally designed to assess pain in RCTs, it can be applied in other fields of medicine, since the items are not specific²¹. Olivo et al.³⁵, in a systematic review, analyzed the scales used to assess the methodological quality of RCTs in the health domain. They found that most of the scales did not have strict control over their development, nor were they tested for validity and applicability. They also observed that the Jadad Scale²¹ has been one of the most cited and used in the academic community of the health domain, besides having the best evidence for validity and applicability.

The evaluation of the Jadad scores²¹ indicated that there was a statistically significant increase in quality when comparing the 1966-2003 period to the 2004-2008 and 2009-2013 periods. However, there was no improvement in quality when comparing the 2009-2013 period to the previous five-year period (2004 to 2008), indicating a stabilization in the quality of RCTs.

Yu et al.³⁶ conducted a cross-sectional study aimed at assessing the quality of RCTs publications on surgery that were published in the 2003-2013 period. They used the conformity of the items to the CONSORT 2010³²,³⁶ checklist as quality criteria. They observed that the studies published in 2013 obtained higher scores than those published in 2003, and this was statistically significant, suggesting an improvement in the quality of publications. They concluded that there has been an increase in the quality of RCTs publications on surgery in the last decade. However, this quality remains at suboptimal levels, especially regarding surgical interventions³⁶.

In this study, it was observed that the studies indicated a stabilization in quality compared to the last analyzed period (2009 to 2013) and the period before that (2004 to 2008) regarding the methodological criteria assessed using the Delphi List²⁰ and the Jadad Scale²¹. This could indicate that plastic surgeons, after a significant improvement, may have reached a basic level of quality in terms of criteria used for the publication of RCTs. However, several other items would need to be incorporated in order to increase their quality. This need reflects in the constant improvement of the CONSORT 2010³⁷ checklist, and in the requirement, by an increasing number of journals, of compliance with the checklist items for an RCT to be accepted for publication.

Plastic Surgery is characterized by a long history of innovation, which continues to this day, and has many contributions to share with other medical, clinical, or surgical specialties³¹. Existing barriers should not be considered as obstacles to scientific growth of the specialty, but as challenges to be overcome.

CONCLUSION

There was no difference in the quality of randomized clinical trials (RCTs) with appropriately described concealment allocation, published by plastic surgeons from 2009 to 2013 compared to the previous five-year period (2004 to 2008). However, both periods had better quality RCTs than the 1966-2003 period.

COLLABORATIONS

TBM Analysis and/or data interpretation, conception and design study, data curation, final manuscript approval, formal analysis, methodology, project administration, resources, writing - original draft preparation. DFW Analysis and/or interpretation of data, statistical analysis, study design and design, project administration, methodology, writing - review and editing, supervision. MSN Final approval of the manuscript. LMF Final approval of the manuscript.

TBM	Analysis and/or data interpretation, conception and design study, data curation, final manuscript approval, formal analysis, methodology, project administration, resources, writing - original draft preparation.
DFW	Analysis and/or interpretation of data, statistical analysis, study design and design, project administration, methodology, writing - review and editing, supervision.
MSN	Final approval of the manuscript.
LMF	Final approval of the manuscript.

REFERÊNCIAS

• ^1.
  Swanson JA, Schmitz D, Chung KC. How to practice evidencebased medicine. Plast Reconstr Surg. 2010;126(1):286-94. DOI: https://doi.org/10.1097/PRS.0b013e3181dc54ee
  » https://doi.org/10.1097/PRS.0b013e3181dc54ee
• ^2.
  Rohrich RJ, Eaves FF 3rd. So you want to be an evidencebased plastic surgeon? A lifelong journey. Plast Reconstr Surg. 2011;127(1):467-72. DOI: https://doi.org/10.1097/PRS.0b013e318203a2dd
  » https://doi.org/10.1097/PRS.0b013e318203a2dd
• ^3.
  Kowalski E, Chung KC. The outcomes movement and evidencebased medicine in plastic surgery. Clin Plast Surg. 2013;40(2):241-7. DOI: https://doi.org/10.1016/j.cps.2012.10.001
  » https://doi.org/10.1016/j.cps.2012.10.001
• ^4.
  Sears ED, Burns PB, Chung KC. The outcomes of outcome studies in plastic surgery: a systematic review of 17 years of plastic surgery research. Plast Reconstr Surg. 2007;120(7):2059-65. DOI: https://doi.org/10.1097/01.prs.0000287385.91868.33
  » https://doi.org/10.1097/01.prs.0000287385.91868.33
• ^5.
  Rohrich RJ, Cho MJ. Evidence-Based Medicine in Aesthetic Surgery: The Significance of Level to Aesthetic Surgery. Plast Reconstr Surg. 2017;139(5):1195e-202e
• ^6.
  Leal DG, Rodrigues MA, Tedesco ACB, Nahas FX, Ferreira LM, Roxo ACW, et al. Evidence-Based Medicine in Plastic Surgery: Are We There Yet? Ann Plast Surg. 2018;80(1):71-5.
• ^7.
  Boden C, Bidonde J, Busch A. Gaps exist in the current guidance on the use of randomized controlled trial study protocols in systematic reviews. J Clin Epidemiol. 2017;85:59-69. DOI: https://doi.org/10.1016/j.jclinepi.2017.04.021
  » https://doi.org/10.1016/j.jclinepi.2017.04.021
• ^8.
  Veiga DF, Veiga-Filho J, Pellizzon RF, Juliano Y, Ferreira LM. Evolution of reports of randomised clinical trials in plastic surgery. J Plast Reconstr Aesthet Surg. 2011;64(6):703-9. PMID: 21300583 DOI: https://doi.org/10.1016/j.bjps.2010.11.015
  » https://doi.org/10.1016/j.bjps.2010.11.015
• ^9.
  Sears ED, Burns PB, Chung KC. The outcomes of outcome studies in plastic surgery: a systematic review of 17 years of plastic surgery research. Plast Reconstr Surg. 2007;120(7):2059-65.
• ^10.
  Waljee JF, Larson BP, Chung KC. Measuring treatment effectiveness: a guide to incorporating the principles of evidencebased medicine. Plast Reconstr Surg. 2012;130(6):1382-94. PMID: 23190822
• ^11.
  Taghinia AH, Liao EC, May JW Jr. Randomized controlled trials in plastic surgery: a 20-year review of reporting standards, methodologic quality, and impact. Plast Reconstr Surg. 2008;122(4):1253-63. PMID: 18827662
• ^12.
  Momeni A, Becker A, Antes G, Diener M, Blümle A, Stark BG. Evidence-based plastic surgery: controlled trials in three plastic surgery journals (1990 to 2005). Ann Plast Surg. 2009;62(3):293-6. PMID: 19240528
• ^13.
  Karri V. Randomised clinical trials in plastic surgery: survey of output and quality of reporting. J Plast Reconstr Aesthet Surg. 2006;59(8):787-96. PMID: 16876074
• ^14.
  Loonen MP, Hage JJ, Kon M. Publications of plastic surgery research 1972 through 2004: a longitudinal trend analysis of three international journals. J Plast Reconstr Aesthet Surg. 2007;60(8):934-45.
• ^15.
  Becker A, Blümle A, Antes G, Bannasch H, Torio-Padron N, Stark GB, et al. Controlled trials in aesthetic plastic surgery: a 16-year analysis. Aesth Plast Surg. 2008;32(2):359-62. PMID: 18058165
• ^16.
  Rohrich RJ. So you want to be better: the role of evidence-based medicine in plastic surgery. Plast Reconstr Surg. 2010;126(4):1395-8.
• ^17.
  Agha RA, Camm CF, Edison E, Orgill DP. The methodological quality of randomized controlled trials in plastic surgery needs improvement: a systematic review. J Plast Reconstr Aesthet Surg. 2013;66(4):447-52.
• ^18.
  Veiga-Filho J, Castro AA, Veiga DF, Juliano Y, Castilho HT, Rocha JL, et al. Quality of reports of randomised clinical trials in plastic surgery. Plast Reconstr Surg. 2005;115(1):320-3. PMID: 15622272
• ^19.
  Guidugli F, Castro AA, Atallah AN. Systematic reviews on leptospirosis. Rev Inst Med Trop. 2000;42(1):47-9.
• ^20.
  Verhagen AP, de Vet HC, de Bie RA, Kessels AG, Boers M, Bouter LM, et al. The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998;51(12):1235-41. PMID: 10086815
• ^21.
  Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1-12. PMID: 8721797
• ^22.
  Siegel S, Castellan NJ Jr. Non-Parametric Statistics for the Behavioral Sciences. 2nd ed. New York: McGraw Hill; 1988.
• ^23.
  McCarthy CM, Collins ED, Pusic AL. Where do we find the best evidence? Plast Reconstr Surg. 2008;122(6):1942-7. PMID: 19050548
• ^24.
  Thoma A, Sprague S, Temple C, Archibald S. The role of the randomized controlled trial in plastic surgery. Clin Plast Surg. 2008;35(2):275-84. PMID: 18298999
• ^25.
  McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D. Randomised trials in surgery: problems and possible solutions. BMJ. 2002;324(7351):1448-51.
• ^26.
  Farrokhyar F, Karanicolas PJ, Thoma A, Simunovic M, Bhandari M, Devereaux PJ, et al. Randomized controlled trials of surgical interventions. Ann Surg. 2010;251(3):409-16. PMID: 20142732
• ^27.
  Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials evaluating surgical operations? Surgery. 1995;118(3):459-67.
• ^28.
  Gattellari M, Ward JE, Solomon MJ. Randomized, controlled trials in surgery: perceived barriers and attitudes of Australian colorectal surgeons. Dis Colon Rectum. 2001;44(10):1413-20.
• ^29.
  Huemer GM, Bauer T, Gurunluoglu R, Sakho C, Oehlbauer M, Dunst KM. Analysis of publications in three plastic surgeryvjournals for the year 2002. Plast Reconstr Surg. 2004;114(5):1147-54. PMID: 15457026
• ^30.
  Loiselle F, Mahabir RC, Harrop AR. Levels of evidence in plastic surgery research over 20 years. Plast Reconstr Surg. 2008;121(4):207e-11e. PMID: 18349600
• ^31.
  Goulden O, Waters R. Evidence-based plastic surgery in 2017. JPRAS Open. 2017;12:31-8.
• ^32.
  Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276(8):637-9. DOI: https://doi.org/10.1001/jama.1996.03540080059030
  » https://doi.org/10.1001/jama.1996.03540080059030
• ^33.
  Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. PMID: 20332511
• ^34.
  Asplund O. Capsular contracture in silicone gel and salinefilled breast implants after reconstruction. Plast Reconstr Surg. 1984;73(2):270-5. PMID: 6695025 DOI: https://doi.org/10.1097/00006534-198402000-00022
  » https://doi.org/10.1097/00006534-198402000-00022
• ^35.
  Olivo AS, Macedo LG, Gadotti IC, Fuentes J, Stanton T, Magee DJ. Scales to assess the quality of randomized controlled trials: a systematic review. Phys Ther. 2008;88(2):156-75.
• ^36.
  Yu J, Li X, Li Y, Sun X. Quality of reporting in surgical randomized clinical trials. Br J Surg. 2017;104(3):296-303.
• ^37.
  Moher D, Jones A, Lepage L; CONSORT Group (Consolidated Standards for Reporting of Trials). Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001;285(15):1992-5.

Publication Dates

• Publication in this collection
  05 June 2023
• Date of issue
  2019

History

• Received
  05 Sept 2018
• Accepted
  10 Feb 2019