Open-access Development and validation of the specific instrument for assistance complexity of puerperal and newborns: Fantinelli Scale

Abstract

Objectives:  to develop and validate a care complexity assessment system adapted for mothers and newborns, based on two pre-existing scales.

Methods:  this is a cross-sectional study of psychometric validation of instruments, applied in a roomming-in, in 2016. The instrument has 13 indicators, submitted to the evaluation of a panel of judges for validation. For the psychometric analysis of the instrument, five criteria were adopted: a) internal consistency through Cronbach's alpha (αC); (b) intraclass correlation coefficient (ICC); c) correlation between categorical items, mediating Kendall correlation; d) ceiling and floor effect; e) Kaiser-Meyer-Olkin test.

Results:  after evaluating the judges on the categories, the agreement was satisfactory, being equal to or greater than 80%. The mean total score of the 13 items was 22.5 ± 4.2, with an intermediate level score of 52.9%. For psychometric validation purposes, the instrument presented αC scores of 0.73 points, between minimum items of 0.70 and maximum of 0.74 points. In the correlation of αC by items and the total score, the instrument showed high relationships (r2: 0.84). In the ICC assessment of 0.73 points (CI95%= 0.71-0.75; p<0.001).

Conclusion:  the questionnaire presented psychometric indicators of acceptable content validity, with statistical evidence of reliability, obtained by satisfactory inter-rateragreement.

Key words: Validation; Neonatal nursing; Rooming-in care

Resumo

Objetivos:  desenvolver e validar um sistema de avaliação de complexidade assistencial adaptado para puérperas e recém-nascidos, com base em duas escalas preexistentes.

Métodos:  trata-se de um estudo transversal, de validação psicométrica de instrumentos, aplicado em um alojamento conjunto, no período 2016. O instrumento possui 13 indicadores, submetidos à avaliação de um painel de juízes para validação. Para análise psicométrica do instrumento foram adotados cinco critérios: a) consistência interna por meio do Alfa de Cronbach (αC); b) Coeficiente de correlação intraclasse (CCI); c) correlação entre itens categóricos, mediando a correlação de Kendall; d) efeito teto e piso; e) teste de Kaiser-Meyer-Olkin.

Resultados:  feita a avaliação dos juízes sobre as categorias, a concordância foi satisfatória, sendo igual ou maior a 80%.A média do escore total dos 13 itens foi de 22,5±4,2, com classificação do nível intermediário em 52,9%. Para fins de validação psicométrica, o instrumento apresentou escores de αC de 0,73 pontos, entre itens mínimos de 0,70 e máximo de 0,74 pontos. Na correlação do αC por itens e o escore total, o instrumento demonstrou relações elevadas (r2: 0,84). Na avaliação do CCI de 0,73 pontos (IC95%= 0,71-0,75; p<0,001).

Conclusão:  o questionário apresentou indicadores psicométricos de validade de conteúdos aceitáveis, com evidência estatística de confiabilidade obtida pela satisfatória concordância interavaliadores.

Palavras-chave: Validação; Enfermagem neonatal; Alojamento conjunto

Introduction

The increasing complexity in care production processes and changes in the demand for patient care in hospital area have required restructuring in health organizations and management models.1,2 This context has become a challenge for the management of health institutions in Brazil, as effective and efficient assistance needs to be met with adequate management of human resources.3 In this sense, it is considered important to discuss issues related to the degree of dependence of patients, with regard to nursing assistance, as well as about its impact on the workload of the nursing team.3

The concept of patient classification system (PCS), in health practice, contributes to the improvement of models used to determine the workload of the nursing team, valuing the average work time dedicated to patients classified in different categories of care. This enables the adequacy of methods used until then to determine costs of the assistance provided.4 For this reason, the system has been considered an essential instrument of administrative practice, providing information for the decisionmaking process regarding thecosts of nursing care, organization of services and planning of nursing care.4

The PCS is a process in which one seeks to categorize patients according to the amount of nursing care required, that is, based on the complexity of the care provided.5 This classification process, according to Perroca,6 produces a data source that can be used for the qualitative and quantitative planning of human resources, as well as the material resources necessary to ensure safe nursing care. In addition, using a patient classification system allows to know the profile of users and to plan care in a more individualized way, focused on the needs of patients and the nursing team.6

Fugulin et al.4 classify patients according to the degree of dependence on nursing, being extremely useful for the improvement of official parameters related to the theme of dimensioning nursing staff in hospital institutions.6 Thus, the central point of the study was to develop and validate a scale that contemplates the evaluation of the puerperal woman in its entirety, focusing on the mother-baby binomial (Fantinelli Scale). An evaluation system of care complexity was developed for the puerperal woman, using the evaluation criteria of the Fugulin Method7 and UNICEF7 precepts based on breastfeeding as a reference. In this sense, this study intends to readapt the evaluation criteria more broadly, contemplating significant aspects for the integral and holistic evaluation of the puerperal woman and the newborn. The adapted scale, which received the name of Fantinelli Scale, presents criteria that will contribute to the planning of the dimensioning of personnel, as well as to the readjustment of the nursing team regarding workload and time to dismiss the patients. Thus, the aim of this study is to develop and validate a care complexity assessment system adapted for puerperal women and newborns cared for in the rooming-in.

Methods

This is a cross-sectional, descriptive and analytical study, for the purpose of developing and validating a specific instrument to assess the care indicator in health service, both for identification and for controlling the degree of complexity of care required by the puerperal women and newborns.

The study was developed from July 2016 to November 2016. The survey was performed on the puerperal women and their newborns, hospitalized in the rooming-in, in a private hospital located in the South Zone of the city of Porto Alegre / RS. As exclusion criteria, we considered hospitalized mothers who were unable to participate in the study due to medical reasons.

After reviewing the literature and identifying the basic needs of the puerperium, 13 assessment indicators were created, such as: mental status, therapeutics, feeding, elimination, vital signs, wander, body care, skin integrity, mother's general observations, baby position, latch-on and suction. Each indicator item has a gradation of increasing intensity of care complexity, so that the first item corresponds to the lowest level of care complexity and the last to the maximum level of complexity. Each of these indicators is subdivided into 4 items, on a Likert scale, graded from one to four, which sum can vary from 13 to 52 points.

In order to homogenize its application, different values were assigned to each level of dependence in relation to the care provided and the time available to the patient. The sum of values obtained in each area and the definition of each care category determines the care complexity to be provided to the patient. Minimal care was considered between 13 and 19 points; intermediate care, from 20 to 26 points; semi-intensive care, from 27 to 33 points; intensive care, above 34 points. The adapted scale follows the same definitions as the care categories of the Fugulin scale.6

For content validation purposes, the instrument was sent to a nursing group (judges), consisting of seven members, with extensive professional experience, guaranteeing the participation of specialists in the maternal and child issue (with a postgraduate degree in pediatric nursing or in obstetrics or in maternal and child nursing). These participants had a minimum professional experience of five years in the practice or teaching of maternal and child nursing, since knowledge of the subject was an essential condition for this work.

To analyze the consistency of content and related references, a form was structured with three adjustment options: a) item according to the theme, with no need for adjustment or exclusion; b) item according to the theme, with adjustment needs and c) item without agreement with the theme, requiring exclusion or replacement. Among the 13 items explored, none received attribution (c), only concepts (a/b) were considered. Thus, the concept assignments (b) received adjustments regarding the researchers' suggestions.8

Data were organized in a table in the Microsoft Access database (Microsoft Corporation, Redmond, Washington, United States of America), version 2013 and exported to SPSS statistical software (Statistical Package for the Social Sciences, New York, United States of America) version 20 for Windows. The following tests were carried out: Kaiser-Meyer-Olkin criterion (KMO), for analysis of the inverse correlation matrix; Bartlett´s sphericity test, to test correlated hypotheses, and the Varimaxrotation test, in order to analyze the factor loads of each domain; Cronback’s α coefficient (αC), intraclass correlation coefficient (ICC) and Kendall’s correlation for the purpose of validating the internal consistency of the instrument. Data were expressed by absolute and relative frequencies for categorical variables and standard deviation for continuous variables.

In the statistical analysis, Cronbach's alpha (αC) was used,9 which assesses whether an instrument is able to always measure what it is intended to measure in the same way, performing an average correlation between questions and answers. Acceptable values were used for scores α-C >0.70 and <0.95. In the correlation between categorical items, Kendall's correlation was used, whose acceptable values are r≥0.3 10 and the intraclass correlation coefficient (ICC),10 in order to measure the homogeneity of measurements. This is useful for interpreting the proportion of total variability attributed to the measured object, adopting a cut-off point ≥ 0.70 for classification of the total score (excellent). For ceiling and floor effects, which evaluate the substantial values of answers, provided that they exceed 20%, criteria 1 (Agree/Floor) and 5 (Disagree/Ceiling) were used. In the factorial validity of the domains, three tests were applied: the Kaiser-Meyer-Olkin (KMO) test, with acceptable levels >0.6, the Bartlett´s sphericity test, with acceptable levels of X2 for p<0.001 and the Varimaxfactorial rotation test, with acceptable levels >0.6.11

The study was approved by the Research Ethics Committee (REC) of the proposing institution, under the consolidated opinion nº 2.612.347/2018. All participants signed a Free and Informed Consent Form (FICF).

Results

To validate the questionnaire, the study was carried out from July to November 2016, and 1,396 puerperal women were evaluated, with mean age of 31.1 ± 5.7 years and gestational age of 37.9 ± 2.3 weeks, predominantly Caucasian (869; 62.2%) and predominantly in the first pregnancy (708; 50.7%), through hospitalizations by health insurance (1,207; 86.5%). Regarding the application of the questionnaire, the average of the total score of 13 items was 22.5 ± 4.2, with a classification in the intermediate level in 739 (52.9%), as shown in Table 1.

Table 1
Overall classification of the 1,396 puerperal women evaluated from July 2016 to November 2016 in Porto Alegre / RS.

In the factorial assessment of the items by domain, the questionnaire presented values within the acceptable ones for the three tests applied. Thus presented: Kaiser-Meyer-Olk in criterion (KMO=0.735), Bartlett´s sphericity test, showing values of X2=p<0.001 and Varimax rotation test, presenting five factors, with a minimum load of 0.527 and a maximum of 0.765, as shown in Table 2. The αC was applied for the punctuation of the total score of the 13 items, with scores of 0.73 points and between minimum items of 0.70 and maximum of 0.74 points. In addition, in the αC correlation by items and the total score, the instrument showed high relations (r2= 0.84), with minimum relations of r2=0.11 and maximum of r2= 0.57, all with significance values <0.05. In the evaluation of ICC, the value presented for the total score was considered acceptable, with an ICC of 0.73 (CI95%= 0.71-0.75; p<0.001), as shown in Table 3.

Table 2
Factorial test through Kaiser-Meyer-Olkintest, Bartlett´ssphericity test and Varimax rotation test criteria (n=1,396).
Table 3
Evaluation, punctuation and classification of the psychometric analysis, using αC and ceiling and floor effects of the 13 items of the questionnaire (n = 1,396).

In the evaluation of the ceiling and floor effects, ten (76.9%) of the items presented values above 20% for floor effect (I agree) and only two (15.4%) for ceiling effect (I disagree), as shown in Table 3.

When assessing the correlation between items and through the score of the mean total punctuation (Table 4) only two items of the questionnaire did not show correlations with the total scores of the questionnaire (items 1 and 2).

Table 4
Correlation test between items and total score (n=1,396).

Discussion

It is extremely important, in the current context, to develop a specific instrument to assess the specific degree of assistance complexity in the care of puerperal women and their newborns, in order to determine, monitor and evaluate the individualized care needs for each binomial. The use of appropriate tools for this type of patient will be of great help in the management of the nursing service, in the sense of verifying the workload of your team, using resources that allow you to better reevaluate the attention and planning, as well as the distribution in control of the professional staff. Thus, the present study had as its primary objective the development and validation of a specific instrument in order to assess the care complexity for puerperal women and their babies cared for in the rooming-in, based on the form of observation and assessment of breastfeeding recommended in the guidelines of the World Health Organization (WHO), in the United Nations Children's Fund (UNICEF) and the Fugulin Scale.

Among the recommended breastfeeding promotion actions, there is the observation of mother and newborn during breastfeeding. To guide this practice, a breastfeeding observation protocol was developed by UNICEF, in which it is possible to evaluate the desirable behaviors of mothers and babies and other indications of problems perceived by the nurse.12

The process of validating an instrument is arduous and long, but it is essential that instruments have reliability and validity to minimize the possibility of subjective judgments.13 Validation processes that include careful and systematic steps can guarantee the quality of the results.14

The construction and validation of instruments that measure the quantity and content of information are essential in an attempt to improve the knowledge of puerperal patients. The clarity index generated by professionals and patients determined that the proposed instrument is easy to understand for the population to be evaluated.10,15,16

In assessing clarity, the instrument met the minimum prerequisites for structuring, relevance, credibility and balance, through intelligible, consistent items and expressions befitting the attribute, expressing a single idea to the proposed instrument.10,17,18

This can be stated, since only 3 of the 13 questions answered by the nurses had doubts and did not obtain 100% positive answers, which is equivalent to 80%. Where a high abstention rate was obtained, however, these values were already expected, given that the levels of abstention reported in the literature are 30 to 50% in the first round and 20 to 30% in the subsequent ones.19

The participation of specialist nurses who have extensive professional experience in the areas of care, teaching and research, was essential for the improvement and validation of the instrument. Their expertise contributed to the construction of knowledge, enhancing these dimensions, given the importance of the theme under study.

The experts pointed out activities that were clearly and objectively described and all considered that they were relevant and represented the practice of puerperal nursing care.They also made suggestions related to the following aspects: title of the instrument, standardization of writing style and inclusion of assistance with the binomial mother and baby in the neonatal intensive care unit.

Regarding the validity of the questionnaire content, through factorial analysis of the items by domain, the results showed values within acceptable patterns for the 1,396 tests applied, demonstrating a good factorial correlation between the 13 items and the 4 domains proposed, such as: (KMO=0.735, Bartlett´s=p<0.001 and minimum Varimax rotation of -0.527 and maximum of 0.765).

The validity of the internal consistency through the Chronbach alpha demonstrates that the application of such a coefficient allows us to evaluate the consistency between items, as well as their responses, providing an estimate of the true viability of an instrument for proper measurements, in which values below 0.70 are considered weak and above 0.95 are redundant. Thus, the values attributed to the αC coefficient in this study demonstrate that there is good reliability between questions (items) and their answers in the likert scale format (αC = 0.73). When applying the αC (r2) correlation, we found all values above the expected ≥0.3, reinforcing that there is a positive association between items and categories.

The content validation of the instrument for the Assessment of the Degree of Dependence of the puerperal woman and the newborn proved to be relevant, clear and objective, enabling its application in a reliable way, thus being able to contribute as a parameter for the nursing dimensioning.20

Regarding the nurses who helped validate the content, an excellent degree of agreement was obtained between them, with a minimum value of 0.72 being found in the guidelines for applying the instrument. Thus, it is considered that the scale proposals considered the needs in relation to what was intended to be questioned, according to the nurses.

The data regarding internal consistency and reliability determined the questionnaire's homogeneity and stability, demonstrating that multiple applications can generate similar and accurate results.21-23 Regarding the sample size, a number of 238 patients hospitalized in rooming-in were used, according to a 95% confidence level and a sampling error of 5% per item, proposed in processes of instrument construction and validation.10,24

The FUGULIN instrument is the validated instrument closest to the proposed context, as it is evaluating, mainly, the hospitalized patient in an inpatient unit. However, the aspects addressed are different from those proposed by the present study under validation.

In addition, in this study, complementary assessments were applied to those analyzed by the two instruments (Fugulin + Observation and Breastfeeding Assessment Form), as in the case of the ceiling and floor effect, being considered an important assessment in the validation process of instruments that use responses in likert format, verifying how much the minimum or maximum alternatives influence the answers of the evaluated person. The values found with the application of the ceiling/floor effects show that 10 items (76.9%) obtained prevalence of the minimum answer option (never), which ended up influencing the average of the total questionnaire 22.6 ± 4.2.

There is a gap in the literature about other researches, national and international, developed with this type of patients, making it impossible to compare the results obtained. This reality represents limitations for the discussion of this research. The fact that it was also carried out in a single place, that is, only one maternity hospital, can be a methodological limitation.

The future performance of these tests will make it possible to verify their applicability in care and management practice, as well as to correlate each of these activities with the time spent to perform them, in order to constitute an instrument that determines the workload of the nursing team in these units.22

Thus, it is suggested to expand the focus on the factors that influence planning and management, considering all the complexity inherent to health services and the dimensioning of personnel as indicators for quality of care and the occurrence of adverse events.

The study made it possible to draw a profile of the unit and hospitalized puerperal women, as well as identifying the days of greatest nursing care demand. Therefore, the identification of the profile of this study unit allows the provision of services in assistance with more quality and with the necessary number of collaborators.

The categorization of nursing care is one of the necessary and important parameters in the management of a health service, since it demonstrates the degree of complexity of the care required by the patient, in addition to guiding a possible need for restructuring the management models in rooming-in. Therefore, access to a specific care category in the rooming-in, for the mother-baby binomial, will bring benefits to the organization in care line.

Analyzing the degree of need for patient care, it was possible to observe a greater concentration in semi-intensive care, followed by minimal, intermediate and intensive care. It is believed that this research has brought contributions to overcome the difficulties related to the proposal of parameters for dimensioning nursing staff in the rooming-in, in view of the excellence of care and safety of patients assisted in this area.22

Finally, the values obtained in the present study showed that the Fantinelli Scale is a valid instrument for a specific patient classification system for postpartum care, suggesting that the scale can be used in the management of a health service for the classification of these patients hospitalized in the roomingin. Given the good prevalence and, if properly used, it can become a valuable tool for health care indicators in the identification and control of the degree of complexity of care required by the patient, in addition to guiding a possible need for restructuring management models in the rooming-in.

References

  • 1 Magalhães AMM, iboldi CO, Dall'Agnol CM. Planejamento de recursos humanos de enfermagem: desafio para as lideranças. Rev Bras Enferm. 2009; 62 (4): 608-20.
  • 2 Marquis BL, Huston CJ. Administração e liderança em enfermagem: teoria e prática. 8 ed. Porto Alegre: Artmed; 2015.
  • 3 Silva KS, Echer IC, Magalhães AMM. Grau de dependência dos pacientes em relação à equipe de enfermagem: uma ferramenta de gestão. Esc Anna Nery. 2016; 20 (3): e201600600.
  • 4 Fugulin FMT, Gaidzinski RR, Kurcgant P. Sistema de classificação de pacientes: identificação do perfil assistencial dos pacientes das unidades de internação do HUUSP. Rev Latino-Am Enferm. 2005; 13 (1): 72-8.
  • 5 Perroca MG. Desenvolvimento e validação de conteúdo da nova versão de um instrumento para classificação de pacientes. Rev Latino-Am Enferm. 2011; 19 (1): 58-66.
  • 6 Perroca MG. The new version of a patient classification instrument: assessment of psychometrics properties. J Adv Nurs. 2013; 69 (8): 1862-8.
  • 7 UNICEF. Breastfeeding management and promotion in a baby-friendly hospital: an 18-hour course for maternity staff; 1993. Disponível em: https://www.unicef.org/nutrition/files/BFHI_2009_s3.1and2.pdf
    » https://www.unicef.org/nutrition/files/BFHI_2009_s3.1and2.pdf
  • 8 Santiago LB. Manual de Aleitamento Materno. Sociedade Brasileira de Pediatria. Barueri, SP: Manole; 2013.
  • 9 Dancey C, Reidy J. Statistics without maths for Psychology: using SPSS for Windows. 3 ed. London: Prentice Hall; 2005.
  • 10 Martins GA. Sobre confiabilidade e validade. Rev Bras Gestão Negócios. 2006; 8 (20): 1-12.
  • 11 Pasquali L. Princípios de elaboração de escalas psicológicas. Rev Psiquiatr Clín. 1998; 25 (5): 206-13.
  • 12 OMS (Organização Mundial da Saúde). Amamentação. Genebra; 2003. [Available from: http://biblioteca.planejamento.gov.br/biblioteca-tematica-1/textos/saude-epidemias-xcampanhas-dados-descobertas/texto-87-amamentacao.pdf
    » http://biblioteca.planejamento.gov.br/biblioteca-tematica-1/textos/saude-epidemias-xcampanhas-dados-descobertas/texto-87-amamentacao.pdf
  • 13 Vieira AC, Costa AR, Gomes P. Boas práticas em aleitamento materno: Aplicação do formulário de observação e avaliação da mamada. Rev Soc Bras Enferm Ped. 2015; 15 (1): 13-20.
  • 14 Raymundo VP. Construção e validação de instrumentos: um desafio para a psicolinguística. Letras Hoje. 2009; 44 (3): 86-93.
  • 15 Medeiros RKS, Ferreira Júnior MA, Pinto DPSR, Vitor AF, Santos VEP, Barichello E. Modelo de validação de conteúdo de Pasquali nas pesquisas em Enfermagem. Rev Enf Ref. 2015; SerIV (4): 127-35.
  • 16 Gaidzinski RR. Dimensionamento de pessoal de enfermagem em instituições hospitalares. [tese Livre-Docência]. São Paulo: Escola de Enfermagem da Universidade de São Paulo; 1998.
  • 17 Kurcgant P, Cunha KC, Rapone GR. Subsídios para a estimativa de pessoal em enfermagem. Enfoque (São Paulo). 1989;17(3):79-81.
  • 18 Sommaruga M, Vidotto G, Bertolotti G, Pedretti R, Tramarin R. A self administered tool for the evaluation of the efficacy of health education interventions in cardiac patients. Monaldi Arch Chest Dis. 2003; 60 (1): 7-15.
  • 19 Pasquali L. Instrumentação psicológica: Fundamentos e práticas [Psychological instrumentation: Bases and practices]. Porto Alegre: Artmed; 2010.
  • 20 Macedo ABT. Avaliação da carga de trabalho, estresse psicossocial e resiliência nos profissionais de enfermagem em uma unidade de internação para adultos portadores de germes multirresistentes [dissertação]. Porto Alegre: Universidade Federal do Rio Grande do Sul; 2013.
  • 21 Fugulin FMT, Silva S, Shimizu HE, Campos F. Implantação do sistema de classificação de pacientes na unidade de clínica médica do hospital universitário da USP. Rev Med HU-USP. 1994; 4 (1/2): 63-8.
  • 22 Machado CR, Poz MR. Sistematização do conhecimento sobre as metodologias empregadas para o dimensionamento da força de trabalho em saúde. Saúde Debate. 2015; 39 (104): 239-54.
  • 23 Pilotto DTS, Vargens OMC, Progianti JM. Alojamento conjunto como espaço de cuidado materno e profissional. Rev Bras Enf. 2009; 62 (4): 604-7.
  • 24 Santos NC, Fugulin FMT. Construção e validação de instrumento para identificação das atividades de enfermagem em unidades pediátricas: subsídio para determinação da carga de trabalho. Rev Esc Enferm USP. 2013; 47 (5): 1052-60.

Publication Dates

  • Publication in this collection
    05 Aug 2020
  • Date of issue
    Apr-Jun 2020

History

  • Received
    14 May 2019
  • Accepted
    27 Dec 2019
location_on
Instituto de Medicina Integral Prof. Fernando Figueira Rua dos Coelhos, 300. Boa Vista, 50070-550 Recife PE Brasil, Tel./Fax: +55 81 2122-4141 - Recife - PR - Brazil
E-mail: revista@imip.org.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Acessibilidade / Reportar erro