ABSTRACT
Objective:
To develop and verify content and face validity evidence of a mobile application prototype for heart failure patients self-care.
Method:
Study of technological development based on Contextualized Instructional Design. In the validation stage, six cardiology specialist nurses evaluated the content through the Suitability Assessment of Materials and 13 people with heart failure underwent face validity assessment, through content validity index. Data were analyzed using descriptive statistics.
Results:
The prototype of the application, called “Tum Tum”, has an interface and free navigation screens covering the concept of heart failure, its causes, symptoms and signs, diagnosis, and treatment. It has a mosaic with educational guidelines, resources for early recognition of signs of clinical decompensation, registration for body weight control, reminders for medication use, consultation and exam schedule. The technology proved to be adequate among specialists and the target audience.
Conclusion:
It was possible to develop and validate the content and face of the “Tum Tum” application prototype, which demonstrates the potential to promote self-care in people with heart failure.
DESCRIPTORS
Heart Failure; Self Care; Mobile Applications; Educational Technology; Validation Study
RESUMEN
Objetivo:
Desarrollar y verificar evidencias de validez de contenido y facial de un prototipo de aplicación móvil para el autocuidado de personas con insuficiencia cardíaca.
Método:
Estudio del desarrollo tecnológico basado en el Diseño Instruccional Contextualizado. En la etapa de validación, seis enfermeros especialistas en cardiología evaluaron el contenido a través del Suitability Assessment of Materials y 13 personas con insuficiencia cardíaca se sometieron a evaluación facial, por el índice de validez de contenido. Los datos fueron analizados utilizando estadística descriptiva.
Resultados:
El prototipo de la aplicación, denominado “Tum Tum”, cuenta con una interfaz y pantallas de navegación gratuitas que abordan el concepto de insuficiencia cardiaca, causas, signos y síntomas, diagnóstico y tratamiento. Cuenta con un mosaico con pautas educativas, recursos para el reconocimiento temprano de signos de descompensación clínica, registro para el control de peso corporal, recordatorios para el uso de medicamentos, calendario de consultas y exámenes. La tecnología demostró ser adecuada entre los especialistas y el público objetivo.
Conclusión:
Se logró desarrollar y validar el contenido y la face del prototipo de la aplicación “Tum Tum”, que demuestra el potencial para promover el autocuidado en personas con insuficiencia cardíaca.
DESCRIPTORES
Insuficiencia Cardíaca; Autocuidado; Aplicaciones Móviles; Tecnología Educacional; Estudio de Validación
RESUMO
Objetivo:
Desenvolver e verificar as evidências de validade de conteúdo e face de um protótipo de aplicativo móvel para o autocuidado de pessoas com insuficiência cardíaca.
Método:
Estudo de desenvolvimento tecnológico baseado no Design Instrucional Contextualizado. Na etapa de validação, seis enfermeiros especialistas em cardiologia avaliaram o conteúdo por meio do Suitability Assessment of Materials e 13 pessoas com insuficiência cardíaca realizaram avaliação de face, pelo índice de validade de conteúdo. Os dados foram analisados por meio de estatística descritiva.
Resultados:
O protótipo do aplicativo, nomeado “Tum Tum”, possui interface e telas de livre navegação que abordam o conceito da insuficiência cardíaca, causas, sinais e sintomas, diagnóstico e tratamento. Apresenta mosaico com orientações educativas, recursos para o reconhecimento precoce de sinais de descompensação clínica, registro para controle do peso corporal, lembretes para o uso de medicamentos, agenda de consultas e exames. A tecnologia mostrou-se adequada entre especialistas e público-alvo.
Conclusão:
Foi possível desenvolver e validar o conteúdo e face do protótipo do aplicativo “Tum Tum”, que demonstra potencial para promover o autocuidado em pessoas com insuficiência cardíaca.
DESCRITORES
Insuficiência Cardíaca; Autocuidado; Aplicativos Móveis; Tecnologia Educacional; Estudos de Validação
INTRODUCTION
Heart failure (HF) is a chronic disease with a high prevalence worldwide, estimated at 64.34 million people(11. Lippi G, Sanchis-Gomar F. Global epidemiology and future trends of heart failure. AME Med J. 2020;5(15):1–6. doi: http://dx.doi.org/10.21037/amj.2020.03.03.
http://dx.doi.org/10.21037/amj.2020.03.0...
), responsible for low quality of life and morbidity and mortality, high rates of hospitalizations due to decompensation and, consequently, high financial costs for the health system(22. Rohde LEP, Montera MW, Bocchi EA, Clausell NO, Albuquerque DC, Rassi S, et al. Comitê Coordenador da Diretriz de Insuficiência Cardíaca. Diretriz brasileira de insuficiência cardíaca crônica e aguda. Arq Bras Cardiol. 2018;111(3):436–539. doi: http://dx.doi.org/10.5935/abc.20180190. PubMed PMID: 30379264.
http://dx.doi.org/10.5935/abc.20180190...
).
Considering the complexity of the treatment, it is imperative that patients with HF adopt self-care behaviors to maintain compensation. Better levels of self-care are related to lower readmission rates(33. Ruppar TM, Cooper PS, Johnson ED, Riegel B. Self-care interventions for adults with heart failure: a systematic review and meta-analysis protocol. J Adv Nurs. 2019;75(3):676–82. doi: http://dx.doi.org/10.1111/jan.13903. PubMed PMID: 30397943.
http://dx.doi.org/10.1111/jan.13903...
), better quality of life(44. Vellone E, Fida R, Ghezzi V, D’Agostino F, Biagioli V, Paturzo M, et al. Patterns of self-care in adults with heart failure and their associations with sociodemographic and clinical characteristics, quality of life, and hospitalizations: a cluster analysis. J Cardiovasc Nurs. 2017;32(2):180–9. doi: http://dx.doi.org/10.1097/JCN.0000000000000325. PubMed PMID: 26938506.
http://dx.doi.org/10.1097/JCN.0000000000...
) and lower mortality(55. Ruppar TM, Cooper PS, Mehr DR, Delgado JM, Dunbar-Jacob JM. Medication adherence interventions improve heart failure mortality and readmission rates: systematic review and meta-analysis of controlled trials. J Am Heart Assoc. 2016;5(6):e002606. doi: http://dx.doi.org/10.1161/JAHA.115.002606. PubMed PMID: 27317347.
http://dx.doi.org/10.1161/JAHA.115.00260...
). However, poor adherence to self-care is a worldwide problem that predicts unfavorable clinical outcomes(66. Mlynarska A, Golba KS, Mlynarski R. Capability for self-care of patients with heart failure. Clin Interv Aging. 2018;13:1919–27. doi: http://dx.doi.org/10.2147/CIA.S178393. PubMed PMID: 30349210.
http://dx.doi.org/10.2147/CIA.S178393...
,77. Lee KS, Moser DK, Dracup K. Relationship between self-care and comprehensive understanding of heart failure and its signs and symptoms. Eur J Cardiovasc Nurs. 2018;17(6):496–504. doi: http://dx.doi.org/10.1177/1474515117745056. PubMed PMID: 29192794.
http://dx.doi.org/10.1177/14745151177450...
). In Brazil, the scarcity of specialized clinics in health care settings and gaps in patients’ knowledge about the disease and treatment contribute to the low adherence of patients with HF to the complex therapeutic regimen(88. Cavalcante LM, Lima FET, Custódio IL, Oliveira SKP, Meneses LST, Oliveira ASS, et al. Influence of sociodemographic characteristics in the self-care of people with heart failure. Rev Bras Enferm. 2018;71(Supl. 6):2604–11. doi: http://dx.doi.org/10.1590/0034-7167-2017-0480. PubMed PMID: 30540034.
http://dx.doi.org/10.1590/0034-7167-2017...
).
The use of technological resources can be a viable strategy to strengthen healthy behaviors and promote better adherence to treatment. Mobile health technology (mHealth) is a promising tool that can help improve self-management of chronic diseases. It is defined as the use of smartphones, tablets, and other mobile devices to provide health care and preventive health services(99. Athilingam P, Jenkins B. Mobile phone apps to support heart failure self-care management: integrative review. JMIR Cardio. 2018;2(1):e10057. doi: http://dx.doi.org/10.2196/10057. PubMed PMID: 31758762.
http://dx.doi.org/10.2196/10057...
).
The mobile applications (apps) have been used as an adjuvant educational tool for people with HF, to improve the information and education systems in different aspects, promote a positive perception regarding the importance of self-care, helping the patient to self-monitor symptoms and signs, control and manage the disease, with no time and space restrictions(1010. Athilingam P, Jenkins B, Johansson M, Labrador M. A Mobile health intervention to improve self-care in patients with heart failure: pilot randomized control trial. JMIR Cardio. 2017;1(2):e3. doi: http://dx.doi.org/10.2196/cardio.7848. PubMed PMID: 31758759.
http://dx.doi.org/10.2196/cardio.7848...
,1111. Mortara A, Vaira L, Palmieri V, Iacoviello M, Battistoni I, Iacovoni A, et al. Would you prescribe mobile health apps for heart failure self-care? An integrated review of commercially available mobile technology for heart failure patients. Card Fail Rev. 2020;6:e13. doi: http://dx.doi.org/10.15420/cfr.2019.11. PubMed PMID: 32537246.
http://dx.doi.org/10.15420/cfr.2019.11...
). International evidence points to beneficial results regarding the use of mHealth technology as an intervention strategy for self-care and reduction in hospitalization rates(1212. Chen C, Li X, Sun L, Cao S, Kang Y, Hong L, et al. Post-discharge short message service improves short-term clinical outcome and self-care behaviour in chronic heart failure. ESC Heart Fail. 2019;6(1):164–73. doi: http://dx.doi.org/10.1002/ehf2.12380. PubMed PMID: 30478888.
http://dx.doi.org/10.1002/ehf2.12380...
,1313. Li X, Chen C, Qu MY, Li Z, Xu Y, Duan XF, et al. Perceptions and acceptability of receiving sms self-care messages in Chinese patients with heart failure an inpatient survey. J Cardiovasc Nurs. 2017;32(4):357–64. doi: http://dx.doi.org/10.1097/JCN.0000000000000349. PubMed PMID: 27617565.
http://dx.doi.org/10.1097/JCN.0000000000...
).
Despite the popularity of smartphones and the use of mobile devices in the world, the strategy mHealth in Brazil is incipient, given that the clinical care of people with HF is heterogeneous in view of economic, educational, and cultural differences, as well as in access to health services.
When searching for apps in the Google® Play Store and Apple® Store, no apps aimed at promoting self-care in people with HF in Portuguese were found. The apps available are from North American countries in the English language. The use of smartphones by the population with HF is increasingly frequent(1414. Pezel T, Berthelot E, Gauthier J, Chong-Nguyen C, Iliou MC, Juillière Y, et al. Epidemiological characteristics and therapeutic management of patients with chronic heart failure who use smartphones: potential impact of a dedicated smartphone application (report from the OFICSel study). Arch Cardiovasc Dis. 2021;114(1):51–8. doi: http://dx.doi.org/10.1016/j.acvd.2020.05.006. PubMed PMID: 32868257.
http://dx.doi.org/10.1016/j.acvd.2020.05...
), which highlights the pertinence of building complementary tools via mobile applications and their potential usefulness for health self-management.
Thus, it becomes relevant to develop innovative technologies for the promotion of self-care, which can be easily incorporated into clinical practice to promote knowledge, self-management skills, and to improve health-related quality of life to reduce hospitalizations, emergency readmissions, and mortality in this population. This proposal is in line with the Sustainable Development Goals (SDGs) in terms of health and well-being. In view of the above, the objective is to develop and verify the evidence of content and face validity of a mobile application prototype to promote self-care in people with HF.
METHOD
Design of Study
The methodology of this study is technological, based on the Contextualized Instructional Design (CID). This method involves the following steps: analysis; design/development; implementation; and evaluation(1515. Filatro A. Design instrucional contextualizado. São Paulo: SENAC; 2019.).
Local
The study was carried out in a large federal teaching hospital located in the state of Paraíba, a reference in specialized cardiology care.
Study Protocol
The study was carried out in three steps, namely:
1st Step – Analysis
This step consisted of providing tools and resources to meet the learning needs of the target audience(1515. Filatro A. Design instrucional contextualizado. São Paulo: SENAC; 2019.). For that, a narrative review of the literature was carried out to identify the educational content directed to the self-care of people with HF. Pubmed/MEDLINE, CINAHL, and Scopus databases were consulted in search of scientific productions. The following descriptors of Medical Subject Headings (MeSH) were used: “Heart failure”; “Self-care”; and “Mobile applications”, associated through the Boolean operator “AND”.
Based on scientific evidence and researchers’ experience in cardiovascular care, remote scientific meetings were held to prepare the textual content and select educational topics on non-pharmacological and pharmacological management indicated for people with HF, such as: daily monitoring of body weight, restriction of fluids, consumption of a low-sodium diet, correct and regular use of prescribed medications, practice of physical activity, recognition of signs of clinical decompensation, immunizations, among others(33. Ruppar TM, Cooper PS, Johnson ED, Riegel B. Self-care interventions for adults with heart failure: a systematic review and meta-analysis protocol. J Adv Nurs. 2019;75(3):676–82. doi: http://dx.doi.org/10.1111/jan.13903. PubMed PMID: 30397943.
http://dx.doi.org/10.1111/jan.13903...
,1616. Jaarsma T, Hill L, Bayes‐Genis A, Brunner La Rocca H, Castiello T, Čelutkienė J, et al. Self-care of heart failure patients: practical management recommendations from the Heart Failure Association of the European Society of Cardiology. Eur J Heart Fail. 2021;23(1):157–74. doi: http://dx.doi.org/10.1002/ejhf.2008. PubMed PMID: 32945600.
http://dx.doi.org/10.1002/ejhf.2008...
).
2nd Step – Design/Development
In this stage, the instructional content was elaborated to promote self-care, using the literature evidence identified in the first stage. Accessible language was adopted, without the use of technical terms, to help in understanding the content. There was help from a consultant, a graphic designer, for creating and developing the interface, and from a systems analyst, for implementing the prototype. Periodic meetings with the project team were held to discuss name, interface, screens, icons, layout, color selection, illustrations, typography, font size, spacing, colors, image, figures, and prototype functionality positioning.
The interface and screens were created using the software Figma® that, through the wireframe, simulated the prototype of the application. The icons and illustrations were customized by the design professional and/or adapted from two Open Source libraries: Storyset and Feather Icons, in shades of navy blue and red, in reference to blood circulation, on a white background and Milush typography. Easy-to-understand illustrations were used for better comprehension of the text.
Currently, in the smartphones market, there are essentially two platforms that dominate the market, Android® and iOS® (used in iPhones). At first, it would be necessary to implement an application to meet each of them, if desired, and each one would require specific software, languages, and knowledge. However, the development of a hybrid model with a single code base was selected. Thus, in the involvement phase, more specifically in the implementation of the application prototype, the framework React Native was used, which allows the construction of native mobile applications for the Android® and iOS® platforms based on a single project written in JavaScript language and does not compromise the user experience. With this single base, it will be possible to make the app available in the Play Store® and Apple Store® application stores, achieving greater public access. The user will need to have access to the internet to download the application and, after downloading it on the smartphone, the application can be used offline.
This phase involved building the application prototype with the collaboration of a systems analyst, who developed the software based on the content produced in the previously described steps.
3rd Step – Validation of Content and Face
Once the prototype with interface with all the content was finished, the content was evaluated and validated by an experts committee. Although the number of specialists is not consensual, the inclusion of five to 10 in the validation process is suggested(1717. Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15(2):214–21. doi: http://dx.doi.org/10.1016/j.sapharm.2018.03.066. PubMed PMID: 29606610.
http://dx.doi.org/10.1016/j.sapharm.2018...
).
The identification of the expert committee occurred through the Lattes Platform. In the tab for advanced search by subject, the following keywords were used: self-care, heart failure, and health technologies. Experts were recruited through non-probabilistic and intentional sampling. The following inclusion criteria were adopted: having a graduate certificate and/or a Master’s degree in cardiovascular nursing; having clinical-assistance experience with the target audience for at least two years; and having work published in journals and/or events on the subject. Twenty-eight potential experts were identified.
The experts were invited by email. Those who agreed to participate received a questionnaire for professional characterization, an evaluation form about the technical-scientific content of the application, and the Free Informed Consent Form (FICF) through a form available via google forms with screens in PDF format and a link for access to the high fidelity prototype in the Figma® software. The material had to be returned within 20 days, with this period being extended for another 15 to 30 days according to the request of the specialists.
Next, face validation took place with the target audience, at the cardiology outpatient clinic of the teaching hospital. A non-probabilistic sample was selected for convenience, consisting of patients with a medical diagnosis of HF, of any etiology, aged 18 years or older, who had a smartphone and finished high school. The decision of adopting the criterion of finished high school was taken so that the participants could access and evaluate the interface and clarity of the content independently.
Patients with no cognitive conditions to answer the data collection instruments did not integrate the sample. To identify the preserved cognitive condition, five questions adapted from a previous study were applied(1818. Ignácio IB, Fernandes PA, Maier SRODC, Dessotte CAM. Anxiety, depression and cardiac anxiety in patients with implantable cardioverter-defibrillator according to gender and age. Rev Rene. 2021;22:e6111. doi: http://dx.doi.org/10.15253/2175-6783.20212261117.
http://dx.doi.org/10.15253/2175-6783.202...
): What is today’s date? How old are you? What day of the week are we on? What is the name of the place we are in right now? What’s your full name? Patients who made mistakes or did not know how to answer three or more questions did not participate in the study. The researchers went to the cardiology outpatient clinic, having a list with the names of the people who would be assisted on that day. Those who met the inclusion criteria were invited to participate in the research, before or after a medical consultation. An Apple iPhone XR® was used with software Figma® for prototype visualization.
Data Collection
Data were collected from October 2021 to February 2022. The specialists evaluated the application interface and content individually, using the adapted instrument Suitability Assessment of Materials (SAM) validated for Brazilian Portuguese, which assesses the difficulty and convenience of health-related educational materials(1919. Sousa CS, Turrini RNT, Poveda VB. Translation and adaptation of the instrument “suitability assessment of materials” (SAM) into portuguese. J Nurs UFPE Oline. 2015;9(5):7854–61. doi: http://dx.doi.org/10.5205/1981-8963-v9i5a10534p7854-7861-2015.
http://dx.doi.org/10.5205/1981-8963-v9i5...
). SAM is an instrument with 22 items, organized into six categories: content; language; graphic illustrations; layout and presentation; motivation; and cultural appropriateness. As response options for each aspect evaluated, the following are scored: 2 points = Adequate, 1 point = Partially Adequate, 0 = Inadequate. In this investigation, the item “The illustrations have legends” was not considered by the specialists, since the illustrations used are self-explanatory.
The evaluation instrument intended for face validation by the target audience was adapted from a previous study carried out with people with HF(2020. Sousa MM, Almeida TCF, Gouveia BLA, Freire MEM, Oliveira SHS. Validation of persuasive audiovisual communication to reduce salt consumption by people with heart failure. Rev Esc Enferm USP. 2021;55:e03751. doi: http://dx.doi.org/10.1590/s1980-220x2020006503751. PubMed PMID: 34190894.
http://dx.doi.org/10.1590/s1980-220x2020...
), consisting of two parts: the first, containing information for characterizing the sample, and the second, evaluative items about the application organization, illustrations, figures, font size, content, language, and motivation to use the application. The items were answered using a four-point Likert-type scale, as follows: 1 = strongly disagree; 2 = disagree; 3 = agree; 4 = strongly agree. At the end, participants were asked the following questions: Do you need any further information about self-care? What did you like about the app? What didn’t you like about the app? Do you believe you can use this application in your daily life?
Data Analysis and Treatment
The answers obtained from the specialists and participants were organized in tables, followed by descriptive analysis, with calculation of absolute and relative frequencies, as well as measures of central tendency (mean) and dispersion (standard deviation).
The total SAM score ranges from 0 to 44 points. In this study, the possible sum is equivalent to 42 points, since the item “The illustrations have legend” was not applied. Thus, the result obtained by the experts was calculated by means of the total sum of points obtained divided by the maximum possible score and multiplied by 100. To evaluate the global SAM score, the arithmetic mean of the sums of each specialist (Σ) was calculated, divided by the number of specialists and multiplied by 100. Thus, it was possible to find the following percentages: 70 – 100% (superior material), 40 – 69% (adequate material) or 0 – 39% (inadequate material)(2121. Doak CC, Doak LG, Root JH. Teaching patients with low literacy skills. 2nd ed. Philadelphia: Lippincott Company; 1996. doi: http://dx.doi.org/10.1097/00000446-199612000-00022.
http://dx.doi.org/10.1097/00000446-19961...
).
To analyze the results of the face validation by the target audience, the Content Validity Index (CVI) was used through the agreement of the items individually (Item-Level Content Validity Index I-CVI), expressed by the formula: number of participants who rated the items as 3 or 4, divided by the total number of participants. To classify the item as valid, a value ≥ 0.78 is desirable. The evaluated items that obtained CVI < 0.78 were reformulated according to the suggestions of people with HF(2222. Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Colet. 2011;16(7):3061–68. doi: http://dx.doi.org/10.1590/S1413-81232011000800006
http://dx.doi.org/10.1590/S1413-81232011...
). To evaluate the content in general, the sum of the items with CVI > 0.78 was performed, and divided by the total number of items. Content is considered valid with a global score ≥ 0.80(2222. Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Colet. 2011;16(7):3061–68. doi: http://dx.doi.org/10.1590/S1413-81232011000800006
http://dx.doi.org/10.1590/S1413-81232011...
). In addition, the general opinion of the participants regarding the application was requested.
Ethical Aspects
The study complied with the ethical aspects contained in Resolution 466/12 of the National Health Council and was approved by the Research Ethics Committee, under Opinion No. 4.620.748/2021. The participants authorized their participation by signing the Free and Informed Consent Form.
RESULTS
“Tum Tum” is an application prototype developed to provide educational information about self-care in HF. The application received this name in allusion to the sound of heartbeats. The icon representing the application is a heart.
On the home screen, the registration can be done by filling in personal information. The user can also access the content in guest mode through free navigation screens. However, to register and view data history, prior log in is required. Next, welcome screens are displayed to the user with information about the purpose and content of the app.
Once the user has logged in or opted for the guest mode, “Tum Tum” presents its interface with the functionalities. This interface has three tabs and a bottom bar, which indicates the tab selected and allows switching to another one. The first tab is called Mosaic and has five buttons at the top, which open screens with information about HF, causes, symptoms, diagnosis, and treatment. Below, an informative mosaic is displayed, organized into nine educational topics to promote self-care: (1) weight; (2) food; (3) exercises; (4) sexual activity; (5) medicines; (6) mental health; (7) sleep;(8) vaccination; and (9) smoking habit.
The second tab, called My Health, is divided into Routine and History. In the Routine, the patient finds functionalities for registering medications, exams and medical appointments. It is possible to program reminders for these according to medical prescription or as needed, and it also features functionality to inform daily body weight as well as report symptoms. The patient will be able to select signs and/or symptoms of HF through checkboxes and will be alerted to seek an urgent and emergency service when checking three or more clinical manifestations, a condition that signals a state of clinical decompensation of the disease. It is also possible to indicate the number of pillows used to sleep, a resource that allows assessment of breathing difficulties during sleep (orthopnea). In History, the user will be able to briefly observe information that he/she recorded previously, with emphasis on the graph with weight variation, which warns of sudden weight gain.
The third tab contains the Settings, which allow making adjustments more related to the needs of each user in the application and accessing information about the project. It should be noted that none of the data is mandatory, ensuring the user accessibility to all the content produced. Figure 1 illustrates the application interface.
The initial version of the prototype was sent to a committee of experts for content evaluation. Of the 28 potential experts invited, 20 did not respond to the initial contact, two declined to participate, and six experts agreed to participate in the research. The six specialists were nurses, lived in the cities of São Paulo, Rio de Janeiro, Uberlândia, and Porto Alegre, had a mean age of 38.67 (± 6.62) years, were mostly female (66.7%), were PhDs in Nursing, worked as Professors, had clinical experience in the care of people with HF, and participated in research projects in the area of care technologies, which show qualification to evaluate the technological artifact. Table 1 presents the score distribution of the application evaluation by specialist nurses based on SAM items.
Adequacy of the application according to the evaluation by specialist nurses – João Pessoa, PB, Brazil, 2022.
Regarding the SAM score, it was found that it reached high scores, classifying educational technology as superior material (≥ 70%). The entire committee of specialists also evaluated the application as of superior category, reaching an overall percentage of 88.4%. Among the 22 items evaluated, only one expert rated the content for promoting self-care in HF as inappropriate, explaining that it was possible to add more educational information. Due to the good evaluation rates achieved, there was only one round of evaluation with specialists.
In addition to the score established for each SAM item, the evaluators were able to use the space intended for suggestions of improvements to the prototype. The comments provided regarding the content, language, illustrations, layout, presentation and motivation for the app content are shown in Chart 1.
After adapting the material to the suggestions, face validation was carried out by the target audience. Fifteen patients with HF were invited, of which 13 agreed to participate. It should be noted that no participants had an impaired cognitive condition.
With regard to age, the mean was 55.92 (± 12.95) years, 53.8% (n = 7) were female, 38.5% (n = 5) were single, 38.5% (n = 5) were married/in a common law marriage relationship, 100% had completed high school and had an average family income of two minimum wages. The most prevalent etiology of HF was non-ischemic, with 76.9% (n = 10); 46.2% (n = 6) were in functional class III; and 30.8% (n = 4) in functional class II. The mean time since diagnosis was seven years (± 6.25), ranging from one to 21 years, and 100% were using diuretics. Asked whether they used or had used any application for HF, 92.3% (n = 12) said they had never used it. Table 2 presents the results of face validation by the target audience.
Results of the face evaluation by the target audience (n = 13) – João Pessoa, PB, Brazil, 2022.
Regarding the evaluated items, it is observed that only item 6, which evaluates the size of the letter, received a score < 0.78. The other items showed excellent agreement among the target audience, showing a total CVI of 0.98. At the end of the evaluation, participants reported: I believe that the use of the application will help the treatment (P1). I will use it because I need to take care of myself (P4). I understand the disease better (P7). I liked it a lot, it has information I didn’t know (P6). It is important as it helps with medication (P11). We never know everything, we always need to know more about the heart (P12). I will definitely use it, it will be like a companion (P3). No participant reported not liking the application.
DISCUSSION
The technology mHealth is innovating communication processes, as it can reach larger populations, with no time restrictions, enhancing the teaching and learning process and, consequently, the promotion, prevention, therapeutic adherence, and health rehabilitation of health in different parts of the world. Studies(2323. Choi JY, George M, Yun SY. Development of a smartphone application for Korean patients with chronic obstructive pulmonary disease: self-monitoring based action plans. Appl Nurs Res. 2021;61:151475. doi: http://dx.doi.org/10.1016/j.apnr.2021.151475. PubMed PMID: 34544569.
http://dx.doi.org/10.1016/j.apnr.2021.15...
,2424. Jiang S, Lv M, Wu T, Chen W, Zhang J. A smartphone application for remote adjustment of warfarin dose: development and usability study. Appl Nurs Res. 2022;63:151521. doi: http://dx.doi.org/10.1016/j.apnr.2021.151521. PubMed PMID: 35034699.
http://dx.doi.org/10.1016/j.apnr.2021.15...
) have been carried out in high-income countries to develop a tool to support self-management of care and health education in patients with chronic diseases. In Brazil, the development of these technologies has increased; however, the high financial investment impacts its operationalization and incorporation into the public health system.
This study developed and verified content and face validity evidence of a mobile application prototype for HF patients self-care. The project was carried out in partnership with professionals from design and information technology, which ensured superior quality to the proposed technology. “Tum Tum” application interface and screens were designed with a pleasant layout, ease of use, on a white background, with interactions, clear information, accessible vocabulary, aimed at facilitating understanding and handling by people with HF. Primacy of these characteristics in the construction of “Tum Tum” considered the pertinence of the argument that mobile technologies should be built based on the elements of simplicity, usefulness, easy visualization, suitability for the target audience(2525. Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, et al. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform. 2016;60:243–51. doi: http://dx.doi.org/10.1016/j.jbi.2016.02.002. PubMed PMID: 26903153.
http://dx.doi.org/10.1016/j.jbi.2016.02....
).
It should be highlighted that, in the development of educational technologies, validation of content by experts and target audience is a recommended technique. Recent studies using this method obtained a similar number of participating experts(2626. Almeida TCF, Sousa MM, Gouveia BLA, Almeida AAM, Oliveira SHS. Prototype of a motivational mobile application for people with hypertension. Acta Paul Enferm. 2021;34:eAPE001055. doi: http://dx.doi.org/10.37689/acta-ape/2021AO001055.
http://dx.doi.org/10.37689/acta-ape/2021...
,2727. Takara NC, Ferreira NC, Murakami BM, Lopes CT. Development and validation of an informative manual on venous thromboembolism for the lay population. Einstein. 2020;18:eAO5425. doi: http://dx.doi.org/10.31744/einstein_journal/2020AO5425. PubMed PMID: 32935827.
http://dx.doi.org/10.31744/einstein_jour...
).
The uniqueness of nursing care in the face of human responses allowed specialists from different regions of the country to add relevant information to improve the application prototype based on the clinical experience of cardiology care. The content that should be addressed in nursing interventions was expanded towards a more congruent lifestyle for the person with HF, to favor self-care and, thus, improve health and quality of life, conferring relevance and suitability to the product designed for the public for whom it is intended. Among the recommendations, we highlight the booster for immunization against COVID-19 and the inclusion of a function that allows the sending of information to the health team, which, in its turn, allows for two-way communication.
Additionally, an expert suggested the inclusion of real illustrations with patterns of normality and clinical decompensation of HF (lower limb edema, jugular swelling and ascitic abdomen), a suggestion that was not accepted as it differs from the visual aesthetics of the illustrations adopted in the graphical interface and that would not portray educational content, but could have a negative impact on users, such as feelings of fear and anxiety.
It is important to emphasize that elements to stimulate interaction make recommendations clearer and more precise, influence the user to develop cognitive skills, and, therefore, should be considered in the elaboration of educational materials on health(2828. Toledo TRO, Peres AL, Barros PES, Russo RC, Carvalho LWT. PrevTev: construction and validation of a mobile application for guidelines on venous thromboembolism. Rev Bras Educ Med. 2022;46(1):e032. doi: http://dx.doi.org/10.1590/1981-5271v46.1-20210405.
http://dx.doi.org/10.1590/1981-5271v46.1...
). In this perspective, red flags to alert for signs of clinical decompensation, charts for monitoring body weight, alarms for medication use and consultation schedule were included. Future versions may incorporate infographics, links, animations and videos.
In this investigation, we chose to use the SAM instrument, internationally used to assess content, organization, clarity of language, use of illustrations, motivation and cultural adequacy of educational materials, to obtain educational technology consistent with the self-care needs of people with HF and with the possibility of influencing the adoption of desirable behaviors and attitudes to control the disease.
Based on the criteria established by the SAM, the application was considered superior quality technology according to the evaluation of specialist nurses. The overall score reached 88.4%, showing that the product offered is suitable for the target audience. This result is consistent with a study that built and validated a mobile application for guidance on venous thromboembolism(2828. Toledo TRO, Peres AL, Barros PES, Russo RC, Carvalho LWT. PrevTev: construction and validation of a mobile application for guidelines on venous thromboembolism. Rev Bras Educ Med. 2022;46(1):e032. doi: http://dx.doi.org/10.1590/1981-5271v46.1-20210405.
http://dx.doi.org/10.1590/1981-5271v46.1...
).
The educational guidelines addressed in the app content to encourage self-care corroborate recommendations from Brazilian(22. Rohde LEP, Montera MW, Bocchi EA, Clausell NO, Albuquerque DC, Rassi S, et al. Comitê Coordenador da Diretriz de Insuficiência Cardíaca. Diretriz brasileira de insuficiência cardíaca crônica e aguda. Arq Bras Cardiol. 2018;111(3):436–539. doi: http://dx.doi.org/10.5935/abc.20180190. PubMed PMID: 30379264.
http://dx.doi.org/10.5935/abc.20180190...
) and European(1616. Jaarsma T, Hill L, Bayes‐Genis A, Brunner La Rocca H, Castiello T, Čelutkienė J, et al. Self-care of heart failure patients: practical management recommendations from the Heart Failure Association of the European Society of Cardiology. Eur J Heart Fail. 2021;23(1):157–74. doi: http://dx.doi.org/10.1002/ejhf.2008. PubMed PMID: 32945600.
http://dx.doi.org/10.1002/ejhf.2008...
) guidelines and technologies mHealth(1111. Mortara A, Vaira L, Palmieri V, Iacoviello M, Battistoni I, Iacovoni A, et al. Would you prescribe mobile health apps for heart failure self-care? An integrated review of commercially available mobile technology for heart failure patients. Card Fail Rev. 2020;6:e13. doi: http://dx.doi.org/10.15420/cfr.2019.11. PubMed PMID: 32537246.
http://dx.doi.org/10.15420/cfr.2019.11...
,2929. Giordan LB, Ronto R, Chau J, Chow C. Use of mobile apps in heart failure self-management: qualitative study exploring the patient and primary care clinician perspective. JMIR Cardio. 2022;6(1):e33992. doi: http://dx.doi.org/10.2196/33992. PubMed PMID: 35442205.
http://dx.doi.org/10.2196/33992...
) developed for patients with HF. It is believed that further studies can be conducted to update and improve this care technology, to potentiate the teaching-learning process, given the continuous advancement of scientific evidence on HF.
Studies(2020. Sousa MM, Almeida TCF, Gouveia BLA, Freire MEM, Oliveira SHS. Validation of persuasive audiovisual communication to reduce salt consumption by people with heart failure. Rev Esc Enferm USP. 2021;55:e03751. doi: http://dx.doi.org/10.1590/s1980-220x2020006503751. PubMed PMID: 34190894.
http://dx.doi.org/10.1590/s1980-220x2020...
,2323. Choi JY, George M, Yun SY. Development of a smartphone application for Korean patients with chronic obstructive pulmonary disease: self-monitoring based action plans. Appl Nurs Res. 2021;61:151475. doi: http://dx.doi.org/10.1016/j.apnr.2021.151475. PubMed PMID: 34544569.
http://dx.doi.org/10.1016/j.apnr.2021.15...
,2626. Almeida TCF, Sousa MM, Gouveia BLA, Almeida AAM, Oliveira SHS. Prototype of a motivational mobile application for people with hypertension. Acta Paul Enferm. 2021;34:eAPE001055. doi: http://dx.doi.org/10.37689/acta-ape/2021AO001055.
http://dx.doi.org/10.37689/acta-ape/2021...
,2727. Takara NC, Ferreira NC, Murakami BM, Lopes CT. Development and validation of an informative manual on venous thromboembolism for the lay population. Einstein. 2020;18:eAO5425. doi: http://dx.doi.org/10.31744/einstein_journal/2020AO5425. PubMed PMID: 32935827.
http://dx.doi.org/10.31744/einstein_jour...
) which developed technological resources for people with chronic diseases used the CVI as a method to assess agreement in relation to the evaluated items. In this study, CVI was applied for face validation by the target audience, which allowed evaluating aesthetic aspects of the organization, interface, content, language, with evidence of adequacy being obtained, which portray the quality of the educational technology produced.
It should be noted that the typography size reached CVI < 0.78, which resulted in adjustments to meet the expectations of the lay public and facilitate reading, especially for elderly users. It is important to highlight that the participants evaluated the application prototype with the potential to help improve the comprehension of HF and the self-care actions instituted in the therapeutic regimen.
Qualitative research exploring the needs and perspectives of patients with HF for the use of health mobile technology highlighted the need to implement designs that facilitated the use based on reliable information about treatment, medications, when and how to seek emergency services, and personalized health-related reminders to strengthen self-care behaviors(3030. Son YJ, Oh S, Kim EY. Patients’ needs and perspectives for using mobile phone interventions to improve heart failure self-care: a qualitative study. J Adv Nurs. 2020;76(9):2380–90. doi: http://dx.doi.org/10.1111/jan.14455. PubMed PMID: 32672374.
http://dx.doi.org/10.1111/jan.14455...
). These functionalities are present in the application mentioned and may be refined as tests of communication between users and health professionals are carried out.
For professional nursing practice, the “Tum Tum” application is an innovative technology in the care of people with HF. So far, to our knowledge, this is the first nurse-led application developed in the Northeast region of Brazil. Therefore, its use shall be encouraged by nurses due to the convenience of access to expand information, add knowledge, and reinforce verbal information and, based on their records, assist health professionals in making an adequate clinical decision in the preparation of the therapeutic plan.
This study has some limitations. Although the sample of specialists complied with the literature recommendations, future research may increase the participation of other professionals from the multidisciplinary health team. Patients from a single service and with an average education level higher than the reality of users monitored in the Brazilian Public Health System are also mentioned. It is assumed that the higher the level of education, the greater the ease of use of mobile technologies. Therefore, the findings cannot be generalized and future investigations are required to evaluate the application content and functionality by people with other levels of education, aiming at reducing digital literacy barriers.
Moreover, the high financial cost is a limiting factor for the development of technologies mHealth. It becomes necessary to bring Nursing closer to other areas of knowledge to share information, seek low-cost solutions and care technologies that can be incorporated into clinical practice. New research will be carried out to accomplish the steps of implementation and usability evaluation not covered in this study. In addition, evaluations to verify efficiency, satisfaction, advances in the interface and possible malfunctions will be tested by users in future stages. It is expected that the technology will be soon transferred to the public sector soon, after its registration and launch on the main mobile application platforms.
CONCLUSION
This study developed a project of graphical interface and obtained adequate evidence of content validity of the “Tum Tum” application prototype for HF patients self-care. The prototype application provides information about the disease, causes, signs and symptoms, diagnosis and treatment. Educational guidelines with essential non-pharmacological and pharmacological measures to maintain HF stability are presented. Furthermore, features for recording information, data history and red flags with signs of clinical decompensation help patients’ self-management. This innovative technological resource can be used by the multidisciplinary team as a care technology to enhance educational activities as a resource for health self-management. Future studies will be conducted to evaluate the usability and effectiveness of the technology in clinical practice.
-
Financial support This work was financially supported by Call no. 03/2020 Productivity in Research PROPESQ/PRPG/UFPB research project code PVG13241-2020.
REFERENCES
-
1.Lippi G, Sanchis-Gomar F. Global epidemiology and future trends of heart failure. AME Med J. 2020;5(15):1–6. doi: http://dx.doi.org/10.21037/amj.2020.03.03
» http://dx.doi.org/10.21037/amj.2020.03.03 -
2.Rohde LEP, Montera MW, Bocchi EA, Clausell NO, Albuquerque DC, Rassi S, et al. Comitê Coordenador da Diretriz de Insuficiência Cardíaca. Diretriz brasileira de insuficiência cardíaca crônica e aguda. Arq Bras Cardiol. 2018;111(3):436–539. doi: http://dx.doi.org/10.5935/abc.20180190 PubMed PMID: 30379264.
» http://dx.doi.org/10.5935/abc.20180190 -
3.Ruppar TM, Cooper PS, Johnson ED, Riegel B. Self-care interventions for adults with heart failure: a systematic review and meta-analysis protocol. J Adv Nurs. 2019;75(3):676–82. doi: http://dx.doi.org/10.1111/jan.13903 PubMed PMID: 30397943.
» http://dx.doi.org/10.1111/jan.13903 -
4.Vellone E, Fida R, Ghezzi V, D’Agostino F, Biagioli V, Paturzo M, et al. Patterns of self-care in adults with heart failure and their associations with sociodemographic and clinical characteristics, quality of life, and hospitalizations: a cluster analysis. J Cardiovasc Nurs. 2017;32(2):180–9. doi: http://dx.doi.org/10.1097/JCN.0000000000000325 PubMed PMID: 26938506.
» http://dx.doi.org/10.1097/JCN.0000000000000325 -
5.Ruppar TM, Cooper PS, Mehr DR, Delgado JM, Dunbar-Jacob JM. Medication adherence interventions improve heart failure mortality and readmission rates: systematic review and meta-analysis of controlled trials. J Am Heart Assoc. 2016;5(6):e002606. doi: http://dx.doi.org/10.1161/JAHA.115.002606 PubMed PMID: 27317347.
» http://dx.doi.org/10.1161/JAHA.115.002606 -
6.Mlynarska A, Golba KS, Mlynarski R. Capability for self-care of patients with heart failure. Clin Interv Aging. 2018;13:1919–27. doi: http://dx.doi.org/10.2147/CIA.S178393 PubMed PMID: 30349210.
» http://dx.doi.org/10.2147/CIA.S178393 -
7.Lee KS, Moser DK, Dracup K. Relationship between self-care and comprehensive understanding of heart failure and its signs and symptoms. Eur J Cardiovasc Nurs. 2018;17(6):496–504. doi: http://dx.doi.org/10.1177/1474515117745056 PubMed PMID: 29192794.
» http://dx.doi.org/10.1177/1474515117745056 -
8.Cavalcante LM, Lima FET, Custódio IL, Oliveira SKP, Meneses LST, Oliveira ASS, et al. Influence of sociodemographic characteristics in the self-care of people with heart failure. Rev Bras Enferm. 2018;71(Supl. 6):2604–11. doi: http://dx.doi.org/10.1590/0034-7167-2017-0480 PubMed PMID: 30540034.
» http://dx.doi.org/10.1590/0034-7167-2017-0480 -
9.Athilingam P, Jenkins B. Mobile phone apps to support heart failure self-care management: integrative review. JMIR Cardio. 2018;2(1):e10057. doi: http://dx.doi.org/10.2196/10057 PubMed PMID: 31758762.
» http://dx.doi.org/10.2196/10057 -
10.Athilingam P, Jenkins B, Johansson M, Labrador M. A Mobile health intervention to improve self-care in patients with heart failure: pilot randomized control trial. JMIR Cardio. 2017;1(2):e3. doi: http://dx.doi.org/10.2196/cardio.7848 PubMed PMID: 31758759.
» http://dx.doi.org/10.2196/cardio.7848 -
11.Mortara A, Vaira L, Palmieri V, Iacoviello M, Battistoni I, Iacovoni A, et al. Would you prescribe mobile health apps for heart failure self-care? An integrated review of commercially available mobile technology for heart failure patients. Card Fail Rev. 2020;6:e13. doi: http://dx.doi.org/10.15420/cfr.2019.11 PubMed PMID: 32537246.
» http://dx.doi.org/10.15420/cfr.2019.11 -
12.Chen C, Li X, Sun L, Cao S, Kang Y, Hong L, et al. Post-discharge short message service improves short-term clinical outcome and self-care behaviour in chronic heart failure. ESC Heart Fail. 2019;6(1):164–73. doi: http://dx.doi.org/10.1002/ehf2.12380 PubMed PMID: 30478888.
» http://dx.doi.org/10.1002/ehf2.12380 -
13.Li X, Chen C, Qu MY, Li Z, Xu Y, Duan XF, et al. Perceptions and acceptability of receiving sms self-care messages in Chinese patients with heart failure an inpatient survey. J Cardiovasc Nurs. 2017;32(4):357–64. doi: http://dx.doi.org/10.1097/JCN.0000000000000349 PubMed PMID: 27617565.
» http://dx.doi.org/10.1097/JCN.0000000000000349 -
14.Pezel T, Berthelot E, Gauthier J, Chong-Nguyen C, Iliou MC, Juillière Y, et al. Epidemiological characteristics and therapeutic management of patients with chronic heart failure who use smartphones: potential impact of a dedicated smartphone application (report from the OFICSel study). Arch Cardiovasc Dis. 2021;114(1):51–8. doi: http://dx.doi.org/10.1016/j.acvd.2020.05.006 PubMed PMID: 32868257.
» http://dx.doi.org/10.1016/j.acvd.2020.05.006 -
15.Filatro A. Design instrucional contextualizado. São Paulo: SENAC; 2019.
-
16.Jaarsma T, Hill L, Bayes‐Genis A, Brunner La Rocca H, Castiello T, Čelutkienė J, et al. Self-care of heart failure patients: practical management recommendations from the Heart Failure Association of the European Society of Cardiology. Eur J Heart Fail. 2021;23(1):157–74. doi: http://dx.doi.org/10.1002/ejhf.2008 PubMed PMID: 32945600.
» http://dx.doi.org/10.1002/ejhf.2008 -
17.Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15(2):214–21. doi: http://dx.doi.org/10.1016/j.sapharm.2018.03.066 PubMed PMID: 29606610.
» http://dx.doi.org/10.1016/j.sapharm.2018.03.066 -
18.Ignácio IB, Fernandes PA, Maier SRODC, Dessotte CAM. Anxiety, depression and cardiac anxiety in patients with implantable cardioverter-defibrillator according to gender and age. Rev Rene. 2021;22:e6111. doi: http://dx.doi.org/10.15253/2175-6783.20212261117
» http://dx.doi.org/10.15253/2175-6783.20212261117 -
19.Sousa CS, Turrini RNT, Poveda VB. Translation and adaptation of the instrument “suitability assessment of materials” (SAM) into portuguese. J Nurs UFPE Oline. 2015;9(5):7854–61. doi: http://dx.doi.org/10.5205/1981-8963-v9i5a10534p7854-7861-2015
» http://dx.doi.org/10.5205/1981-8963-v9i5a10534p7854-7861-2015 -
20.Sousa MM, Almeida TCF, Gouveia BLA, Freire MEM, Oliveira SHS. Validation of persuasive audiovisual communication to reduce salt consumption by people with heart failure. Rev Esc Enferm USP. 2021;55:e03751. doi: http://dx.doi.org/10.1590/s1980-220x2020006503751 PubMed PMID: 34190894.
» http://dx.doi.org/10.1590/s1980-220x2020006503751 -
21.Doak CC, Doak LG, Root JH. Teaching patients with low literacy skills. 2nd ed. Philadelphia: Lippincott Company; 1996. doi: http://dx.doi.org/10.1097/00000446-199612000-00022
» http://dx.doi.org/10.1097/00000446-199612000-00022 -
22.Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Colet. 2011;16(7):3061–68. doi: http://dx.doi.org/10.1590/S1413-81232011000800006
» http://dx.doi.org/10.1590/S1413-81232011000800006 -
23.Choi JY, George M, Yun SY. Development of a smartphone application for Korean patients with chronic obstructive pulmonary disease: self-monitoring based action plans. Appl Nurs Res. 2021;61:151475. doi: http://dx.doi.org/10.1016/j.apnr.2021.151475 PubMed PMID: 34544569.
» http://dx.doi.org/10.1016/j.apnr.2021.151475 -
24.Jiang S, Lv M, Wu T, Chen W, Zhang J. A smartphone application for remote adjustment of warfarin dose: development and usability study. Appl Nurs Res. 2022;63:151521. doi: http://dx.doi.org/10.1016/j.apnr.2021.151521 PubMed PMID: 35034699.
» http://dx.doi.org/10.1016/j.apnr.2021.151521 -
25.Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, et al. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform. 2016;60:243–51. doi: http://dx.doi.org/10.1016/j.jbi.2016.02.002 PubMed PMID: 26903153.
» http://dx.doi.org/10.1016/j.jbi.2016.02.002 -
26.Almeida TCF, Sousa MM, Gouveia BLA, Almeida AAM, Oliveira SHS. Prototype of a motivational mobile application for people with hypertension. Acta Paul Enferm. 2021;34:eAPE001055. doi: http://dx.doi.org/10.37689/acta-ape/2021AO001055
» http://dx.doi.org/10.37689/acta-ape/2021AO001055 -
27.Takara NC, Ferreira NC, Murakami BM, Lopes CT. Development and validation of an informative manual on venous thromboembolism for the lay population. Einstein. 2020;18:eAO5425. doi: http://dx.doi.org/10.31744/einstein_journal/2020AO5425 PubMed PMID: 32935827.
» http://dx.doi.org/10.31744/einstein_journal/2020AO5425 -
28.Toledo TRO, Peres AL, Barros PES, Russo RC, Carvalho LWT. PrevTev: construction and validation of a mobile application for guidelines on venous thromboembolism. Rev Bras Educ Med. 2022;46(1):e032. doi: http://dx.doi.org/10.1590/1981-5271v46.1-20210405
» http://dx.doi.org/10.1590/1981-5271v46.1-20210405 -
29.Giordan LB, Ronto R, Chau J, Chow C. Use of mobile apps in heart failure self-management: qualitative study exploring the patient and primary care clinician perspective. JMIR Cardio. 2022;6(1):e33992. doi: http://dx.doi.org/10.2196/33992 PubMed PMID: 35442205.
» http://dx.doi.org/10.2196/33992 -
30.Son YJ, Oh S, Kim EY. Patients’ needs and perspectives for using mobile phone interventions to improve heart failure self-care: a qualitative study. J Adv Nurs. 2020;76(9):2380–90. doi: http://dx.doi.org/10.1111/jan.14455 PubMed PMID: 32672374.
» http://dx.doi.org/10.1111/jan.14455
Edited by
ASSOCIATE EDITOR
Publication Dates
-
Publication in this collection
06 Jan 2023 -
Date of issue
2022
History
-
Received
15 Aug 2022 -
Accepted
04 Nov 2022