January-June 2025Back

Open Access

Depression and Anxiety in Adult Cardiology Patients Consulting Through Telemedicine During the Covid-19 Pandemic Using the Validated Filipino Version of the Hospital Anxiety and Depression Score (Hads-P)

Introduction

The coronavirus disease (COVID-19) was a global pandemic that started in December 2019 in Wuhan, China. Since then, it spread to almost all countries around the world and has affected over millions of people. Healthcare systems around the world focused their efforts into stemming this disease and its deleterious effects on specific populations. Hospitals and other facilities had been overwhelmed with multitude of patients being affected by COVID-19. In addition, patients were hesitant to consult in hospitals for fear of contracting the disease. Patients with chronic conditions were unable to follow-up in the outpatient clinics due to their closures. Due to these circumstances, telemedicine emerged as a leading means of consultation in the non-emergent setting. This study aimed to investigate the effect of this pandemic on mental health of cardiovascular patients who consult via the telemedicine service in our institution.

 

Prevalence of Depression and Anxiety Among Cardiac Patients

Depression and anxiety are common among cardiac patients as demonstrated in several studies. In a cross-sectional study in Palestine published in 2019, among 1053 patients who were admitted in a period of eight months with a new or pre-existing cardiac diagnosis, 78.7% were noted to have depression using the Cardiac Depression Scale. In the same study, they also used the Depression Anxiety Stress Scale to determine the presence of depression, anxiety and stress, which were found in 52.9%, 53.1% and 37.4%, respectively.1 In a global study published in 2007 which surveyed populations in 17 countries, the odds ratio of major depression among patients with heart disease was 2.1 (CI 1.8-2.4) and generalized anxiety disorder 2.1 (1.7-2.5).2 A more recent meta-analysis published in 2016 showed that the prevalence of any anxiety disorder was estimated to be 16% among patients with cardiovascular disease.3 Locally, a study published in 2016 surveyed the prevalence of depression and anxiety among adults with congenital heart disease (CHD). Using the validated Hospital Anxiety and Depression Scale (HADS) translated into Filipino, it was noted that the cohort of adult CHD patients had a higher prevalence of anxiety and depression compared to general populations. Furthermore, this study investigated factors that affected such an increased prevalence. Socioeconomic and clinical factors such as employment status, higher functional class, lower six-minute walk test distance, uncorrected defects and presence of heart failure were important predictors of anxiety while educational attainment, functional class, eisenmengerization and presence of heart failure were determined to be predictors of depression.4 An unpublished study conducted in the Philippine General Hospital looked into prevalence of anxiety and depression among adult patients with acute coronary syndrome, which were 46.7% and 25%, respectively.5

 

Anxiety and Depression During the COVID-19 Pandemic

With advent of the coronavirus pandemic, its impact on mental health of the global population has not gone unnoticed. A review article published in 2020 identified studies that looked into mental health during the COVID-19 pandemic. Among newly recovered patients, the prevalence of depression was 29.2%. Those with pre-existing psychiatric disorders also reported worsening of their symptoms. Patients with COVID-19 are not just the ones who are affected by this pandemic. Healthcare workers who care for these patients also have increased depressive and anxiety symptoms as well. This article also identified that the general public had lower psychological well-being during the pandemic as compared to prior to outbreak of the virus.6 In another meta-analysis published in the same year, prevalence in the general population of stress was 29.6%, anxiety was 31.9% and depression was 33.7%. In a subgroup analysis, the population with highest prevalence of anxiety (32.9%) and depression (35.3%) was in Asia.7 Indeed, health systems worldwide are now looking into interventions to address this unmet mental health problem in the midst of the ongoing pandemic.

 

Importance of Screening for Anxiety and Depression

In 2014, the American Heart Association published a scientific statement that depression is considered as a risk factor for adverse medical outcomes in patients with acute coronary syndrome. This was concluded after the scientific committee reviewed 53 articles that studied depression in acute coronary syndrome patients and their outcomes. Among these studies, 32 looked into the association of depression and all-cause mortality, with 17 of these studies reporting significant risk-adjusted association and four reporting significant unadjusted association between depression and mortality.8 Moreover, two studies suggested that anxiety was associated with younger age at the time of first myocardial infarction, with one study in particular demonstrating this to be of particular importance in females aged 16-40 years old.9,10 While the exact causal pathophysiology between the presence of depression or anxiety and incident cardiovascular events has not yet been established, screening for these concomitant conditions is important to manage overall health of cardiovascular patients. A review of the relationship between depression, anxiety and emotional stress and cardiovascular disease has shown that these factors are related to acute myocardial infarction, sudden cardiac death and increased symptomatology (such as angina, physical limitation, decreased quality of life).11 In addition, cardiovascular diseases are also adversely affected indirectly by depressive and anxiety symptoms as these patients would sometimes lack interest in carrying out simple tasks such as preparing healthy meals and engaging in exercise, nor would they have the energy to change their behavior such as quitting smoking or adopting a less sedentary lifestyle. These patients usually experience a decline in psychological and physical motivation and tend not to adhere to therapeutic regimens and prescribed cardiac rehabilitation programs.12

 

The HADS Questionnaire

The HADS is a self-administered questionnaire that was first published in 1983. It consists of 14 statements, each of which patients will rate on a four-point (0-3) scale with independent subscales for anxiety and depression. A score of 0-7 is interpreted as normal, 8-10 suggestive of disease and >/= 11 as probable presence of mood disorder.13 Over the years, the HADS questionnaire has been validated in more than 50 languages and used to screen for anxiety and depression in patients with different illnesses.4

 

Validation of HADS-P in the Philippines 

In the local setting, the HADS questionnaire has been translated into the national language Pilipino (hence, use of the acronym HADS-P) and has been validated in a study published in 2013. In this study, the rating scale was used in 710 medically ill admitted patients in the Philippine General Hospital, a tertiary government medical facility. The main objective of the study was to determine the prevalence of anxiety and/or depression in the aforementioned study population. Secondary objectives include validation of the questionnaire and optimal cut-off score for the Filipino population. Depression and/or anxiety was more prevalent in patients who were younger, married and with lower educational levels. The study recommended a cut-off score of 11 (sensitivity of 75% and specificity of 70%) as a screening instrument for depression and anxiety in medically ill patients.14 The HADS-P questionnaire has since then been used in several study populations including HIV patients,15 chronic kidney disease patients undergoing hemodialysis,16 tuberculosis patients,17 cervical cancer patients18 and glaucoma patients.19 In these studies, factors that have been seen to be associated with anxiety include higher New York Heart Association (NYHA) functional class, unemployment and female sex. Factors that have been seen to be associated with depression include lower educational achievement, NYHA functional class and male sex. However, these associations differed based on the underlying condition that the patient had. 

 

Use of the HADS/HADS-P Questionnaire in Cardiac Patients

Internationally, the HADS questionnaire has been used to screen for anxiety and depression in various cardiac diseases and interventions, including patients undergoing percutaneous coronary intervention,20 those undergoing cardiac rehabilitation,21 patients with advanced heart failure,22 and those who have had a cardiac event (a cohort of patients who have had acute coronary syndrome, acute myocardial infarction, unstable angina or those who have undergone coronary artery bypass grafting),23 among others. As mentioned earlier, a local study published in 2016 utilized the validated HADS-P questionnaire in screening for depression and anxiety among 92 adult patients with CHD.4 As of writing, this is the only published study known to have utilized the HADS-P questionnaire among Filipino cardiac patients.

 

Use of the HADS/HADS-P Questionnaire in the Era of Telemedicine

With limitations imposed by the pandemic on face-to-face consultations for chronically ill patients, physicians are working to adapt to the burgeoning need of attending to patients who need medical attention without increasing the risk of contracting the coronavirus for both the healthcare provider and patient. In a similar way, doctors should be able to adapt their practice including screening for comorbid mental illnesses to telemedicine. Phone calls or video calls using various messaging platforms are now emerging as the newest methods for patient consultation. In a search for the use of the HADS questionnaire as a screening method for patients who consult via telemedicine, three studies utilized the questionnaire by sending an online link for the questionnaire to be filled out by the patient.24–26 One study utilized an interactive voice response version of the HADS which proved to be difficult to use among their study population of elderly patients with congestive heart failure. This form of assessment tool was eventually eliminated a few weeks into the trial due to reported difficulty in utilization by their patients.27 As of writing, there are no studies elucidating the use of the HADS/HADS-P questionnaire as administered over a phone or video call.

 

Telemedicine in the Division of Cardiovascular Medicine in the Philippine General Hospital

During the pandemic, most outpatient services in the Philippine General Hospital were put on hold. Despite this, the system adapted to ensure that care for outpatients continued despite restrictions in place. The telemedicine services of different clinics began and were the main method of checking on patients who previously consulted in the outpatient department and for new patients who were going to consult for the first time. In the Division of Cardiovascular Medicine, the telemedicine service was held once a week and was able to cater to over 100 patients during each session. Patients were called using their landline or mobile phones. In some instances, video calls were made if patients had the means for it. At the end of the consult, laboratory requests and prescriptions were sent via email.

 

With the general prevalence of depression and anxiety among cardiac patients, and increased stress from the ongoing pandemic, this study aimed to identify the prevalence of anxiety and depression among outpatient consults via telemedicine through a simple screening tool to lead to an appropriate psychiatric referral in an effort to achieve a more holistic approach to patient care.

 

Research Question: What is the prevalence of HADS-P score of greater than or equal to 11 among cardiovascular patients who consulted with the Division of Cardiovascular Medicine via telemedicine in the Philippine General Hospital using the HADS-P questionnaire?

 

Primary Objective:

1. To determine the prevalence of HADS-P greater than or equal to 11 among cardiovascular patients who consulted with the Division of Cardiovascular Medicine via telemedicine in the Philippine General Hospital using the HADS-P questionnaire

 

Secondary Objective:

1. To describe the clinical and socioeconomic profile of patients consulting in the cardiovascular outpatient clinic via telemedicine.

2. To compare the clinical and socioeconomic profile of patients with HADS-P >/=11 and those less than 11.  

 

Methodology

Study Design

This study was a cross-sectional study using a non-probability sampling of all patients who consulted with the Division of Cardiovascular Medicine in the Philippine General Hospital via the telemedicine service. Using a prevalence rate of depression and anxiety of 47% in a previous study of acute coronary syndrome patients and 3.3% unexposed group (general population), this study utilized power (1-β) = 80%, confidence interval of 95%, and a 5% margin of error under the assumption of simple random sampling. Based on these assumptions, the computed sample size was 99 and this sample size was achieved during the date collection period.

 

The inclusion criteria for patients were the following:

  • Patients who consulted with telemedicine service of the Division of Cardiovascular Medicine in the Outpatient Department of the Philippine General Hospital
  • Patients who were able to read
  • Patient who were able to access and answer an online form

 

The patients were asked to answer the self-administered questionnaire in their homes at their convenience. Accomplishing the online questionnaire meant an implied consent to participate. During recruitment, the investigators reiterated that information obtained would only be used in the study and will remain confidential. Furthermore, it was also emphasized that refusal to participate in the study would not affect their care. All participants were free to withdraw from the study at any given time. Patients with the following characteristics were excluded:

  • Patients who cannot read
  • Patients who are unable to answer an online form

 

The HADS-P Questionnaire Using an Online Form

The HADS-P is a 14-item rating scale that is self-administered by the patient. It has separate subscales for anxiety and depression with a score of >/=11 as probable depression or anxiety.

 

Data Collection

Patients were contacted by one of the investigators via phone call and objectives of the study explained, the process of answering an online questionnaire and information needed were outlined and consent was implied if they proceeded to answer the online questionnaire. Clinical and sociodemographic profiles were gathered using an online form followed by the online HADS-P questionnaire. Confidentiality was ensured by only allowing data access to the investigators. The estimated duration of participation by patients in the study did not exceed one hour.

 

Outcomes

Main Outcome

The prevalence of a HADS-P score of >/=11 for both depression and anxiety subscales were the main outcome of the study.

 

Secondary Outcomes

The clinical profiles of patients consulting in the telemedicine clinic were obtained and described in the study. A comparison between subgroups as defined with cut-off values mentioned above was performed to check for significant differences.

 

Data Analysis

Data was encoded using Microsoft ExcelTM. The prevalence of a score of 11 or more for both anxiety and depression was computed for primary analysis. Descriptive data of clinical and socioeconomic profiles were presented as percentages, mean and standard deviation. For the exploratory secondary objective of comparison between groups, a chi square test analysis was done.

 

Ethical Considerations

This study was conducted upon approval of the UP Manila Research Ethics Board. No additional information was obtained other than that which was originally stated in the protocol. The study objectives were clearly explained to participants and confidentiality of results was ensured. Implied consent was garnered when participants decided to proceed with answering the online form. The primary investigator shouldered the cost of this research. The results of the screening tool was relayed to participants and if the screening was suggestive of possible anxiety or depression in participants, their primary attending physician was made aware for the appropriate referral to be made.

 

Results

A total of 112 patients were recruited in this study. Majority of the participants were less than 60 years, female, with a partner (whether married or common law) and unemployed with a monthly income of <10,000 pesos. Among identified illnesses in these patients, the most common were ischemic heart disease, hypertension and valvular heart disease. Most patients presented with some symptoms being classified as to having a functional class of II or greater (Table 1).

 

Among 112 participants in the study, a total of 25 patients had a HADS-P score of >/=11 for anxiety and a total of 9 patients had a HADS-P score of >/=11 for depression. This accounts for 22% and 8% of the population, respectively.

 

There was a significant difference between participants with and without anxiety with respect to their civil status. A higher percentage of patients who scored >/=11 for anxiety were noted to be single (32%) compared to those who had partners (15%). Consequently, a lower percentage of patients who were single (68%) had scores of less than 11 compared to that with partners (85%). For depression, there was a significant difference for those who scored >/=11 on the HADS-P screening tool for depression with respect to their civil status and employment status. A higher percentage of single patients had scores of >/=11 (14%) compared to those with partners (3%) and a higher percentage of employed patients scored >/=11 for depression (17%) compared to unemployed patients (5%) (Table 2 and 3).

 

Discussion

Mental health is an important part of any person’s well-being. This is especially important in patients who are chronically ill, whose mental health can greatly affect how they handle and manage their other diseases. In the Philippines, available data showed that depression is the most common mental health condition which was shown to be present in about 3.3% of the general population. Anxiety follows closely behind occurring in about 3.1% of the population. Both conditions affect over 3 million Filipinos each year.28 While some mechanisms are already present which are able to identify patients with these conditions, the current situation is still far from ideal in terms of being able to screen most of the population or even just a greater part of the population that is at an increased risk of developing these conditions.

 

In a study conducted during the early part of the pandemic, Tee, et. al., were able to survey over 1800 Filipinos to screen for depression, anxiety or stress using the Depression, Anxiety and Stress Scales (DASS-21) questionnaire. This study showed that one-fourth of respondents reported moderate to severe anxiety and one-sixth reported moderate to severe depression.29 This was representative of the general population, showing an increase in these mental health disorders compared to the usual prevalence in the general population. In another multi-country study published in 2021, albeit in young adults, the Philippines showed the highest mean scores in all scales of DASS-21, indicating a high burden of these diseases in the population.30

 

Studies have shown that cardiac patients have an increased incidence of anxiety and depression.1 This is especially true for patients who have suffered from an acute cardiac event.23 There is also a multitude of evidence that links depression and anxiety as risk factors for cardiovascular disease.31 In a large meta-analysis pooling over three million patients, it was noted that severe mental illness was associated with cardiovascular disease, cerebrovascular disease and cardiovascular-related deaths.32 A clear pathogenesis linking mental illness and cardiovascular disease has not yet been established. Some studies have showed that risk factors for cardiovascular disease have also been associated with development of anxiety and depression. Other studies have postulated that biological effects of depression and anxiety such as elevated inflammatory markers and cytokines may contribute to the development of cardiovascular disease. Other proposed mechanisms include effects on the sympathetic nervous system, increased oxidative stress, endothelial dysfunction and platelet activation.33

 

Our study showed the prevalence of anxiety and depression was higher in our study population compared to that of the general population (anxiety 22% vs 3.1% and depression 8% vs 3.3%, respectively). We also note that anxiety is more prevalent compared to depression in this population, differing from relative occurrence of these disorders in the general population. However, these relative proportions were more consistent with the study conducted by Tee, et. al., which may be more reflective of the current situation during the pandemic29 where more people may experience anxiety due to fear of contracting the disease and uncertainty of the future. Comparing this study with previous published articles on cardiovascular patients, in CHD patients, probable anxiety was seen in 22% of patients and probable depression in 13% of patients,4 which is similar to numbers that we have gathered. In other studies utilizing the HADS-P questionnaire in chronically ill Filipino patients, increased prevalence of anxiety and depression was also seen in patients with chronic obstructive pulmonary disease,34 HIV,15 diabetes,35 cervical cancer patients18 and chronic kidney disease patients.16

 

In our study, the only characteristic of the population that portend higher probability of anxiety and depression was their civil status. A higher prevalence of higher score for anxiety and depression was seen for single patients. This is similar to other studies where being unpartnered was also seen as a factor for comorbid depression and anxiety.1,23 In addition, employment status is another factor associated with depression. Interestingly, employed patients had a higher rate of depression compared to that of unemployed patients. This is different from previous studies in which depression was linked to patients who did not have work.1,36 This may be due to stress of having to provide for the patient’s family’s needs during an uncertain time.

 

This study is limited by the participant’s ability to access an online form and ability to read. Since this is also a self-administered survey, patients may also not be able to comprehend the questionnaire’s items fully and may not be able to answer appropriately. A larger sample size may also be able to better detect significant differences between sociodemographic factors which may affect prevalence of anxiety or depression. The HADS-P questionnaire is also only a screening tool and diagnosis of both anxiety and depressive disorders require proper assessment by a psychiatrist.

 

Conclusion

Patients consulting through telemedicine in the Division of Cardiovascular Medicine have a higher prevalence of HADS-P scores indicative of probable anxiety and depression. Civil status is associated with higher prevalence of both anxiety and depression, and employment was seen to be associated with higher prevalence of depression. It has been shown that anxiety and depression are associated with cardiovascular diseases and may portend worse outcomes. It is therefore important that screening for these diseases is done to be able to address them early on. The HADS-P questionnaire is a simple tool that can help clinicians identify patients at risk and make necessary referrals for early intervention.

  1. Allabadi H, Alkaiyat A, Alkhayyat A, Hammoudi A, Odeh H, Shtayeh J, et al. Depression and anxiety symptoms in cardiac patients: a cross-sectional hospital-based study in a Palestinian population. BMC Public Health [Internet]. 2019;19(1):232. Available from: http://dx.doi.org/10.1186/s12889-019-6561-3
  2. Ormel J, Von Korff M, Burger H, Scott K, Demyttenaere K, Huang Y-Q, et al. Mental disorders among persons with heart disease - results from world mental health surveys. Gen Hosp Psychiatry [Internet]. 2007;29(4):325–34. Available from: http://dx.doi.org/10.1016/j.genhosppsych.2007.03.009 .
  3. Tully PJ, Harrison NJ, Cheung P, Cosh S. Anxiety and cardiovascular disease risk: A review. Curr Cardiol Rep [Internet]. 2016;18(12):120. Available from: http://dx.doi.org/10.1007/s11886-016-0800-3
  4. Depression and anxiety in adults with congenital heart disease using the validated Filipino version of the hospital anxiety and depression score (HADS-P). Philippine Journal of Internal Medicine. 2016;54(1):1-6.
  5. Vindegaard N, Benros ME. COVID-19 pandemic and mental health consequences: Systematic review of the current evidence. Brain Behav Immun [Internet]. 2020;89:531–42. Available from: http://dx.doi.org/10.1016/j.bbi.2020.05.048
  6. Salari N, Hosseinian-Far A, Jalali R, Vaisi-Raygani A, Rasoulpoor S, Mohammadi M, et al. Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: a systematic review and meta-analysis. Global Health [Internet]. 2020;16(1):57. Available from: http://dx.doi.org/10.1186/s12992-020-00589-w
  7. Lichtman JH, Froelicher ES, Blumenthal JA, Carney RM, Doering LV, Frasure-Smith N, et al. Depression as a risk factor for poor prognosis among patients with acute coronary syndrome: systematic review and recommendations: a scientific statement from the American Heart Association: A scientific statement from the American Heart Association. Circulation [Internet]. 2014;129(12):1350–69. Available from: http://dx.doi.org/10.1161/CIR.0000000000000019
  8. Walters K, Rait G, Petersen I, Williams R, Nazareth I. Panic disorder and risk of new onset coronary heart disease, acute myocardial infarction, and cardiac mortality: cohort study using the general practice research database. Eur Heart J [Internet]. 2008;29(24):2981–8. Available from: http://dx.doi.org/10.1093/eurheartj/ehn477
  9. Mathur R, Pérez-Pinar M, Foguet-Boreu Q, Ayis S, Ayerbe L. Risk of incident cardiovascular events amongst individuals with anxiety and depression: A prospective cohort study in the east London primary care database. J Affect Disord [Internet]. 2016;206:41–7. Available from: http://dx.doi.org/10.1016/j.jad.2016.07.046
  10. Silverman AL, Herzog AA, Silverman DI. Hearts and minds: Stress, anxiety, and depression: Unsung risk factors for cardiovascular disease. Cardiol Rev [Internet]. 2019;27(4):202–7. Available from: http://dx.doi.org/10.1097/CRD.0000000000000228
  11. Chauvet-Gelinier J-C, Bonin B. Stress, anxiety and depression in heart disease patients: A major challenge for cardiac rehabilitation. Ann Phys Rehabil Med [Internet]. 2017;60(1):6–12. Available from: http://dx.doi.org/10.1016/j.rehab.2016.09.002
  12. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand [Internet]. 1983;67(6):361–70. Available from: http://dx.doi.org/10.1111/j.1600-0447.1983.tb09716.x .
  13. De Guzman MLRE. A validation of the hospital anxiety and depression scale (HADS) in the medically-ill. Acta Med Philipp [Internet]. 2013;47(3):53-62. Available from: http://dx.doi.org/10.47895/amp.v47i3.1318
  14. Measurement of anxiety and depression among HIV patients seen in the Philippine General Hospital using the Hospital Anxiety and Depression Scale-Pilipino version (HADS-P). Acta Medical Philippina. 2018;52:40–52.
  15. Villanueva D, Bartolome R, Loyola A. The prevalence of anxiety and depression among patients with chronic kidney disease seen in the University of the Philippines-Philippine General Hospital in Manila using the Hospital Anxiety and Depression Scale- English/Pilipino version. Unpublished manuscript. 2016;
  16. Ambrosio G, Santiaguel J. Anxiety and depression among diagnosed tuberculosis patients seen at the University of the Philippines-Philippine General Hospital using the validated Filipino version of the Hospital Anxiety and Depression Score (HADS-P). Unpublished manuscript. 2015;
  17. The prevalence of anxiety and depression among cervical cancer patients seen in a tertiary government hospital using the Hospital Anxiety and Depression Scale-English/Pilipino version (HADS/HADS-P). PJOG. 2018;42:11–21.
  18. Bell CS, Florcruz NVDG. Risk factors for anxiety and depression in patients diagnosed with glaucoma at the Philippine General Hospital. Asian J Ophthalmol [Internet]. 2019;16(4):329–44. Available from: http://dx.doi.org/10.35119/asjoo.v16i4.415
  19. Gu G, Zhou Y, Zhang Y, Cui W. Increased prevalence of anxiety and depression symptoms in patients with coronary artery disease before and after percutaneous coronary intervention treatment. BMC Psychiatry [Internet]. 2016;16:259. Available from: http://dx.doi.org/10.1186/s12888-016-0972-9
  20. Tulloch H, Heenan A, Cupper L, Pelletier R, O’Farrell P, Pipe A. Depression and anxiety screening and Triage protocol for cardiac rehabilitation programs. J Cardiopulm Rehabil Prev [Internet]. 2018;38(3):159–62. Available from: http://dx.doi.org/10.1097/hcr.0000000000000276
  21. Rogers JG, Patel CB, Mentz RJ, Granger BB, Steinhauser KE, Fiuzat M, et al. Palliative care in heart failure: The PAL-HF randomized, controlled clinical trial. J Am Coll Cardiol [Internet]. 2017;70(3):331–41. Available from: http://dx.doi.org/10.1016/j.jacc.2017.05.030
  22. Murphy B, Le Grande M, Alvarenga M, Worcester M, Jackson A. Anxiety and depression after a cardiac event: Prevalence and predictors. Front Psychol [Internet]. 2019;10:3010. Available from: http://dx.doi.org/10.3389/fpsyg.2019.03010
  23. Bolier L, Haverman M, Kramer J, Westerhof GJ, Riper H, Walburg JA, et al. An Internet-based intervention to promote mental fitness for mildly depressed adults: randomized controlled trial. J Med Internet Res [Internet]. 2013;15(9):e200. Available from: http://dx.doi.org/10.2196/jmir.2603
  24. Kenter R, Warmerdam L, Brouwer-Dudokdewit C, Cuijpers P, van Straten A. Guided online treatment in routine mental health care: an observational study on uptake, drop-out and effects. BMC Psychiatry [Internet]. 2013;13:43. Available from: http://dx.doi.org/10.1186/1471-244X-13-43  
  25. Duffecy J, Sanford S, Wagner L, Begale M, Nawacki E, Mohr DC. Project onward: an innovative e-health intervention for cancer survivors: E-health intervention for cancer survivors. Psychooncology [Internet]. 2013;22(4):947–51. Available from: http://dx.doi.org/10.1002/pon.3075
  26. Cole SA, Farber NC, Weiner JS, Sulfaro M, Katzelnick DJ, Blader JC. Double-disease management or one care manager for two chronic conditions: pilot feasibility study of nurse telephonic disease management for depression and congestive heart failure. Dis Manag [Internet]. 2006;9(5):266–76. Available from: http://dx.doi.org/10.1089/dis.2006.9.266
  27. Marchevsky N. Errors in prevalence estimated in population studies: a practical method for calculation real prevalence. Zoonosis. 1974;16:98–109.

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, which permits use, share — copy and redistribute the material in any medium or format, adapt — remix, transform, and build upon the material, as long as you give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. You may not use the material for commercial purposes. If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-sa/4.0/.