Effects of phone versus mail survey methods on the measurement of health-related quality of life and emotional and behavioural problems in adolescents

Erhart, Michael; Wetzel, Ralf M; Krügel, André; Ravens-Sieberer, Ulrike
January 2009
BMC Public Health;2009, Vol. 9 Issue 1, p491
Academic Journal
Background: Telephone interviews have become established as an alternative to traditional mail surveys for collecting epidemiological data in public health research. However, the use of telephone and mail surveys raises the question of to what extent the results of different data collection methods deviate from one another. We therefore set out to study possible differences in using telephone and mail survey methods to measure health-related quality of life and emotional and behavioural problems in children and adolescents. Methods: A total of 1700 German children aged 8-18 years and their parents were interviewed randomly either by telephone or by mail. Health-related Quality of Life (HRQoL) and mental health problems (MHP) were assessed using the KINDL-R Quality of Life instrument and the Strengths and Difficulties Questionnaire (SDQ) children's self-report and parent proxy report versions. Mean Differences ("d" effect size) and differences in Cronbach alpha were examined across modes of administration. Pearson correlation between children's and parents' scores was calculated within a multi-trait-multi-method (MTMM) analysis and compared across survey modes using Fisher-Z transformation. Results: Telephone and mail survey methods resulted in similar completion rates and similar socio-demographic and socio-economic makeups of the samples. Telephone methods resulted in more positive self- and parent proxy reports of children's HRQoL (SMD ≤ 0.27) and MHP (SMD ≤ 0.32) on many scales. For the phone administered KINDL, lower Cronbach alpha values (self/proxy Total: 0.79/0.84) were observed (mail survey self/proxy Total: 0.84/0.87). KINDL MTMM results were weaker for the phone surveys: mono-trait-multi-method mean r = 0.31 (mail: r = 0.45); multi-traitmono- method mean (self/parents) r = 0.29/0.36 (mail: r = 0.34/0.40); multi-trait-multi-method mean r = 0.14 (mail: r = 0.21). Weaker MTMM results were also observed for the phone administered SDQ: mono-trait-multi-method mean r = 0.32 (mail: r = 0.40); multi-trait-mono-method mean (self/parents) r = 0.24/0.30 (mail: r = 0.20/0.32); multi-trait-multi-method mean r = 0.14 (mail = 0.14). The SDQ classification into borderline and abnormal for some scales was affected by the method (OR = 0.36-1.55). Conclusions: The observed differences between phone and mail surveys are small but should be regarded as relevant in certain settings. Therefore, while both methods are valid, some changes are necessary. The weaker reliability and MTMM validity associated with phone methods necessitates improved phone adaptations of paper and pencil questionnaires. The effects of phone versus mail survey modes are partly different across constructs/measures.


Related Articles

  • How Are the Kids Doing? How Do We Know? Recent Trends and International Comparisons in Child andYouth Well-Being. Land, Kenneth C. // Sociation Today;2008, Vol. 6 Issue 2, p4 

    The article focuses on the Child and Youth Well-Being Index (CWI). CWI consists of several interrelated measures of trends over time in the quality of life, or well-being, of America's children and young people. It is indices of annual time series of 28 social indicators of well-being over time....

  • Development of the PROMIS pediatric global health (PGH-7) measure. Forrest, Christopher; Bevans, Katherine; Pratiwadi, Ramya; Moon, JeanHee; Teneralli, Rachel; Minton, Jo; Tucker, Carole // Quality of Life Research;May2014, Vol. 23 Issue 4, p1221 

    Purpose: To develop a practical, efficient, and reliable pediatric global health (PGH) measure that would be useful for clinical, quality improvement, and research applications. Methods: Using the Patient Reported Outcome Measurement Information System (PROMIS) mixed-methods approach for item...

  • The use of health-related quality of life (HRQOL) in children and adolescents as an outcome criterion to evaluate family oriented support for young carers in Germany: an integrative review of the lite. Schlarmann, Jörg große; Metzing-Blau, Sabine; Schnepp, Wilfried // BMC Public Health;2008, Vol. 8 Issue 1, p414 

    Background: Young people below the age of 18, whose lives are affected by looking after a relative with a disability or long-term illness, are called young carers. Evidence based family oriented support for young carers and their families in Germany is currently being developed. To allow for...

  • Managing the Risks of Childhood Poverty: Changing Interventions By the State. Baker, Maureen // Women's Health & Urban Life;Dec2007, Vol. 6 Issue 2, p8 

    Over the past century, Canada and New Zealand have created various programs to improve the health and wellbeing of low-income families. Initially, they focused on maternal/child health and income support for widows and deserted mothers but later included unemployment benefits, family allowances,...

  • Seniori - kvalita �ivota, zdravotn� p�ce a soci�ln� zabezpecen�. Alena, Zvon�kov� // Revision & Assessment Medicine / Revizni a Posudkove Lekarstvi;Apr2012, Vol. 15 Issue 2, p80 

    The communication deals with the demographic situation in the Czech Republic form the standpoint of population ageing, the results soci�l consequence, and quality of life at the old age. Principal data from the area of health care, public health insurance and soci�l security for 2010...

  • HEALTH AND HEALTH CARE. Soonman Kwon // Social Indicators Research;Apr2003, Vol. 62/63 Issue 1-3, p171 

    Examines the quality of life in South Korea in terms of public health and health care. Role of the national health insurance program in the improvement of public health and health care; Financial barriers to health care utilization; Differential mortality rates among the different...

  • Study protocol. The Childhood Health, Activity, and Motor Performance School Study Denmark (The CHAMPS-study DK). Wedderkopp, Niels; Jespersen, Eva; Franz, Claudia; Klakk, Heidi; Heidemann, Malene; Christiansen, Christina; M�ller, Niels Christian; Leboeuf-Yde, Charlotte // BMC Pediatrics;2012, Vol. 12 Issue 1, p128 

    Background: An increasingly passive life-style in the Western World has led to a rise in life-style related disorders. This is a major concern for all segments of society. The county council of the municipality of Svendborg in Denmark, created six Sport Schools with increased levels of suitable...

  • Report summary -- Health-Adjusted Life Expectancy in Canada: 2012 Report by the Public Health Agency of Canada. Choi, Bernard C. K. // Chronic Diseases & Injuries in Canada;Mar2013, Vol. 33 Issue 2, p103 

    The article discusses the summary report on Health-Adjusted Life Expectancy in Canada for 2012 by the Public Health Agency of Canada. It mentions that the life expectancy shows an average number of years for the healthy state of an individual that is expected to live. It notes that summary...

  • Optimizing diffusion of an online computer tailored lifestyle program: a study protocol. Schneider, Francine; van Osch, Liesbeth A. D. M.; Kremers, Stef P. J.; Schulz, Daniela N.; van Adrichem, Mathieu J. G.; de Vries, Hein // BMC Public Health;2011 Supplement 4, Vol. 11 Issue Suppl 4, p480 

    Background: Although the Internet is a promising medium to offer lifestyle interventions to large amounts of people at relatively low costs and effort, actual exposure rates of these interventions fail to meet the high expectations. Since public health impact of interventions is determined by...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics