Evaluation of community-based oral health promotion and oral disease prevention--WHO recommendations for improved evidence in public health practice

TY - JOUR

T1 - Evaluation of community-based oral health promotion and oral disease prevention--WHO recommendations for improved evidence in public health practice

AU - Petersen, Poul Erik

AU - Kwan, Stella

PY - 2004/12

Y1 - 2004/12

N2 - Systematic evaluation is an integral part of the organisation and delivery of community oral health care programmes, ensuring the effectiveness of these community-based interventions. As for general health promotion programmes the common problems from effectiveness reviews of oral health interventions relate to the quality and validity of programme evaluations. Problems identified mostly refer to the quality of outcome measures, short-term timescales to assess change, inadequate evaluation methodologies and inappropriate evaluation of programme implementation and processes. It remains a challenge to oral health professionals to integrate community oral health programmes into a wider health agenda. Public health research focusing on the development of evaluation methodologies has identified a variety of issues including the importance of using pluralistic evaluation approaches (quantitative and/or qualitative), limitations of the randomised controlled trial (RCT) design for evaluation of public health interventions, the need to match evaluation methods with the nature of intervention, development of outcome measures appropriate for the nature of intervention, importance of developing workforce capacity in evaluation techniques, and the need for development of partnerships between health practitioners and academics in conducting evaluations. In June 2003, the WHO Oral Health Programme at Headquarters organised a two-day workshop to take forward the development and documentation of the evaluation of oral health promotion and oral disease prevention programmes. The aims of the workshop were to: (1) identify common problems and challenges in evaluating community-based oral health interventions; (2) explore developments in the evaluation approaches in public health; (3) share experiences in evaluating oral health intervention programmes implemented at national or community levels in developing and developed countries and (4) develop guidelines for quality evaluation of national and community oral health programmes. Twenty-two invitees from 15 countries attended in addition to WHO staff. The first day was devoted to presentations of oral health promotion and oral disease prevention programmes from around the world. During the second day, WHO staff at Headquarters in Geneva discussed aspects of evaluation of public health programmes. Two working groups were formed to discuss agreed topics, and the reports from their deliberations, together with the general discussion, resulted in the presentation of emerging key issues and recommendations. In summary, it was agreed that evaluation of oral health promotion and disease prevention programmes should integrate, whenever possible, with general health programmes. While the design and advantages of RCTs in clinical evaluations are well documented, the relevance of this design in evaluation of community oral disease preventive programmes and oral health promotion programmes are much less clearly defined. Subsequently, the conduct of such programmes may be inappropriately evaluated in systematic reviews. There is a need for more research into appropriate immediate, interim and ultimate outcome measures, as well as process evaluation, an assessment that is poorly understood and practised less often than outcome evaluation. Guidance on potential design, conduct, and especially the evaluation, of community oral disease prevention programmes and oral health promotion programmes should be developed and updated regularly. WHO Collaborating Centres could have a role in promoting good practice, training and collaboration between teams throughout the world. Centres undertaking systematic reviews should consider the guidelines given in the proposed WHO document when defining their evaluation criteria.

AB - Systematic evaluation is an integral part of the organisation and delivery of community oral health care programmes, ensuring the effectiveness of these community-based interventions. As for general health promotion programmes the common problems from effectiveness reviews of oral health interventions relate to the quality and validity of programme evaluations. Problems identified mostly refer to the quality of outcome measures, short-term timescales to assess change, inadequate evaluation methodologies and inappropriate evaluation of programme implementation and processes. It remains a challenge to oral health professionals to integrate community oral health programmes into a wider health agenda. Public health research focusing on the development of evaluation methodologies has identified a variety of issues including the importance of using pluralistic evaluation approaches (quantitative and/or qualitative), limitations of the randomised controlled trial (RCT) design for evaluation of public health interventions, the need to match evaluation methods with the nature of intervention, development of outcome measures appropriate for the nature of intervention, importance of developing workforce capacity in evaluation techniques, and the need for development of partnerships between health practitioners and academics in conducting evaluations. In June 2003, the WHO Oral Health Programme at Headquarters organised a two-day workshop to take forward the development and documentation of the evaluation of oral health promotion and oral disease prevention programmes. The aims of the workshop were to: (1) identify common problems and challenges in evaluating community-based oral health interventions; (2) explore developments in the evaluation approaches in public health; (3) share experiences in evaluating oral health intervention programmes implemented at national or community levels in developing and developed countries and (4) develop guidelines for quality evaluation of national and community oral health programmes. Twenty-two invitees from 15 countries attended in addition to WHO staff. The first day was devoted to presentations of oral health promotion and oral disease prevention programmes from around the world. During the second day, WHO staff at Headquarters in Geneva discussed aspects of evaluation of public health programmes. Two working groups were formed to discuss agreed topics, and the reports from their deliberations, together with the general discussion, resulted in the presentation of emerging key issues and recommendations. In summary, it was agreed that evaluation of oral health promotion and disease prevention programmes should integrate, whenever possible, with general health programmes. While the design and advantages of RCTs in clinical evaluations are well documented, the relevance of this design in evaluation of community oral disease preventive programmes and oral health promotion programmes are much less clearly defined. Subsequently, the conduct of such programmes may be inappropriately evaluated in systematic reviews. There is a need for more research into appropriate immediate, interim and ultimate outcome measures, as well as process evaluation, an assessment that is poorly understood and practised less often than outcome evaluation. Guidance on potential design, conduct, and especially the evaluation, of community oral disease prevention programmes and oral health promotion programmes should be developed and updated regularly. WHO Collaborating Centres could have a role in promoting good practice, training and collaboration between teams throughout the world. Centres undertaking systematic reviews should consider the guidelines given in the proposed WHO document when defining their evaluation criteria.

KW - Community Health Services

KW - Dental Care

KW - Health Promotion

KW - Humans

KW - Oral Health

KW - Outcome Assessment (Health Care)

KW - Program Development

KW - Program Evaluation

KW - Public Health

KW - World Health Organization

M3 - Journal article

C2 - 15617418

SN - 0265-539X

VL - 21

SP - 319

EP - 329

JO - Community Dental Health

JF - Community Dental Health

IS - 4 Suppl

ER -