Citation

Huckel Schneider C, Milat AJ, Moore G. Eval. Program Plann. 2016; 58: 208-215.

Affiliation

Menzies Centre for Health Policy, University of Sydney, Level 6 The Hub, Charles Perkins Centre D17, The University of Sydney NSW 2006, Australia. Electronic address: gabriel.moore@saxinstitute.org.au.

Copyright

(Copyright © 2016, Elsevier Publishing)

DOI

10.1016/j.evalprogplan.2016.06.011

PMID

27461992

Abstract

Our research sought to identify the barriers and facilitators experienced by policymakers and evaluation researchers in the critical early stages of establishing an evaluation of a policy or program. We sought to determine the immediate barriers experienced at the point of initiating or commissioning evaluations and how these relate to broader system factors previously identified in the literature. We undertook 17 semi-structured interviews with a purposive sample of senior policymakers (n=9) and senior evaluation researchers (n=8) in Australia. Six themes were consistently raised by participants: political influence, funding, timeframes, a 'culture of evaluation', caution over anticipated results, and skills of policy agency staff. Participants also reflected on the dynamics of policy-researcher relationships including different motivations, physical and conceptual separation of the policy and researcher worlds, intellectual property concerns, and trust. We found that political and system factors act as macro level barriers to good evaluation practice that are manifested as time and funding constraints and contribute to organisational cultures that can come to fear evaluation. These factors then fed into meso and micro level factors. The dynamics of policy-researcher relationship provide a further challenge to evaluating government policies and programs.

Copyright © 2016 Elsevier Ltd. All rights reserved.

Language: en