Services

Our services include:

  • Developing monitoring and evaluation frameworks
  • Conducting evaluations of policies, strategies and programs
  • Developing evaluation capacity
  • Conducting research, particularly to inform strategy development and subsequent evaluations
  • Strategy development
  • Organisational review and capacity development

Developing monitoring and evaluation frameworks

Development of a sound monitoring and evaluation framework provides a guide and a shared understanding between the evaluator, client and key stakeholders regarding the purpose, focus and conduct of an evaluation.  We are experienced in development of monitoring and evaluation frameworks for initiatives of varying types, sizes and levels of complexity.  This covers both one-off evaluations, and on-going evaluation systems.  Common elements include use of a program logic to identify expected outcomes, generation of evaluation questions and indicators, and specifying means to collect and analyse information, and also reporting arrangements.

We have developed training programs on preparing monitoring and evaluation frameworks and delivered these for the Australasian Evaluation Society in Australia and New Zealand; at the American Evaluation Association conference; and also in the UK, Ireland, Cyprus, Papua New Guinea and Indonesia.

Conducting evaluations of policies, strategies and programs

Our approach to conduct of evaluations takes into account client needs and preferences, but typically involves assessment of the degree to which policies, strategies or programs have met their objectives and intended outcomes. We assess the appropriateness of the initiative to its objectives and stakeholder needs, and whether it has been carried out efficiently.  We emphasise drawing on evidence from the literature and practice reviews to provide a benchmark for assessment, and identification and dissemination of learning. We are experienced with a range of evaluation approaches, methodologies and tools including:

  • Evaluability assessment
  • Assessment of current practice in a sector and literature reviews
  • Participatory approaches
  • Performance measurement and monitoring
  • Qualitative, quantitative and mixed methods approaches
  • Survey design, conduct, management and analysis
  • Stakeholder interviews and case studies
  • Conduct of individual and multiple case studies
  • Governance reviews and assessment of organisational performance

Developing evaluation capacity

We assist both organisations and individuals to access knowledge and skills, and design and implement evaluations and evaluative approaches.  More broadly, we provide support for organisations to develop and manage evaluation systems, and use evaluation to improve organisational performance, and promote learning. We provide mentoring and training, as well facilitating staff/stakeholder workshops on the:

  • purpose and use of evaluation in specific contexts, such as evaluation of training initiatives, programs and strategies, and assessment of organisational performance
  • developing monitoring and evaluation frameworks
  • use of program theory and logic
  • use of specific evaluation approaches and tools

Conducting research

We conduct research, particularly to inform strategy development and subsequent evaluations. We have extensive experience in identification of good practice and lessons learned across a range of professional areas, and in conduct of associated literature reviews.  Such research may be carried out independently or integrated into a larger evaluation initiative.  The products of this research are particularly useful to identify emerging thinking and successful strategies; and to focus evaluations, inform evaluation questions and provide benchmarks for evaluative assessment.

Strategy development

Following the conduct of evaluations or facilitating reflection on program or organisational performance, we may be retained by a client to assist with the revision of strategies or program designs.  We also have experience in participation in program formulation roles within which we identify monitoring and evaluation needs and a suitable approach and methods for performance assessment and learning.

Organisational review and capacity development

We undertake organisational reviews covering functions such as strategy; governance and planning arrangements; program management; stakeholder engagement and public relations; and the role of monitoring, evaluation and learning.  We assist in developing new organisational structures; plans and systems; and with training and mentoring of staff.  Our intent is to promote alignment between different organisational functions and increase effectiveness.

Tailored approach / common principles

The scope of our evaluative work covers individual projects and programs; strategies and partnership arrangements; policy initiatives; whole of government and sectoral reform programs; regional strategies and initiatives; organisational effectiveness and governance arrangements; and funding and grant delivery structures.

Our evaluation work is tailored to specific needs, and also guided by professional practice principles.  We customise our approach and the methodologies employed to the scope of the initiative, its stage of implementation, and the interests and capacity of involved stakeholders.

Common principles guiding our work include:

  • Working collaboratively with the client and stakeholders to understand needs and identify the best approach
  • Maintaining on-going communication with clients regarding evaluation processes and products
  • Respecting the rights, dignity and privacy of those contributing to the evaluation
  • Using a rigorous approach in design, data collection and analysis
  • Ensuring that judgements and recommendations are based on sound and reliable evidence
  • Being sensitive to cultural and socio-economic factors which may affect participation in the  evaluation, and the use and impact of the evaluation
  • Producing clear, concise reports and presentations that meet client expectations
  • Maintaining agreed timeframes for deliverables

Formative or Summative Approach

Our evaluation work may be Formative or Summative, or involve a mix of these two approaches. We conduct Formative Evaluations before or during a program’s implementation with the aim of improving its design and performance.  Our experience highlights the value of such evaluations in community engagement and behaviour change interventions which may be complex and require careful assessment of processes and emergent outcomes.  Summative Evaluations are most commonly conducted near the end of a program or stage of its implementation. In such evaluations, we commonly assess levels of achievement of objectives and outcomes, and identify what works and what does not in the program, and why.