How to use the guidelines
The purpose of the guidelines is to build:
- your own and your service’s knowledge about evaluation;
- your capacity to identify what data needs to be collected to help you demonstrate your program’s success through evaluation, including how program success relates to the ACT Wellbeing Framework and Closing the Gap targets (see Guideline 6);
- your service’s capacity to undertake evaluation and monitoring activities; and
- your service’s capacity to facilitate evaluations that might be completed by other external organisations.
Some services may already have high levels of internal knowledge and capacity to undertake evaluation and monitoring activities and have systems set up exactly for this. If so, they may only use these guidelines and resources occasionally, for example, when thinking about changing data collection and systems.
There will also be services that have less knowledge and experience about evaluation and performance monitoring. These guidelines are intended to be a helpful resource for these services, to build internal capacity to undertake evaluation and performance monitoring. Where relevant, they can also support external evaluators to do these activities on your behalf.
The guidelines have been split into stages that can take your service through evaluation step-by-step. They are not intended to be prescriptive, and you do not have to use all of the guidelines, if they are not relevant to you and your service. It is also not expected that you will implement everything that is suggested in these guidelines. Instead, they are designed to provide some guidance that can be embedded in your systems and also adapted to suit your purposes.
A number of activities have informed the development of these guidelines and resources, including desktop reviews and consultations. For more information refer to Additional resources section of the Overview and introduction document.
Overview of guidelines
You can read an overview of each of the guidelines, what they cover and who they are targeted at. A workflow map for how the guidelines can be used at different stages of preparing for evaluation is also available.
What does it cover?
- What is a program logic model?
- How can services develop their own program logic model?
Who is it for?
- Services that have not developed a logic model yet
- Services that want to refresh or revise existing logic models
What does it cover?
- Why is getting consent important?
- What are the concerns about client capacity to consent?
- When should consent be collected?
- How should services record and store information about consent?
Who is it for?
- Services that do not have consent processes in place yet
- Services that want to review their consent processes to ensure they are ethical and consistent with the Privacy Act 1988
What does it cover?
- Why collect detailed information about clients?
- What types of information should services be collecting?
- When should client information be collected?
- How should services be recording and storing client information?
- How can services ensure that information is being collected consistently?
Who is it for?
- Services that are not collecting information about client characteristics yet
- Services that need some guidance about how to ask clients for sensitive information in a safe and appropriate way
- Services that are interested in reviewing what they currently collect about clients
What does it cover?
- What are activities and outputs?
- Why should services record what they do?
- What types of information should services be collecting?
- When should activity and output information be collected?
- How can services ensure that information is being collected consistently?
Who is it for?
- Services that are not collecting information about outputs and activities yet
- Services that are developing or reviewing their activity and output processes
- Services that want guidance on what they should be collecting to help with evaluation and reporting
- Services that want to review the information they currently collect and how they complete reporting
What does it cover?
- What is client feedback?
- Why collect client feedback?
- When should services collect client feedback?
- What tools can services use to collect client feedback?
- How should services collect client feedback?
- Which clients should be asked to provide feedback?
- How can services increase client response rates?
- How should services store client feedback?
Who is it for?
- Services that are not yet measuring client satisfaction
- Services that want to check whether their client satisfaction measurement processes are best practice
- Services that want some advice about how to increase client participation in these feedback processes
What does it cover?
- What are outcomes?
- What outcomes should services measure?
- What tools should services use to measure outcomes?
- When should services collect outcomes data?
Who is it for?
- Services that are not collecting information about outcomes associated with their service
- Services that are already collecting some information but want guidance about how they could collect more data for evaluation purposes
What does it cover?
- What is a case study?
- Why use case studies?
- What data should services use to create a case study?
- What is an appropriate unit of analysis for a case study?
- How can services protect client anonymity?
- What is a composite case study?
Who is it for?
- Services that are unfamiliar with the development of case studies for evaluation purposes