Digital evaluator

You can:

• explain why it's important to clearly communicate findings from analysis
• explain some methods for effectively communicating findings from analysis

You can:

• explain the importance of using data ethics and privacy in your work
• identify appropriate channels to discuss ethical issues, with support

You can:

• evaluate interventions with support using techniques including process evaluation, impact evaluation, ‘theory of change’, experimentation and economic evaluation
• collect quantitative and qualitative data with support
• analyse and interpret data you have collected and data from other sources with support
• use some analytical approaches, including descriptive and inferential analysis

You can:

• describe how you might work with a stakeholder to understand what they need to evaluate and why
• describe a process for translating stakeholder needs into potential research questions and evaluation approaches
• describe some methods for monitoring and evaluating a product or service

You can:

• describe how evaluation needs and activities vary at different phases of the product life cycle

You can:

• describe what a ‘theory of change’ is
• identify some appropriate stakeholders to involve in developing a theory of change
• describe common issues when measuring performance indicators
• explain the difference between analysis of digital performance and broader monitoring of a product, for example against strategic objectives

You can:

• describe some basic data issues and how to check that data and analysis look right
• explain the concept of data being fit for purpose, and the context of the data
• describe some methods for preparing data for analysis
• describe quality assurance processes

You can:

• choose the appropriate medium to communicate findings
• shape and share communications relevant to the audience
• present analysis and visualisations in clear ways to both specialist and non-specialist audiences, with support
• give tactical recommendations based on your analysis and insight to inform decision making

You can:

• apply fundamental principles of data ethics and privacy in your work under supervision
• share data ethics and privacy risks through appropriate channels

You can:

• evaluate interventions with support using techniques including process evaluation, impact evaluation, ‘theory of change’, experimentation and economic evaluation
• collect quantitative and qualitative data with support
• analyse and interpret data you have collected and data from other sources with support
• use some analytical approaches, including descriptive and inferential analysis

You can:

• work with stakeholders to understand their needs
• translate stakeholder needs into potential research questions and evaluation approaches
• present options for monitoring and evaluation of products and services
• influence decisions on evaluation plans with support

You can:

• ensure the team is measuring performance as appropriate for the relevant service standard phase
• manage the delivery of evaluation of services or products at different phases
• plan and look at data requirements in future phases

You can:

• develop a ‘theory of change’ for product or services through discussion with stakeholders, with support
• identify and present options for measuring indicators to stakeholders
• turn some identified theory of change indicators into measurement frameworks for a digital service
• support the development of a performance dashboard

You can:

• identify appropriate ways to collect, collate and prepare data
• decide if data and analysis is accurate and fit for purpose
• perform data preparation and cleansing with limited guidance
• undertake quality assurance processes
• peer-review colleagues’ outputs from data analysis to ensure quality

You can:

• turn complex data into compelling, clear and actionable stories
• share data communication skills with the team and across government
• present analysis and visualisations in clear ways to communicate complex messages
• communicate negative and positive information to stakeholders
• give tactical and strategic recommendations

You can:

• work with stakeholders to identify and address ethical and privacy concerns
• demonstrate and communicate how data ethical issues fit into the wider organisational context
• research developments in data ethics and privacy to improve compliance and processes
• assess and constructively challenge proposed data ethics policies

You can:

• evaluate digital services using some appropriate techniques including process evaluation, impact evaluation, ‘theory of change’, experimentation and economic evaluation
• collect quantitative and qualitative data
• analyse and interpret data you have collected and data from other sources
• use a wide range of analytical approaches, including descriptive and inferential analysis.

You can:

• influence stakeholders to secure resources for an evaluation project
• identify evaluation and evidence needs
• ensure plans for monitoring and evaluation of products and services are appropriate and proportionate
• consider wider policy and practical constraints that affect evaluation strategy
• agree the evaluation approach with diverse stakeholders

You can:

• ensure the team is measuring performance as appropriate for the relevant service standard phase
• manage the delivery of evaluation of services or products at different phases
• plan and look at data requirements in future phases

You can:

• develop a ‘theory of change’ for product or services through discussion with stakeholders
• turn theory of change indicators into measurement frameworks for a digital service
• work with performance analysts to develop a performance dashboard reporting service analytics and other identified indicators

You can:

• set up a system to get data ready for use
• specify how data should be cleansed and prepared
• bring data together from different sources
• communicate the limitations of data

You can:

• communicate relevant, compelling stories using the most appropriate medium
• make complex recommendations at a tactical and strategic level

You can:

• oversee compliance with data ethics standards and legislation across the organisation
• develop, manage and continuously improve an ethical framework within your area
• develop a data ethics culture, influencing others to act on it
• ensure data ethics is applied appropriately when formulating, implementing and evaluating organisational policies and programmes

You can:

• evaluate digital services using some appropriate techniques including process evaluation, impact evaluation, ‘theory of change’, experimentation and economic evaluation
• collect quantitative and qualitative data
• analyse and interpret data you have collected and data from other sources
• use a wide range of analytical approaches, including descriptive and inferential analysis.

You can:

• influence stakeholders to secure resources for an evaluation project
• identify evaluation and evidence needs
• ensure plans for monitoring and evaluation of products and services are appropriate and proportionate
• consider wider policy and practical constraints that affect evaluation strategy
• agree the evaluation approach with diverse stakeholders

You can:

• apply monitoring and evaluation techniques in multiple parts of the product life cycle
• recommend when to move forward and when to stop
• work with other Agile delivery disciplines throughout the product life cycle
• plan and proactively engage with stakeholders at the appropriate stage of the project

You can:

• get support from senior stakeholders for the need to develop theories of change
• provide guidance on how to develop theories of change
• define best practice and methodologies for measuring indicators, including economic outcomes, and communicating limitations

You can:

• set up tools and systems for effectively assuring data and analysis across multiple teams
• use appropriate approaches for verifying and validating data and analysis
• influence senior stakeholders over data and analysis approaches
• coach and mentor others in assuring data and analysis

You can:

• communicate relevant, compelling stories using the most appropriate medium
• make complex recommendations at a tactical and strategic level

You can:

• oversee compliance with data ethics standards and legislation across the organisation
• develop, manage and continuously improve an ethical framework within your area
• develop a data ethics culture, influencing others to act on it
• ensure data ethics is applied appropriately when formulating, implementing and evaluating organisational policies and programmes

You can:

• provide guidance on evaluation techniques for digital services to evaluators
• assure the evaluation work of digital evaluator teams define best practice and methodologies for evaluation and ensure they are shared across teams
• coach people across the organisation to use appropriate evaluation techniques

You can:

• influence the organisation’s senior stakeholders to secure resources for evaluation projects
• provide guidance on the evaluation strategy for a group of digital products and services
• ensure evaluation plans are delivered effectively and meet quality standards
• coach teams on how to create evaluation and plans and strategies

You can:

• lead and champion best practice, and identify improvements to current approaches for monitoring and evaluation through the product life cycle
• identify and raise evaluation or product risks during any stage of the product life cycle
• coach, guide and support teams moving through the product life cycle phases

You can:

• get support from senior stakeholders for the need to develop theories of change
• provide guidance on how to develop theories of change
• define best practice and methodologies for measuring indicators, including economic outcomes, and communicating limitations

You can:

• set up tools and systems for effectively assuring data and analysis across multiple teams
• use appropriate approaches for verifying and validating data and analysis
• influence senior stakeholders over data and analysis approaches
• coach and mentor others in assuring data and analysis

Communicating analysis and insight

Data ethics and privacy

Communicating analysis and insight

Quality assurance of data and analysis

Data ethics and privacy

Data ethics and privacy

Data ethics and privacy