Data engineer

You can:

• explain why it's important to communicate technical concepts in non-technical language
• explain the types of communication that can be used with internal and external stakeholders, and their impact

You can:

• undertake data profiling and source system analysis
• present clear insights to colleagues to support the end use of the data

You can:

• use official data classification when authoring documents
• apply internal procedures, policies and technologies to ensure secure data handling
• identify and address ethical considerations when working with data
• address data compliance issues using internal processes

You can:

• implement simple data solutions such as data pipelines, following established approaches and standards
• create repeatable, reliable and reusable data solutions

You can:

• show an awareness of opportunities for innovation with new tools and uses of data

You can:

• design simple data exchange or integration solutions using established patterns or modelling techniques
• include security features in your data integration designs

You can:

• explain the concepts and principles of data modelling
• produce, maintain and update relevant data models for an organisation’s specific needs
• reverse-engineer data models from a live system

You can:

• use metadata repositories to complete complex tasks such as data and systems integration impact analysis
• maintain a metadata repository to ensure information remains accurate and up to date

You can:

• investigate problems in systems, processes and services, with an understanding of the level of a problem, for example, strategic, tactical or operational
• contribute to the implementation of remedies and preventative measures

You can:

• design, code, test and deploy programs or scripts following standards and good practice
• write readable, maintainable code
• use automation to improve the software development life cycle
• consider and adopt appropriate security measures in your solutions

You can:

• understand the core technical concepts related to the role, and apply them with guidance

You can:

• communicate effectively with technical and non-technical stakeholders
• support and host discussions within a multidisciplinary team, with potentially difficult dynamics
• be an advocate for the team externally
• manage differing stakeholder perspectives

You can:

• undertake data profiling and source system analysis
• present clear insights to colleagues to support the end use of the data

You can:

• consistently apply data ethics, legislation, internal procedures, policies and technologies to ensure secure data handling
• help ensure your team remain compliant by identifying and addressing current and potential data compliance and ethical issues
• guide and support others in addressing data compliance issues

You can:

• lead the implementation of complex or large-scale data solutions
• apply appropriate technology and techniques to ensure data solutions are secure and scalable
• identify and implement continuous improvement to the operation and performance of data solutions

You can:

• understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage

You can:

• select the most appropriate techniques for different integration scenarios
• evaluate and lead the implementation of integration using varied approaches that ensure security, efficiency and compliance

You can:

• produce relevant data models across multiple subject areas
• explain which models to use for which purpose
• understand industry-recognised data modelling patterns and standards, and when to apply them
• compare and align different data models

You can:

• design an appropriate metadata repository
• suggest changes to improve current metadata repositories
• understand a range of tools for storing and working with metadata
• advise less experienced members of the team about metadata management

You can:

• initiate and monitor actions to investigate patterns and trends to resolve problems
• effectively consult specialists where required
• determine the appropriate resolution and assist with its implementation
• determine preventative measures

You can:

• lead the design, code, testing and deployment of secure, resilient and maintainable solutions
• continuously improve the codebase and reliability of solutions
• create automation to improve the software development life cycle
• work with others to implement standards and good practice to ensure security, testability and maintainability of solutions

You can:

• understand the core technical concepts related to the role, and apply them with guidance

You can:

• listen to and interpret the needs of technical and non-technical stakeholders, and manage their expectations
• manage active and reactive communication
• support or host difficult discussions within the team or with diverse senior stakeholders

You can:

• understand and help teams to apply a range of techniques for data profiling
• source system analysis from a complex single source
• bring multiple data sources together in a conformed model for analysis

You can:

• advise senior stakeholders on data security, ethical or procedural risks
• improve organisational awareness of data compliance and procedures
• lead, guide and mentor teams in implementing secure data practices and maintaining compliance

You can:

• establish cross-organisational data solutions that include all aspects of the data development life cycle
• define and promote good practices for creating repeatable, reliable and reusable data solutions

You can:

• identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption

You can:

• establish cross-organisational data integration standards and design patterns
• guide teams in designing secure and interoperable systems and services

You can:

• understand the concepts and principles of data modelling and can produce relevant data models
• work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations
• design the method to categorise data models within an organisation

You can:

• design an appropriate metadata repository
• suggest changes to improve current metadata repositories
• understand a range of tools for storing and working with metadata
• advise less experienced members of the team about metadata management

You can:

• ensure that the right actions are taken to investigate, resolve and anticipate problems
• co-ordinate the team to investigate problems, implement solutions and take preventive measures

You can:

• lead the design, code, testing and deployment of secure, resilient and maintainable solutions
• continuously improve the codebase and reliability of solutions
• create automation to improve the software development life cycle
• work with others to implement standards and good practice to ensure security, testability and maintainability of solutions

You can:

• show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape

You can:

• mediate between people and strengthen relationships, adopting the appropriate communication method with stakeholders at all levels
• manage stakeholder expectations and moderate difficult discussions about high risk and complex topics, even within constrained timescales
• speak on behalf of, and represent the community to, large audiences inside and outside the organisation

You can:

• understand and help teams to apply a range of techniques for data profiling
• source system analysis from a complex single source
• bring multiple data sources together in a conformed model for analysis

You can:

• advise senior stakeholders on data security, ethical or procedural risks
• improve organisational awareness of data compliance and procedures
• lead, guide and mentor teams in implementing secure data practices and maintaining compliance

You can:

• establish cross-organisational data solutions that include all aspects of the data development life cycle
• define and promote good practices for creating repeatable, reliable and reusable data solutions

You can:

• investigate emerging trends in data-related approaches, perform horizon-scanning for the organisation and introduce innovative ways of working

You can:

• establish cross-organisational data integration standards and design patterns
• guide teams in designing secure and interoperable systems and services

You can:

• explain the concepts and principles of data modelling
• produce, maintain and update relevant data models for an organisation’s specific needs
• reverse-engineer data models from a live system

You can:

• identify how metadata repositories can support different areas of the organisation
• communicate the value of metadata repositories
• set up robust governance processes to keep repositories up to date

You can:

• anticipate problems and defend against them at the right time
• understand how a problem fits into the larger picture
• identify and describe problems, and help others to describe them
• build problem-solving capabilities in others

You can:

• set standards for programming tools and techniques
• select appropriate development methods for a problem
• advise on the application of standards and methods that ensure security, maintainability and compliance
• take technical responsibility for all stages of a software development project, providing technical advice and guidance to stakeholders

You can:

• anticipate and advise on future technology changes that present opportunities for the product or programme

Data analysis and synthesis

Data innovation

Metadata management

Programming and build (data and analytics engineering)

Problem management

Communicating between the technical and non-technical

Data analysis and synthesis

Data innovation

Data modelling

Metadata management

Problem management

Communicating between the technical and non-technical

Technical understanding

Problem management

Technical understanding

Problem management

Communicating between the technical and non-technical

Problem management