Data engineer

You can:

• show an awareness of the need to translate technical concepts into non-technical language
• understand what communication is required with internal and external stakeholders

You can:

• undertake data profiling and source system analysis
• present clear insights to colleagues to support the end use of the data

You can:

• design, build and test data products based on feeds from multiple systems, using a range of different storage technologies, access methods or both
• create repeatable and reusable products

You can:

• show an awareness of opportunities for innovation with new tools and uses of data

You can:

• deliver data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future-proof

You can:

• explain the concepts and principles of data modelling
• produce, maintain and update relevant data models for an organisation’s specific needs
• reverse-engineer data models from a live system

You can:

• use metadata repositories to complete complex tasks such as data and systems integration impact analysis
• maintain a metadata repository to ensure information remains accurate and up to date

You can:

• explain the types of problems in databases, data processes, data products and services

You can:

• design, code, test, correct and document simple programs or scripts under the direction of others

You can:

• understand the core technical concepts related to the role, and apply them with guidance

You can:

• correctly execute test scripts under supervision
• understand the role of testing and how it works

You can:

• communicate effectively with technical and non-technical stakeholders
• support and host discussions within a multidisciplinary team, with potentially difficult dynamics
• be an advocate for the team externally, and can manage differing perspectives

You can:

• undertake data profiling and source system analysis
• present clear insights to colleagues to support the end use of the data

You can:

• design, build and test data products that are complex or large scale
• build teams to complete data integration services

You can:

• understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage

You can:

• select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions

You can:

• produce relevant data models across multiple subject areas
• explain which models to use for which purpose
• understand industry-recognised data modelling patterns and standards, and when to apply them
• compare and align different data models

You can:

• design an appropriate metadata repository
• suggest changes to improve current metadata repositories
• understand a range of tools for storing and working with metadata
• advise less experienced members of the team about metadata management

You can:

• respond to problems in databases, data processes, data products and services as they occur
• initiate actions, monitor services and identify trends to resolve problems
• determine the appropriate remedy and assist with its implementation, and with preventative measures

You can:

• use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations
• collaborate with others to review specifications where appropriate

You can:

• understand the core technical concepts related to the role, and apply them with guidance

You can:

• review requirements and specifications, and define test conditions
• identify issues and risks associated with work
• analyse and report test activities and results

You can:

• listen to the needs of technical and business stakeholders, and interpret them
• effectively manage stakeholder expectations
• manage active and reactive communication
• support or host difficult discussions within the team or with diverse senior stakeholders

You can:

• understand and help teams to apply a range of techniques for data profiling
• source system analysis from a complex single source
• bring multiple data sources together in a conformed model for analysis

You can:

• establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them
• manage resources to ensure that data services work effectively at an enterprise level

You can:

• identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption

You can:

• establish standards, keep them up to date and ensure adherence to them
• keep abreast of best practice in industry and across government

You can:

• understand the concepts and principles of data modelling and can produce relevant data models
• work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations
• design the method to categorise data models within an organisation

You can:

• design an appropriate metadata repository
• suggest changes to improve current metadata repositories
• understand a range of tools for storing and working with metadata
• advise less experienced members of the team about metadata management

You can:

• ensure that the most appropriate actions are taken to resolve problems as they occur
• co-ordinate teams to resolve problems and to implement solutions and preventative measures

You can:

• use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations
• collaborate with others to review specifications where appropriate

You can:

• show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape

You can:

• review requirements and specifications, and define test conditions
• identify issues and risks associated with work
• analyse and report test activities and results

You can:

• mediate between people and mend relationships, communicating with stakeholders at all levels
• manage stakeholder expectations and moderate discussions about high risk and complexity, even within constrained timescales
• speak on behalf of and represent the community to large audiences inside and outside of government

You can:

• understand and help teams to apply a range of techniques for data profiling
• source system analysis from a complex single source
• bring multiple data sources together in a conformed model for analysis

You can:

• establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them
• manage resources to ensure that data services work effectively at an enterprise level

You can:

• investigate emerging trends in data-related approaches, perform horizon-scanning for the organisation and introduce innovative ways of working

You can:

• establish standards, keep them up to date and ensure adherence to them
• keep abreast of best practice in industry and across government

You can:

• explain the concepts and principles of data modelling
• produce, maintain and update relevant data models for an organisation’s specific needs
• reverse-engineer data models from a live system

You can:

• identify how metadata repositories can support different areas of the organisation
• communicate the value of metadata repositories
• set up robust governance processes to keep repositories up to date

You can:

• anticipate problems and know how to prevent them
• understand how problems fit into the bigger picture
• identify and describe problems, and help others to describe them
• build problem-solving capabilities in others

You can:

• set local or team-based standards for programming tools and techniques and can select appropriate development methods
• advise on the application of standards and methods and ensure compliance
• take technical responsibility for all stages and iterations in a software development project, providing method-specific technical advice and guidance to project stakeholders

You can:

• anticipate and advise on future technology changes that present opportunities for the product or programme

You can:

• review requirements and specifications, and define test conditions
• identify issues and risks associated with work
• analyse and report test activities and results

Communicating between the technical and non-technical

Data analysis and synthesis

Data innovation

Metadata management

Problem resolution (data)

Programming and build (data engineering)

Testing

Communicating between the technical and non-technical

Data analysis and synthesis

Data innovation

Data modelling

Metadata management

Technical understanding

Testing

Communicating between the technical and non-technical

Data innovation

Technical understanding

Testing