Description:
The Data Engineer will build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by the OfS’ data analysts and data scientists. They will implement efficient data systems that are aligned appropriately with business goals, and will make all the organisation’s data accessible to be used in support of relevant aspects of the OfS regulatory mission.
Key responsibilities include:
- Working to Extract, Transform and Load (ETL) data sets from a variety of data sources across the OfS enterprise technology stack.
- Monitoring the execution of data workflows, including identifying and mitigating risks, setting service level indicators and configuring alerts.
- Adopting data governance best practice when processing raw data to develop, test and maintain datasets, including the use and maintenance of relevant resources (such as, but not limited to, a data catalogue, data dictionary, logical data models).
- Supporting continuous data quality improvements across the organisation by exploring enhancements to: automated quality assurance processes; the reliability of data workflows; and the effectiveness of data transformations.
- Applying dimensional data modelling concepts and practices across the OfS data to develop conceptual, logical and physical data models that support efficiency and effectiveness of business operations
- Advocating and supporting an evidence-led culture across the organisation, assisting with driving enhancements to the organisation’s data capability.
Person specification
About you
To fulfil the role you will be:
- Adaptable, with a willingness to work flexibly as the needs of the organisation evolve
- Able to work well within a team, and able to work closely with internal and external stakeholders.
- Able to take a logical and analytical approach, and to take a pragmatic, collaborative approach to solving problems.
- Experienced in organising, manipulating, understanding and optimising data structures through data management tools and analytical programming, and of designing and running complex processes from beginning to end.
- Adept at communicating technical concepts to a non-technical audience.