Lead Data Engineer

 

Description:

The Data, Analysis and Insight team plays a pivotal role in supporting a whole range of senior leaders across the business through reporting, analysis and insights. Our work supports the organisation’s overall strategy and empowers senior leaders to make strategic, data driven business decisions. In December 2021 we published our Data Strategy, setting out HMCTS’s commitment to becoming a data driven organisation.

HMCTS Data Strategy (publishing.service.gov.uk)

As part of this strategy, HMCTS has invested in a cloud-based strategic data platform to transform the ways in which we work with data and enable us to add more value than ever to the organisation and the public. This platform is now technically complete, and we are looking for enthusiastic and motivated individuals to join our team and help us exploit our new technology.

This role will be based in our Data Management and Engineering team responsible for holding, curating, and protecting our data to drive value for our organisation both now and into the future.

Job Descriptions

  • You will manage and lead a team of data engineering professionals to develop and deliver business-as-usual data, reporting and analytics output.
  • You will enable operational data from case management systems to be appropriately shared and disseminated within operational reports, published Management Information or Official Statistics.
  • Working closely with Data analysts and scientist colleagues to develop robust processes for managing and automating regular outputs.
  • Communicating plans and timescales to enable onward management of key stakeholders and providing regular updates. Feeding into development priorities to understand potential efficiencies and savings in automated processes, to deploy and manage resources appropriately as the organization progresses towards its strategic data solution.
  • Developing and implementing new technologies to support robust and accurate data management, ensuring documentation, data dictionaries, and data lineage information is readily available across a range of stakeholders.
  • Manage and lead a team to provide robust data models to support required reporting and ensure data processes are efficient and reliable. This will include ensuring accuracy of data by implementing a robust quality assurance framework to guarantee decisions and actions are based upon reliable and accurate data.

Key responsibilities

Essential Criteria

  • Understanding of managing teams and their priorities, setting expectations to meeting evolving customer needs and ensure BAU
  • Lead on the delivery of physical data models and views required for data exploiters to enable visualization of metrics and the provision of insightful analysis for data science projects.
  • Extensive working knowledge and experience with ETL (extract, transform and load) and data integration, including exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
  • Experience of communicating effectively with operational business and analytical teams to define data requirements, analyse data, and develop data models and metrics that meet requirements.
  • Technical lead for departmental work area, this could one or more HMCTS jurisdictions and overall data management framework.
  • Demonstrate a passion for continuous improvement for working with data across the wider team, including automation of manual tasks and data assurance.
  • Analytical skills in, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation.
  • Confident in defining and documenting data workflows across systems and operations; capturing complex data definitions.
  • Proficient in working with data and databases with understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts. (e.g Kimball)
  • Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
  • Experience of code reviews and ensuring coding standards are applied and met.
  • Knowledge of work management/collaboration tools such as MS Teams, Trello and JIRA etc.

Desirable criteria

  • Experience of writing parameterised code in either a programming or scripting language such as SQL/PL-SQL and/or Python/Spark and experienced in delivering metadata driven development processes.
  • Experience of building pipelines in cloud technologies such as Azure Data Factory/Databricks.
  • Experience of using CI/CD techniques and processes DevOps/Git repository code promotion and change management experience.

Organization Ministry of Justice
Industry IT / Telecom / Software Jobs
Occupational Category Lead Data Engineer
Job Location London,UK
Shift Type Morning
Job Type Full Time
Gender No Preference
Career Level Intermediate
Experience 2 Years
Posted at 2024-08-01 6:47 am
Expires on 2024-12-27