Dataops Engineer

Description:

As a DataOps Engineer, you will play a key role in leveraging state-of-the-art data technologies to drive positive impacts for the people of Scotland.

This is a key role in the Data Architecture Unit which has been established to coordinate and support Data Architecture activities across the Scottish Government and Public Sector.

Focused on developing and constructing data products and services and integrating them into systems and business processes you will collaborate closely with a diverse range of professionals, each bringing unique skills to the table, fostering innovation and problem-solving in the realm of data.

Typically, you will spend your time: -

• Designing and implementing complex data flows to connect operational systems and build data catalog, APIs, and data search repositories.
• Identifying and promoting opportunities for leveraging existing data flows across different teams
• Leading the development of data-streaming systems.
• Coordinating teams and establishing best practices and standards.
• Applying your expertise in systems integration to optimise data operations.
• Advocating for data engineering excellence within the government sector.

After a successful first year we anticipate you can look back with pride on the significant strides made in building a metadata search repository, implementing federated and self-service data architecture, and incorporating AI (Artificial Intelligence) into data architecture and governance. This will be instrumental in enhancing the Scottish Government’s cloud platform's capabilities and utility.

Responsibilities:

• Strategic
• Drive automation initiatives and incorporate DevOps best practices to optimise data pipelines, deployment processes, and overall system reliability.
• Provide strategic direction in designing, implementing, and optimizing REST and GraphQL APIs to facilitate seamless data exchange between systems and applications, while also mentoring junior developers in API design principles.