Description:
We are looking for a Data Engineer that likes solving complex problems across a full spectrum of technologies. You will help ensure our technological infrastructure operates seamlessly in support of our business objectives.
You will help us to create and develop data as we move forward into our new Snowflake environment to ensure we deliver accurate and timely information to the rest of the business.
Duties Include
- Develop and implement data pipelines that extract, transform and load data using into our Snowflake environment for use with reporting tools such as Power BI and SSRS.
- Work on ingesting, storing, processing and analysing large data sets
- Assist in the creation and maintenance of a scalable and high-performance data warehouse.
- Translate complex technical and functional requirements into detailed designs
- Investigate and analyse alternative solutions to data storing, processing etc. to ensure the most streamlined approaches are implemented.
Responsibilities Include
- Develop and maintain data pipelines implementing ETL/ELT processes using
- Take responsibility for data set development and implementation
- Work closely with the wider data and BI team’s in implementing data analytic pipelines
- Help define data governance policies and support data versioning processes
- Maintain security and data privacy
- Define, build and maintain the data pipelines that will enable faster, better, data-informed decision-making within the business.
- An expert in SQL development, designing and developing scalable ETL packages from the business source systems
- Analyse complex data elements and systems, data flow, dependencies, and relationships to contribute to conceptual physical and logical data models.
- Responsible for designing, architecting and developing the data environment.
- Supporting and influencing the implementation of the data strategy.
- Work collaboratively with the entire Data & Analytics teams, providing support to the entire department for its data centric needs.
- Keep up with industry trends and best practices, advising senior management on new and improved data engineering strategies that will drive departmental performance, promoting informed decision-making, and ultimately improving overall business performance.
- Performs similar duties as delegated by the Data manager, Senior Data & Analytics manager and Chief Information Officer.
- Convey technical messages to collaborative non-technical departments and colleagues
- Documentation of Data architecture, policies, and procedures