Description:
At Biscuit, our mission is to make pet wellbeing easy, fun and rewarding for members – leading to happier and healthier pets. We understand the importance of our connection to our pets and the pivotal role they play in our lives.
We are looking for a talented Data Engineer to join our dynamic team. In this role, you will leverage cutting-edge technologies to enhance our data capabilities, providing critical insights that drive our mission forward. If you're passionate about making a significant impact through innovative data solutions, we’d love to hear from you.
Your Role:
- Data Pipeline Management: Design, build, and maintain scalable data pipelines using Azure Databricks.
- ETL Processes: Develop and implement robust ETL processes using big data technologies.
- Data Modelling: Apply strong expertise in data modelling techniques and warehousing solutions to support operational and analytical use cases.
- Programming and Querying: Use Python for complex data manipulation tasks and SQL to query large datasets.
- Data Integration: Seamlessly integrate data from various internal and external sources, including third-party vendors and APIs, to enrich existing datasets and expand the scope of actionable insights.
- System Optimisation: Continuously analyse and optimise data systems for enhanced performance and scalability.
Requirements:
- Professional Experience: At least four years of relevant data engineering experience.
- Technical Proficiency: Strong familiarity with Azure Databricks, Spark, Hive, Python, and SQL. Knowledge of Azure cloud services such as Data Factory and Storage accounts is highly regarded.
- Data System Mastery: Proven ability to handle data at scale, including data warehousing and data lakes.
- Collaboration and Communication: Excellent communication skills, with the ability to work effectively in a remote team environment.