Senior Data Engineer

Description:

Their team is a mixture of data engineering and data science individuals, so expect your work to have a clear impact on the business, as we work closely with our product team.

You’d be joining the business where your input will be pivotal, and you’ll have autonomy, an impact on decision-making, and a large scope for personal progression.

Responsibilities:

• Design solutions, build, develop, and deliver completed functionality to production

• Design & and implementation of the task scheduling (Airflow), distributed computation system (Python, Celery, EMR), and data lakes/data warehouses (S3, PostgreSQL)

• Implement data integration and ETL processes, ensuring data quality, integrity, and security

• Build and maintain data warehouses, data lakes, and other storage solutions, utilizing cloud-based technologies (such as AWS, Azure, or GCP) and modern data architecture patterns

Essential:

• Experience as a Data Engineer or a similar role

• Expertise in designing and implementing scalable data pipelines, ETL processes, and data warehousing solutions

• Proficiency in programming languages like Python, with experience in using frameworks like Apache Spark or Hadoop

• Experience with Snowflake