Description:
The position is a senior technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure and platform engineering, platform operations and production support.
In this role you will:
- Ingest and provision raw datasets, enriched tables, and curated data assets to support various cybersecurity use cases.
- Drive enhancements to the data ingestion process, with an emphasis on real-time data coverage.
- Design and implement robust data pipelines that integrate diverse data sources across the enterprise and external platforms.
- Perform ETL workflows, leveraging both advanced data manipulation tools and custom code, ensuring data is accessible and structured appropriately for all systems and stakeholders.
- Identify, analyze, and onboard new data sources, conducting exploratory analysis when necessary.
To be successful in this role you should meet the following requirements:
- Strong experience with SRE and Azure DevOps.
- Proficiency in scripting (Bash/PowerShell, Azure CLI), coding (Python, C#, Java), and querying (SQL, Kusto).
- Hands-on experience with PowerShell, Terraform, and object-oriented programming languages.
- Strong experience with cloud & big data technologies, including Azure Cloud, Azure IAM, Azure AD, Azure Data Factory, Databricks, Kubernetes, and PowerBI.
- Experience with server and infrastructure technologies like Nginx/Apache, CosmosDB, Linux, and tools such as Prometheus, Grafana, and Elasticsearch.