Senior Data Engineer

The Role

This year marks the go-live for our major tech transformation. This end-to-end system will give us some amazing benefit and opportunities, including access more and ‘better’ data. With this context in mind, we are looking for two Senior Data Engineers to play a pivotal role in designing, developing, and maintaining a cutting-edge data platform on Azure using Databricks. Your primary responsibility will be to architect and implement scalable data pipelines, ensuring efficient data processing, storage, and retrieval. You will collaborate closely with analysts, and other stakeholders to deliver high-quality data solutions that drive business insights and decision-making. 

Duties include (but not limited to)

• Provide logical, and physical data designs/models. 
• Design, develop, and maintain scalable data pipelines using Azure Databricks. 
• Ensure efficient data ingestion, transformation, and storage processes.
• Work closely with business stakeholders, architects, analysts, and other stakeholders to understand data requirements. 
• Implement and enforce data security measures to protect sensitive information. 
• Ensure compliance with data governance policies and regulatory requirements. 
• Maintain comprehensive documentation of data pipelines, processes, and architectures. 

You!

We are looking for seasoned Senior Data Engineer.

If you have a combination of the following skills and experience, we are keen to chat!

• Strong skills in designing and building ETL/ELT pipelines. ETL v ELT and when to use them. 
• DataBricks and Azure  
• Proficiency in programming languages such as Python, SQL, PowerShell 
• Familiarity with cloud architecture and best practices. Specifically, Azure
• Experience in data modelling, schema design, and data warehousing concepts. 
• OLTP and OLAP Modelling 
• Securing data using RBAC 
• Understanding of data quality frameworks and data governance principles. 
• Some experience mentoring junior data engineers.  
• Financial Service experience 
• DevOps experience and tooling: Specifically, Microsoft Azure DevOps.  

Knowledge of Microsoft SQL Server architecture and features.