Principal Data Engineer (Core Engineering)
Big Data Jobs ⫽ Data Engineer
Edinburgh
Competitive salary
Contract, Full time
Job description
Job Title: Principal Data Engineer
Contract Type: Permanent
Location: Alderley or Edinburgh or Glasgow
Working style: Hybrid 50% home/office based
Closing date: 29th October 2024
Royal London is seeking a Principal Data Engineer to lead a Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to the Group's data strategy and consists of a core structured data warehouse area plus an attached data science\ML platform.
This role presents a fantastic opportunity for an experienced data engineer - helping setup the core engineering team (who consist of data engineers, testers, and data modellers), defining reusable frameworks, patterns, and standards, guiding the data modellers in the definition and extension of the silver layer data model, and managing Agile Engineering boards/backlogs.
About the RoleAbout You
- Design and implement Extract, Transform, and Load (ETL) processes across a Data Lakehouse to ensure efficient data movement with appropriate transformations. Define and publish data engineering and ETL standards for the data platform.
- Analyse and communicate complex data engineering problems to senior audiences. Work with both structured and unstructured data to support downstream business outcomes. Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
- Work with Databricks, Lakehouse, ETL, and data pipelines.
- Provide technical leadership, responsible for mid and lower-level designs, patterns, and standards. Produce artifacts for architecture and design authorities to make informed decisions.
- Extensive technical design and development experience in specialism for the platform. Expected to be a code contributor in specialism.
- Experience with Azure Databricks, Azure Data Factory.
- Proficiency in SQL, Python, and PySpark.
- Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
- Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
- A broad understanding of BI and analytics tools, such as PowerBI, and optimizing consumption against engineered data layers.
- Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.
About Royal London
We're the UK's largest mutual life, pensions, and investment company, offering protection, long-term savings and asset management products and services.
Our People Promise to our colleagues is that we will all work somewhere inclusive, responsible, enjoyable and fulfilling. This is underpinned by our Spirit of Royal London values; Empowered, Trustworthy, Collaborate, Achieve.
We've always been proud to reward employees by offering great workplace benefits such as 28 days annual leave in addition to bank holidays, an up to 14% employer matching pension scheme and private medical insurance. You can see all our benefits here - Our Benefits
Inclusion, diversity and belonging.
We're an Inclusive employer. We celebrate and value different backgrounds and cultures across Royal London. Our diverse people and perspectives give us a range of skills which are recognised and respected - whatever their background.
Application url
This job is located on a third party website
Opens in new window - Please mention as the source of data when applying for this job