Data Engineer at Jubilee Insurance

Job Ref. No.: JLIL239

Role Purpose

The data engineer will oversee expanding and optimizing of our data architecture and data pipeline with the purpose of improving data analysis and ML workflows. The data engineer will be handling the design and construction of scalable data systems and research new use cases for data acquisition.

Main Responsibilities
 Strategy:

• Design and develop a data estate that is performant, accessible, secure, scalable, maintainable, and extensible. This includes AWS/Azure Data Lake and all other integrating functionalities and layers like ML, Analytics and data science.
• Design and develop and maintain data pipelines including ML pipelines.
• Model EDW entities and ensure all data is complete, accurate, timely, and well documented.
• Work towards the implementation of a true Self-Service analytics platform.
• Implementation of CI/CD practices within the data platform

Operational:

• Follow existing processes and work to improve/identify gaps in these processes.
• Ensure the correct SDLC promotion processes are followed.
• Follow the correct sign-off processes to ensure that only approved releases are deployed into Production.
• Ensure that all AWS/Azure development follows CI/CD processes and is repeatable.

Corporate Governance (Regulatory and Compliance):

• Ensure compliance with regulatory and industry standards, data privacy, security, and governance requirements.
• Ensure that all work follows the best security practices and fully adheres to DPA and other data regulations.
• Ensure that all work follows the correct approval and sign-off process before it is pushed into Production.
• Ensure that all work is documented and if needed, has a runbook in order to guarantee business continuity and support.
•  Work with others in the team to keep the Data Dictionary and Ubiquitous Language complete and up to date.

Leadership and Culture:

• Build relationships with members of the data team and the wider business team.
• Work closely and collaboratively with all members of the data team.
• Work closely with and learn from tech and team leads and challenge proposed solutions with your own ideas.

 Key Competencies and Skills

• Experience and knowledge of the SQL query language.
• Understanding of data architecture and data modelling techniques
• Experience with cloud technologies in building and maintaining platforms.
• ETL and ELT experience - both batch and microservices-led.
• Proven experience working with data.

 Academic Qualifications

• Bachelors’ degree in IT or related fields

 Professional Qualifications

• Certification in Azure/GCP/AWS preferred.

Relevant Experience

• Minimum three years’ experience in a data engineer role or similar.
• Experience and knowledge of a coding language such as Python specifically data manipulation