Data Engineer

Job Description

Job Description:

Project Description:
Role Overview:
You will be a critical team member supporting the existing solutions and developing the means to collect and ingest data, developing data models and data architectures, creating automated data pipelines, and taking the lead in making these Production-ready. You will assist with integrating with existing applications, and will be working with leading organizations and teams in the region.
We are interested in hearing from individuals with a background in data – both SQL and non-SQL, with very strong Data Engineering background.

Responsibilities:
You will work alongside a strong, global team of individuals with diverse backgrounds and skills in a variety of areas to:
* Analyse data sources, and acquire data
* Create data pipelines, and integrate to final data destinations
* Create appropriate data models, architectures and pipelines
* Move the models and pipelines into Production
* You will assist the practice in:
* Developing templates and accelerators, across a variety of libraries and platforms.
* Participating in data workshops and client work as necessary
* You will collaborate with business and technology partners to grow and develop the data engineering practice.

Mandatory Skills Description:
* Must have proven history of multiple analytics projects on AWS.
* Strong data-related development skills.
* Lead technical discussions, relating to the analytics AWS footprint, with the other areas of the business in all areas of data and analytics.
* Develop a highly scalable and secure Cloud Data Platform within AWS, leveraging appropriate AWS services and technologies including AWS Redshift, Athena, Lambda or Glue.
* Strong skills with SAP HANA Databases and good understandings and experience to analyse them as data source.
* Strong experience with SAP HANA data connectors and demonstrable experience of SAP HANA data analysis.
* Exposure to the full Software Development Life Cycle, and experience of working in a modern development team
* Good analytical skills
* Strong communication skills, both verbal and written. The successful candidates will be expected to communicate effectively with both business and technical teams

Nice-to-Have Skills:
* Good understanding of data integration patterns
* Extensive experience in Architect, designing, and implementing the data flow from source systems into an AWS Data Lake.
* Good understanding of Data Quality, governance is highly desirable.
* Good experience with Databricks is highly desirable.