Big Data Engineer - Octave: Data and Advanced Analytics Centre of Excellence
.
Our business built over 150 years touches nearly every major sector of the economy. We generate a significant quantum of data and we intend to use it to build the future of our businesses. Our Digital and Analytics insights canpositively disrupt life for all Sri Lankans and our commitment to passion and excellence will help to deliver superior value to customers, our people and the community.
Octave will be the cornerstone of our data driven strategic and operational decisions!
Team Octave will solve JKH’s most intractable problems across industry verticals by building pipelines using Python and Azure data factory to work on one of the country’s richest data lakes, building and implementing complex machine learning algorithms which will impact millions of Sri Lankans.
We are looking for driven and enthusiastic analytics practitioners for our Data and Advanced Analytics Centre of Excellence- Octave.
Role description
The Big Data Engineers will help in developing high performance & high scalability enterprise applications using one or more leading cloud platforms across SaaS and PaaS. They will be working closely with the data architects to jointly develop the data architecture and ensure security and maintenance. Their role also involves diagnosis of existing architecture and data maturity and help the organization in identifying gaps and possible solutions. They will also work with data scientists and business leadership to develop data pipelines for model development and productionalization. Their work will involve high level of interface with business heads and corporate leadership.
Key responsibilities
- Gather requirements, assess gaps and build roadmaps and architectures
- Lead teams of 2-3 associate data engineers in the project building and delivery process
- Explore suitable options, design, and create data pipelines (data lake / data warehouses) for specific analytical solutions
- Define ETL / ELT based on jointly defined requirements
- Identify gaps and implement solutions for data security, quality and automation of processes
- Support maintenance, bug fixing and performance analysis along data pipeline
- Build and manage cloud data services
Desired Skills / Competencies
Education + Technical skills / experience
-
- Bachelor's degree in Computer Science, Engineering, Mathematics or Statistics. Master's degree preferred
- 3+ years of experience in the data engineering field
- Experience in using SQL, PL/SQL or T-SQL with RDBMSs like Teradata, MS SQL Server, or Oracle in production environments.
- Experience with Python
- Limited Experience in using Microsoft Azure or other leading cloud platforms
- Experience in maintaining and configuring data engineering and ETL tools
- Experience with data tools such as Hive, Spark, Hadoop, or Presto
Managerial Skills
-
- Ability to work well in agile environments in diverse teams with multiple stakeholders
- Strong project management and organizational skills
- Ability to effectively communicate complex analytical and technical content
Mindset & Behavior
-
- High energy and passionate individual who inspires teammates to reach their
maximum potential - Excited about trying new solutions outside standard approved
- Willing to adopt an iterative approach; experimental mindset to drive innovation
- High energy and passionate individual who inspires teammates to reach their