Senior Consultant- Databricks
John Keells Information Technology (Pvt) Ltd (JKIT), a fully owned subsidiary of John Keells Holdings PLC, Sri Lanka's largest conglomerate listed on the Colombo Stock Exchange, is a global IT professional services leader, transforming enterprises with cutting-edge digital solutions.
JKIT is a 100% cloud-native solutions provider, offering end-to-end digital transformation solutions in collaboration with global Principals like Microsoft, SAP, and Salesforce. Driven by a Cloud-first, Mobile-first and AI-first strategy, JKIT empowers businesses with innovation, agility, growth, and state-of-the-art security.
We invite applications from suitably qualified individuals for the post of Senior Consultant- Databricks. The selected candidate will report to the Practice Manager.
.
The Senior Consultant- Databricks will be responsible for:
- Designing, developing, deploying, and supporting scalable batch and streaming data pipelines using Azure Databricks, Spark, PySpark, Python, and SQL.
- Implementing Lakehouse solutions using Delta Lake, Unity Catalog, Databricks SQL, Workflows, Jobs, and Clusters.
- Developing ETL/ELT frameworks and supporting data platform modernization and migration from legacy platforms.
- Applying best practices in data modelling, warehousing, Medallion Architecture, governance, security, data quality, metadata, lineage, orchestration, and production support.
- Optimizing Spark workloads, SQL, clusters, and storage for performance and cost efficiency.
- Implementing secure access controls and compliance using Unity Catalog and Azure security services.
- Developing and maintaining CI/CD pipelines using Git, Azure DevOps, or similar tools.
- Collaborating with architects, analysts, cloud and AI/ML teams, and customers on solution design, workshops, code reviews, troubleshooting, documentation, and mentoring.
.
The ideal candidate should possess:
- A Bachelor’s degree in Computer Science, Data Science, or a related discipline.
- 5+ years of experience in Data Engineering, Analytics, BI, or software engineering, including 2+ years of enterprise Databricks experience.
- Strong expertise in Spark, PySpark, Python, SQL, Delta Lake, Databricks SQL, Notebooks, Workflows, and Repos.
- Experience with Azure Databricks, Data Factory, Data Lake Storage, Synapse, Microsoft Fabric, and Power BI.
- Experience with CI/CD, Git, automated testing, and release management.
- Databricks Professional certification is mandatory; Delivery Expert or Project Expert certification is an added advantage. Azure/Fabric certifications are desirable.
- Strong analytical, communication, documentation, customer engagement, and teamwork skills, with the ability to work independently and mentor junior engineers in Agile environments.
- Exposure to Asset Bundles, IaC, MLflow, MLOps, GenAI, Purview, data observability, event streaming, presales, estimations, POCs, and customer demonstrations.
- Ability to deliver secure, scalable, production-ready solutions while meeting quality, performance, and cost targets and contributing to reusable assets and engineering standards.
If you’re up for the challenge, please send your resume to careers@johnkeellsit.com or Click on the advert to apply. Please state the position you’re interested in the subject line of your email.