ELEKS Logo

ELEKS

Lead Data Engineer (Databricks/Python) in UK #TSCM-40888

Posted 3 Days Ago
Be an Early Applicant
United Kingdom
Senior level
United Kingdom
Senior level
Lead the design and delivery of ETL/ELT pipelines, focusing on data quality, and drive technical leadership in data engineering. Collaborate with teams to align data solutions with business needs and oversee the optimization of AWS data infrastructure.
The summary above was generated by AI
ELEKS Software Engineering and Development Office is looking for a Lead Data Engineer in the United Kingdom.

ABOUT PROJECT
The customer is a British company producing electricity with zero carbon emissions.

REQUIREMENTS

  • 7+ years of experience in Data Engineering, including SQL and ETL (data validation, data mapping, exception handling)
  • 2+ years of hands-on experience with Databricks
  • 2+ years in a technical leadership role
  • Strong knowledge of Python
  • Practical experience with AWS services (e.g. S3, Redshift, Athena, Glue, Lambda)
  • Upper-Intermediate or higher level of English
  • Experience in energy-related domains (e.g. energy trading, utilities, power systems) — a strong advantage
  • Experience with geospatial data will be a plus
  • Ability to work on a dynamic, high-impact project in the energy sector
  • Comfortable collaborating with multinational teams and cross-functional stakeholders
  • Experience working in complex enterprise environments (defined processes, policies, and security protocols)
  • Strong interpersonal and clear, confident communication skills

RESPONSIBILITIES

  • Lead design and delivery of robust ETL/ELT pipelines with a focus on data quality and resilience
  • Drive technical leadership across the data engineering stream: architecture, coding standards, and mentoring
  • Collaborate with analysts, stakeholders, and cross-functional teams to align data solutions with business needs
  • Build and optimize data infrastructure in AWS (S3, Redshift, Glue, Lambda, etc.)
  • Use Databricks + Python to transform and orchestrate data workflows
  • Ensure compliance with enterprise security, governance, and SDLC best practices
  • Communicate proactively and clearly across teams and stakeholders in a fast-moving, international environment

WHAT WILL YOU GET WITH ELEKS

  • Close cooperation with a customer 
  • Challenging tasks 
  • Competence development 
  • Team of professionals 
  • Dynamic environment with a low level of bureaucracy

Top Skills

Athena
AWS
Databricks
ETL
Glue
Lambda
Python
Redshift
S3
SQL

Similar Jobs

5 Days Ago
In-Office
3 Locations
Mid level
Mid level
Insurance
As a Data Engineer, you will develop Python applications using Databricks and PySpark, collaborate with teams for data solutions, and maintain automated CI/CD pipelines.
Top Skills: Ci/CdDatabricksPysparkPythonRestful Apis
An Hour Ago
Hybrid
London, England, GBR
Mid level
Mid level
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
Manage strategic sourcing and procurement activities for EMEAI, collaborating with stakeholders, negotiating contracts, and ensuring alignment with Tapestry's objectives.
Top Skills: E-Procurement SystemsSpend Reporting Systems
An Hour Ago
Hybrid
London, England, GBR
Junior
Junior
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
The Junior Real Estate Counsel drafts and negotiates lease-related documents, oversees lease accounting, manages landlord relations, and supports new store approvals while collaborating with internal and external teams.
Top Skills: Lease AgreementsReal Estate Law

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account