ELEKS Logo

ELEKS

Lead Data Engineer (Databricks/Python) in UK #TSCM-40888

Reposted 17 Days Ago
Be an Early Applicant
United Kingdom
Senior level
United Kingdom
Senior level
Lead the design and delivery of robust ETL/ELT pipelines, drive technical leadership in data engineering, and collaborate with cross-functional teams in AWS and Databricks environments.
The summary above was generated by AI
ELEKS Software Engineering and Development Office is looking for a Lead Data Engineer in the United Kingdom.

ABOUT PROJECT
The customer is a British company producing electricity with zero carbon emissions.

REQUIREMENTS

  • 7+ years of experience in Data Engineering, including SQL and ETL (data validation, data mapping, exception handling)
  • 2+ years of hands-on experience with Databricks
  • 2+ years in a technical leadership role
  • Strong knowledge of Python
  • Practical experience with AWS services (e.g. S3, Redshift, Athena, Glue, Lambda)
  • Upper-Intermediate or higher level of English
  • Experience in energy-related domains (e.g. energy trading, utilities, power systems) — a strong advantage
  • Experience with geospatial data will be a plus
  • Ability to work on a dynamic, high-impact project in the energy sector
  • Comfortable collaborating with multinational teams and cross-functional stakeholders
  • Experience working in complex enterprise environments (defined processes, policies, and security protocols)
  • Strong interpersonal and clear, confident communication skills

RESPONSIBILITIES

  • Lead design and delivery of robust ETL/ELT pipelines with a focus on data quality and resilience
  • Drive technical leadership across the data engineering stream: architecture, coding standards, and mentoring
  • Collaborate with analysts, stakeholders, and cross-functional teams to align data solutions with business needs
  • Build and optimize data infrastructure in AWS (S3, Redshift, Glue, Lambda, etc.)
  • Use Databricks + Python to transform and orchestrate data workflows
  • Ensure compliance with enterprise security, governance, and SDLC best practices
  • Communicate proactively and clearly across teams and stakeholders in a fast-moving, international environment

WHAT WILL YOU GET WITH ELEKS

  • Close cooperation with a customer 
  • Challenging tasks 
  • Competence development 
  • Team of professionals 
  • Dynamic environment with a low level of bureaucracy

Top Skills

Athena
Aws (S3
Databricks
Glue
Lambda)
Python
Redshift
SQL

Similar Jobs

7 Minutes Ago
In-Office or Remote
London, England, GBR
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Senior Customer Success Manager will build relationships with enterprise customers, ensuring product adoption and value realization, while managing post-sales activities and developing success plans.
Top Skills: ConfluenceGainsightJIRASalesforceTableau
7 Minutes Ago
In-Office or Remote
London, England, GBR
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Global Partner Manager at Atlassian will lead and develop partnerships, monitor performance metrics, and engage cross-functional teams while driving growth and strategic initiatives.
An Hour Ago
In-Office
London, England, GBR
Mid level
Mid level
Aerospace • Artificial Intelligence • Computer Vision • Software • Analytics • Defense • Big Data Analytics
The Integration Architect will support the integration and deployment of geospatial analytics products into ISR systems, engaging with customers to lead technical efforts and ensure successful adoption.
Top Skills: BashCesiumGdalGnssGrpcInsOpencvPythonPyTorchRestSfmSlamUnity

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account