NewDay Logo

NewDay

Lead Data Engineer

Posted 11 Days Ago
Be an Early Applicant
In-Office
London, Greater London, England
Senior level
In-Office
London, Greater London, England
Senior level
Lead and mentor a team of data engineers, define technical vision, collaborate with stakeholders, develop data pipelines, and ensure data quality.
The summary above was generated by AI

What you will deliver

  • Lead and Mentor: Lead, manage, and mentor a team of 3-6 data engineers, fostering a collaborative and high-performing environment.

  • Technical Vision & Ownership: Own and define the technical vision, providing architectural guidance and best practices for data modelling, ETL/ELT processes, data warehousing, and data lake solutions.

  • Collaboration & Stakeholder Management: Work closely with Product Owners, Business Analysts, and other stakeholders to understand requirements, translate them into technical specifications, and ensure successful delivery of data solutions.

  • Hands-on Development: Be a hands-on contributor to the design, development, and maintenance of scalable data pipelines and platforms, leveraging a modern data stack.

  • Data Quality & Testing: Implement and champion robust testing strategies for data pipelines, including unit testing, integration testing, and data quality checks, to ensure accuracy, reliability, and completeness of data.

Your Skills and Experience

Essential

  • Extensive Data Engineering Experience: Proven experience as a Senior or Lead Data Engineer, with a strong track record of designing, building, and maintaining complex data pipelines and platforms.

  • Technical Expertise:

    • Languages: Strong proficiency in Python and SQL.

    • Cloud Platform: Hands-on experience with AWS services (EMR, Athena, Lambda, S3, Glue, Step Functions).

    • Data Warehousing: In-depth experience with Snowflake.

    • Big Data Processing: Experience with Spark and familiarity with Scala (even if limited).

    • Orchestration: Solid experience with Airflow for workflow orchestration.

    • Data Transformation: Hands-on experience with DBT (Data Build Tool).

    • Version Control: Proficient with Git and GitHub, including experience with GitHub Actions for CI/CD.

  • Leadership & Management:

    • Demonstrated experience in leading, mentoring, and managing a team of data engineers.

    • Ability to motivate and inspire a team, fostering a culture of continuous learning and excellence.

    • Strong communication and interpersonal skills, with the ability to effectively collaborate with technical and non-technical stakeholders.

Desirable

  • Real-time data processing

  • Data governance and data quality frameworks

  • Data operations and observability

#LI-Hybrid

#LI-TM1

We work with Textio to make our job design and hiring inclusive.

Permanent

Top Skills

Airflow
AWS
Dbt
Git
Git
Python
Scala
Snowflake
Spark
SQL

Similar Jobs

3 Days Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Insurance
Lead and develop complex data engineering initiatives focusing on metadata ingestion and orchestration, utilizing Azure and Databricks. Mentor junior engineers and enforce best practices while collaborating with stakeholders to optimize data solutions.
Top Skills: AirflowAzure Data FactoryAzure Data Lake StorageAzure FunctionsAzure SynapseBicepDatabricksDbtTerraform
3 Days Ago
In-Office
Salford, Manchester, Lancashire, England, GBR
Senior level
Senior level
Information Technology • Software
As a Lead Data Engineer, you will manage data pipelines, guide a team, design data models, and collaborate with stakeholders to deliver insights.
Top Skills: AgileCloudData LakeData Pipeline ArchitecturesDevOpsSql Databases
8 Days Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Software • Financial Services
The Lead Data Engineer will manage a data engineering team, oversee data pipeline operations and drive the migration to a new data stack while ensuring data quality and governance.
Top Skills: AWSDbtPythonSnowflakeSQL

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account