Top Data Engineer Jobs in Edinburgh

Design, build, and maintain scalable batch and streaming data pipelines. Write and review code (Python, SQL, Spark), implement data quality checks, monitor pipelines, and collaborate with analysts, data scientists, and product managers to deliver reliable, documented data solutions.

Build production AI-powered tools, data pipelines, and internal full-stack applications that automate incident investigation, surface anomalies, and enable AI agents to interact safely with platform systems. Work across Python, TypeScript, Go and SQL, deploy on Docker/Kubernetes/AWS, and collaborate with TechOps, Connectivity, and Data teams to own, monitor, and improve shipped systems.

Serve as the technical authority for enterprise customers in data security, owning the technical sales process. Deliver technical presentations, demos, and whiteboard sessions, advise on AI/ML-driven data protection, and drive outcomes through value-based selling with partners and GTM teams.

Build the companys first data stack and data products (internal analytics and customer-facing). Work across data engineering, devops, and software tasks; ship early features, improve developer experience, document proposals, and iterate based on feedback.

As a Data Engineer, you will design, build, and maintain data pipelines and infrastructure to support data-driven decision-making in a collaborative environment.

The Data Engineer will design and support data warehouses, create analytics dashboards, perform data quality analysis, and identify process improvements. Responsibilities include collaborating with stakeholders to develop insights and ensure data governance.

The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.

Support ledger migration and data lake cleanup by extracting, transforming, reconciling and validating large datasets. Develop and validate SQL queries, batch jobs and processing logic, perform regression testing, document mappings and validation rules, and collaborate with engineering, product and business teams to ensure production readiness and post-migration validation.

Client-facing Principal Data Engineer leading design and delivery of enterprise Databricks-based data platforms. Provide architecture leadership, mentor engineering teams, drive platform optimisation, define standards, support technical governance, and deliver across multiple consultancy engagements.

Design, build, and maintain high-volume distributed data processing jobs and pipelines (Redshift, Athena, Iceberg, Spark, Airflow). Collaborate with data scientists and analysts to productionize models, optimize performance, troubleshoot systems, and mentor junior engineers. Support lakehouse/data warehouse management and ensure data accuracy and efficiency.

Design, build, and maintain scalable batch and streaming data pipelines, internal tools, and APIs to support analytics, product features, and ML. Collaborate with product and engineering to improve data infrastructure, ensure reliability, testing, and observability in a cloud-native environment.

The Data Engineer will build and scale data pipelines, ensure data quality, implement dbt best practices, and empower cross-functional teams with self-service data access.

Lead client-facing data platform architecture and strategy. Design scalable Databricks/Azure or AWS-based solutions, oversee multi-team delivery, incident response, governance, and data security. Mentor engineers, drive roadmap and budget decisions, and ensure resilient, high-quality data pipelines aligned to business goals.

Entry-level data engineer to follow a structured 12-month development programme. Build internal reporting, reusable engineering frameworks, documentation, and tooling while learning SQL, Python, Databricks and cloud data services. Support senior engineers, join code reviews, shadow customer workshops, and progressively contribute to client projects.

Design, build and maintain cloud-native ETL/ELT pipelines and data lake solutions using dbt, Snowflake/Databricks and AWS services. Optimize SQL and data models for performance and cost, create dashboards, follow CI/CD and software engineering best practices, and collaborate with architects, engineers and clients to deliver production-ready enterprise data solutions.

Build, optimise and stabilise AWS-based data pipelines (S3, Glue, Redshift, Lake Formation). Resolve technical debt, support the Architect on target-state design, collaborate with client engineering teams to transfer knowledge, and deliver production-ready platforms in regulated, high-volume gaming environments.

Design, build, and maintain scalable production data pipelines using Microsoft Fabric, Python, and PySpark. Own reliability, performance, and CI/CD for data workflows, troubleshoot live pipelines, mentor engineers, and collaborate with stakeholders to translate requirements into robust technical solutions.

Lead regional data visualization and IT solutions: design dashboards, integrate and normalize data sources, translate business needs into functional specs, manage projects and vendors, and drive adoption of contemporary visualization tools and best practices.

Build and maintain scalable data pipelines and platform components to serve analytics, ML, and product teams. Design data services/APIs, ensure data quality, observability, security and compliance, and evolve cloud-native infrastructure using IaC and Kubernetes. Partner with cross-functional teams, produce documentation, and ship reliable, tested data solutions.

Design, build, and maintain scalable data pipelines and platform services to support analytics, ML, and product teams. Implement infrastructure-as-code (Terraform) and Kubernetes-based deployments, develop data services/APIs, and ensure data quality, observability, security, and compliance. Partner with cross-functional teams, document systems, and continuously improve performance and reliability.

Design, build, test and document secure batch and real-time data pipelines, perform logical/physical database design and data modelling, expand platform capabilities, analyse and resolve data processing issues, and ensure alignment with data architecture for downstream consumers.

Build, test, and document secure batch and real-time data pipelines for a government client; design logical and physical databases; extend platform capabilities; ensure data models align with architecture; perform data analysis and root-cause investigations to improve processing and availability for downstream consumers.

Develop stored procedures or notebooks to build 230 additional data items into DCoE tables/views. Create an extensible, config-driven process to add fields with minimal re-engineering. Produce self-documenting, well-commented code and collaborate with the DCoE team on delivery; DCoE handles business analysis, design sign-offs, data modeling, and testing.

As a Data Engineer, you will develop and manage data pipelines, ensuring reliable data ingestion and delivery while optimizing for simplicity and performance.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.