Top Data Engineer Jobs in Edinburgh

Own and operate Databricks-based data platform production support, build and migrate ETL/ELT pipelines to Databricks across Azure/AWS, optimize compute and performance, enforce Delta Lake architecture and data security, implement observability and CI/CD, support multi-tenant onboarding and on-call incident response, and maintain runbooks and SLA metrics.

Design, develop, and unit test complex ETL/ELT and application integrations using Informatica (Real Time/Cloud/PowerCenter). Build SOAP/REST API components, write complex SQL, stored procedures and triggers, and collaborate with BI/IT teams to support the enterprise data integration hub and BI platform.

As a Senior Data Engineer, you will manage complex data projects, lead small teams, and work with clients on data engineering solutions. Responsibilities include ETL development, data pipeline orchestration, and customer relationship management.

Design, build, and maintain scalable ETL/ELT pipelines and modern lakehouse architectures. Optimize data solutions using Databricks, Spark, and AWS. Produce high-quality Python code, data models, and monitoring to ensure data accuracy, reliability, and performance. Collaborate with product teams, troubleshoot complex data issues, and improve infrastructure scalability.

Triage and resolve Master Data Management (Party, Risk, Reference) issues in Stibo STEP, run targeted data-cleansing sprints, monitor data quality dashboards, support releases/UAT, and maintain documentation and playbooks to prevent recurring data issues.

The Data Visualization Developer will create and support dashboards in Power BI, develop SQL scripts, perform regression testing, and troubleshoot existing scripts.

The Senior Site Reliability Engineer will design and maintain a reliable data platform, develop data pipelines, automate processes, and ensure system observability while collaborating across teams.

Lead end-to-end development and productionisation of time-series forecasting ML solutions: design, train, deploy models, build cloud-native data pipelines, collaborate with stakeholders, and monitor model performance to optimise clinic scheduling and staffing.

This role involves designing and optimizing a blockchain data platform, focusing on ETL pipeline development, data quality, and system scalability. The engineer will collaborate with cross-functional teams to enhance data access and enable product engineering efforts.

The Senior Data Engineer will design and maintain scalable data pipelines, ensure data quality, and develop backend services to support WalletConnect's payments infrastructure and analytics.

As a Python and Kubernetes Software Engineer, you will develop data analytics solutions using open source tools, collaborating with a distributed team.

Design and implement core YTsaurus functionality in C++, build and evolve platform-level capabilities, improve APIs and UX for internal users, own production quality including incident response/on-call, and collaborate with stakeholders to prioritize and deliver scalable data platform features.

Build and maintain scalable data pipelines and platform components to serve analytics, ML, and product teams. Design data services/APIs, ensure data quality, observability, security and compliance, and evolve cloud-native infrastructure using IaC and Kubernetes. Partner with cross-functional teams, produce documentation, and ship reliable, tested data solutions.

Build, test, and document secure batch and real-time data pipelines for a government client; design logical and physical databases; extend platform capabilities; ensure data models align with architecture; perform data analysis and root-cause investigations to improve processing and availability for downstream consumers.

Design, build, test and document secure batch and real-time data pipelines, perform logical/physical database design and data modelling, expand platform capabilities, analyse and resolve data processing issues, and ensure alignment with data architecture for downstream consumers.

Design, build, and maintain scalable data pipelines and platform services to support analytics, ML, and product teams. Implement infrastructure-as-code (Terraform) and Kubernetes-based deployments, develop data services/APIs, and ensure data quality, observability, security, and compliance. Partner with cross-functional teams, document systems, and continuously improve performance and reliability.

The Senior Data Engineer will enhance backend systems for a social media app by managing databases, optimizing recommendation algorithms, and ensuring accurate recommendations.

Lead pre-sales technical engagements for a data management/DSPM platform: perform technical discovery, architect solutions, run demos and POCs, enable partners, support RFPs, and liaise with product, marketing, and customer success to drive enterprise sales and adoption.

Lead design and implementation of scalable generative AI services and reusable components using Python. Drive architectural decisions, deploy containerized applications on Kubernetes (EKS), ensure scalability/observability and CI/CD, mentor engineers, and collaborate with product and research teams to productionize LLM capabilities.

Design and deliver scalable Customer Data Platform solutions (Oracle Unity), build and operate data pipelines and Customer 360 models, integrate CDP with data lake/CRM/marketing systems, lead architecture and data modelling workshops, ensure data quality, governance, security, and support CDP operations, and partner with Oracle implementation teams.

Lead data architecture and strategy across OLTP, OLAP, and AI systems. Drive AI-first foundations (LLM orchestration, RAG, real-time inference), ensure DataOps/CI-CD, mentor technical leads, run architectural reviews, partner with product and engineering leadership, and optimise platform security, observability and costs.

The Senior Software Engineer II will design and implement generative AI services, drive architectural standards, mentor engineers, and collaborate across teams to enhance data solutions.

The Senior Data Engineer will oversee data infrastructure, collaborate with product engineers, implement data governance, and drive cultural change regarding data usage within the organization.

As a Senior Data Engineer, you will design and develop large-scale data processing software, manage technical components, and mentor team members, while ensuring code quality and operational readiness.

As a Senior Data Engineer, you'll design and develop data processing solutions, collaborate with architects, mentor team members, and ensure operational readiness in agile teams.