Top Data Engineer Jobs in Edinburgh

Own and expand third-party billing and usage integrations for a cloud cost platform. Build and maintain ingestion pipelines, normalize vendor data, manage orchestration and backfills, and ensure financial-grade correctness through reconciliation, deduplication, and data quality checks. Use AI throughout the engineering workflow, collaborate with product and support teams, and improve integration scalability. The role requires strong SQL and Python, cloud data warehouse experience, REST API integration expertise, and production pipeline ownership.

Build the companys first data stack and data products (internal analytics and customer-facing). Work across data engineering, devops, and software tasks; ship early features, improve developer experience, document proposals, and iterate based on feedback.

Lead customer underwriting proof-of-concept projects using SQL, Python, and AWS to transform, validate, and deliver insurance risk data. Match address data to reference identifiers, investigate data-quality issues, document outputs, support underwriting data platforms, and automate manual workflows. Collaborate with technical and non-technical stakeholders, communicate project updates, and improve scalable data processes, quality, and customer experience.

The Data Engineer will build and maintain data infrastructure, optimize performance pipelines, and ensure efficient data ingestion and querying for analysis within a high-performance AI media platform.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

Build, test, optimize, and maintain ELT pipelines supporting analytics, reporting, and data products. Deploy config-driven workflows to Databricks across a multi-tenant environment, extend data models, support CI/CD and ingestion projects, monitor pipeline health, troubleshoot failures, and collaborate with data and product teams to deliver reliable, well-tested data.

The Software Engineer will develop data pipelines, manage cloud infrastructure, and collaborate with AI scientists to enhance data acquisition for model training.

Design, build, and maintain scalable batch and streaming data pipelines. Write and review code (Python, SQL, Spark), implement data quality checks, monitor pipelines, and collaborate with analysts, data scientists, and product managers to deliver reliable, documented data solutions.

Develop and maintain enterprise Power BI and Tableau reporting solutions, data pipelines, models, dashboards, and analytics using Snowflake, SQL, dbt, and Alteryx. Analyze institutional and external data to support strategic planning, forecasting, recruitment targets, and executive decision-making. Ensure data quality, reporting governance, release standards, and stakeholder satisfaction. Provide technical guidance, training, and support across the University, contribute to emerging AI-enabled analytics, and potentially line-manage junior developers.

Lead the technical direction and architecture for Arbor’s data platform, spanning transactional, analytical, and AI systems. Define target architectures, guide technical leads, support product delivery, and enable AI-first engineering through LLM orchestration, RAG, and real-time inference infrastructure. The role includes mentoring, architectural reviews, data governance, security, compliance, observability, DataOps, cloud platform cost optimization, and cross-functional collaboration with product and commercial leaders.

Own the end-to-end design, reliability, resilience, and recovery of production data ingestion systems and pipelines. Build batch and streaming ETL/ELT workflows, establish data quality checks and SLAs, improve monitoring and alerting, resolve platform issues, reduce technical debt, and optimize performance and cost. Collaborate with stakeholders, AI teams, and international expansion initiatives while supporting time-series, textual, and event-stream data workloads.

Leads the design and scaling of Databricks-based data, analytics, and AI platforms supporting global customer operations. Builds enterprise data pipelines, machine learning, NLP, generative AI, conversational AI, dashboards, and operational intelligence solutions. Establishes governance, data quality, CI/CD, reliability, and AI lifecycle standards while partnering with product, operations, engineering, workforce management, and AI teams. Provides technical leadership, coaching, and mentorship to engineers and data scientists.

Designs, builds, and maintains scalable data pipelines supporting data science and advanced analytics. Manages reliable Airflow orchestration, delivers data engineering solutions using Databricks, and contributes to GitHub-based collaborative development, code reviews, and engineering standards. Partners with data scientists, supports controlled feature-led delivery, investigates root causes, and develops practical solutions. The role also values adaptability, continuous learning, and exposure to MLOps concepts and tooling.

Designs, builds, and maintains scalable data pipelines supporting data science and advanced analytics. Manages Airflow orchestration and delivers data engineering solutions using Databricks. Collaborates through GitHub, code reviews, and shared engineering standards in feature-led environments. Partners with data scientists, owns delivery outcomes, performs root-cause analysis, and continuously improves pipeline reliability, observability, and maintainability. Exposure to MLOps concepts and tooling is desirable.

Own the design, delivery, and operation of complex data pipelines, datasets, and platform components. Translate business needs into scalable data models and reliable data products, improve data quality and observability, resolve production issues, and establish reusable engineering tools and standards. Collaborate with product and business stakeholders, contribute to architecture decisions, mentor engineers, and participate in on-call support.

Operate and architect large-scale distributed data infrastructure across Kafka, Hadoop HDFS, Ceph, SQL Server, bare-metal systems, and hybrid cloud environments. Responsibilities include capacity planning, reliability engineering, automation, observability, incident response, backup and recovery, platform tooling, and architecture decisions. The role requires expertise with petabyte-scale systems or billions of daily events, mentoring engineers, and shaping infrastructure standards across engineering organizations.

Serve as the technical authority for enterprise customers in data security, owning the technical sales process. Deliver technical presentations, demos, and whiteboard sessions, advise on AI/ML-driven data protection, and drive outcomes through value-based selling with partners and GTM teams.

As a Data Engineer, you will design, build, and maintain data pipelines and infrastructure to support data-driven decision-making in a collaborative environment.

The Data Engineer will design and support data warehouses, create analytics dashboards, perform data quality analysis, and identify process improvements. Responsibilities include collaborating with stakeholders to develop insights and ensure data governance.

The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.

Support ledger migration and data lake cleanup by extracting, transforming, reconciling and validating large datasets. Develop and validate SQL queries, batch jobs and processing logic, perform regression testing, document mappings and validation rules, and collaborate with engineering, product and business teams to ensure production readiness and post-migration validation.

Design, build, and maintain scalable batch and streaming data pipelines, internal tools, and APIs to support analytics, product features, and ML. Collaborate with product and engineering to improve data infrastructure, ensure reliability, testing, and observability in a cloud-native environment.

The Data Engineer will build and scale data pipelines, ensure data quality, implement dbt best practices, and empower cross-functional teams with self-service data access.

Build large-scale data pipelines and infrastructure for frontier AI model training. Develop data-processing models such as classifiers, quality filters, and labeling systems; design deduplication, quality scoring, labeling, and augmentation strategies; and create reliable tooling for researchers to explore and train on massive datasets. The role also evaluates how data quality and composition affect model outcomes, with web crawler experience as a bonus.

Migrate SQL Server data products and analytical workloads to a modern cloud platform. Redesign legacy SQL, ETL processes, and business logic; build scalable pipelines and analytical models; validate data quality; collaborate with stakeholders; and improve platform reliability, performance, cost efficiency, and AI-assisted data engineering automation.