Client-facing Principal Data Engineer leading design and delivery of enterprise Databricks-based data platforms. Provide architecture leadership, mentor engineering teams, drive platform optimisation, define standards, support technical governance, and deliver across multiple consultancy engagements.
We are looking for an experienced Principal Data Engineer to join us on a contract
basis, supporting complex client engagements across Data & AI transformation
programmes.
This is a highly client-facing consultancy role, suited to someone who is comfortable
operating at both strategic and hands-on technical levels. You will work directly with
senior client stakeholders, delivery teams and architects to design and deliver
scalable modern data platforms.
We are specifically looking for someone with deep expertise in Databricks, either
operating at Architect level or leading high-performing engineering teams within
enterprise environments.
The successful candidate will bring strong consulting capability, commercial
awareness and stakeholder management skills alongside exceptional technical depth.
basis, supporting complex client engagements across Data & AI transformation
programmes.
This is a highly client-facing consultancy role, suited to someone who is comfortable
operating at both strategic and hands-on technical levels. You will work directly with
senior client stakeholders, delivery teams and architects to design and deliver
scalable modern data platforms.
We are specifically looking for someone with deep expertise in Databricks, either
operating at Architect level or leading high-performing engineering teams within
enterprise environments.
The successful candidate will bring strong consulting capability, commercial
awareness and stakeholder management skills alongside exceptional technical depth.
Key Responsibilities
Client Engagement & Stakeholder Management
- Act as a trusted technical advisor across client engagements.
- Build strong relationships with senior stakeholders, delivery leads and
engineering teams. - Translate complex technical concepts into clear business value and delivery
outcomes. - Support clients through technical decision-making, platform strategy and
roadmap planning.
Databricks Leadership & Solution Architecture
- Lead the design and implementation of enterprise-scale Databricks solutions and modern data platforms.
- Provide architectural leadership across cloud-native data engineering
initiatives. - Define engineering standards, best practices and scalable delivery approaches.
- Drive platform optimisation, resilience and performance improvements.
Delivery & Consultancy
- Lead technical delivery across multiple client engagements within a consultancy environment.
- Work closely with cross-functional teams including Data Engineers, Architects, Product Owners and client stakeholders.
- Support project planning, technical governance and delivery execution.
- Ensure high-quality, scalable and maintainable engineering solutions.
Technical Leadership
- Mentor and guide engineering teams across modern data engineering practices.
- Lead technical problem-solving and incident resolution where required.
- Drive adoption of engineering best practices, automation and DevOps
principles.
Skills, Knowledge and Expertise
- Proven experience operating as a Principal Data Engineer, Lead Data Engineer or Data Architect within enterprise environments.
- Strong consultancy and client-facing experience, ideally across multiple customer engagements.
- Deep expertise in Databricks, including architecture, optimisation and leading delivery teams.
- Strong experience designing and delivering cloud-native data platforms within
Azure and/or AWS environments. - Advanced experience with PySpark, SparkSQL and large-scale distributed data processing.
- Strong understanding of modern data architecture, ETL/ELT frameworks and
data modelling. - Excellent SQL skills and experience working with large-scale datasets.
- Strong understanding of data governance, security and platform reliability
principles. - Excellent communication, stakeholder management and consulting skills.
- Ability to operate confidently in fast-paced, delivery-focused environments
Benefits
- Opportunity to work on complex, high-impact client programmes.
- Exposure to enterprise-scale Data & AI transformation initiatives.
- Flexible remote-first working model aligned to client requirements.
- Access to AWS & Databricks partner training and certifications.
- Collaborative culture focused on technical excellence and innovation.
- Opportunity to influence engineering standards, delivery capability and client success across Colibri Digital.
About
We are passionate about helping businesses navigate the rapidly changing and complex world of emerging technologies. We create well-structured, secure, scalable solutions at speed to provide the foundation for groundbreaking change.
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Lead strategic identity security engagements across EMEA, advising executive stakeholders on risk, regulation, governance, access controls, and operational priorities. Shape complex sales opportunities, define identity roadmaps, facilitate executive workshops, align business and technical teams, and translate identity programs into measurable outcomes. The role requires influencing C-level decisions, working through ambiguity, partnering with sales and delivery teams, and representing SailPoint at industry events.
Top Skills:
Cloud SecurityIdentity And Access Management (Iam)Identity Security
Big Data • Cloud • Healthtech • Software • Big Data Analytics
Lead complex engagements in Life Sciences Consulting, managing project teams and relationships, driving strategy and financial outcomes, while fostering a culture of excellence in the team.
Top Skills:
AIBusiness ConsultingDataSaaSVeeva Products
Cloud • Information Technology • Security • Software • Cybersecurity
Lead field-facing AI security strategy for enterprise customers by designing secure LLM/RAG architectures, delivering demos and POVs, advising on data protection and unsanctioned AI usage, and scaling enablement and product feedback across sales, product, and engineering teams.
Top Skills:
AgentsApi IntegrationsCloud-Native Security PlatformsData Loss Prevention (Dlp)Large Language Models (Llms)Llm ApisMcp (Model Context Protocol)Prompt WorkflowsRag (Retrieval-Augmented Generation)Zero Trust
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
