Lead client-facing data platform architecture and strategy. Design scalable Databricks/Azure or AWS-based solutions, oversee multi-team delivery, incident response, governance, and data security. Mentor engineers, drive roadmap and budget decisions, and ensure resilient, high-quality data pipelines aligned to business goals.
As a Principal Data Engineer, you will serve as the bridge between complex technical architecture and strategic business value. This is a high-impact, client-facing leadership role designed for an expert who can navigate deep technical challenges while maintaining a "customer-first" mindset. You will be the primary technical authority for our clients, ensuring their data platforms are resilient, scalable, and aligned with their long-term business goals.
Key Responsibilities
- Customer Excellence & Stakeholder Management: Act as the primary strategic partner to client business owners, aligning technical data solutions with corporate goals while championing reliability and "clean data" for all consumers.
- Solution Architecture & Tech Strategy: Drive the development of complex, large-scale data architectures and multi-year technology roadmaps, balancing technical innovation with cost efficiency and operational stability.
- Delivery & Execution: Oversee "team-of-teams" delivery performance, ensuring the quality and resilience of high-impact data pipelines while managing capacity planning and team velocity.
- Incident Management & Resilience: Lead the triage and resolution of critical platform incidents, taking full ownership of root-cause prevention and maintaining transparent communication with clients during recovery.
- Governance, Risk & Compliance: Implement robust governance frameworks and compliance controls, acting as the authoritative lead on risk mitigation and the primary technical contact for regulatory matters.
- Knowledge Management & Mentorship: Champion an organisational culture of knowledge sharing, representing the firm at industry events and establishing best practices across communities of practice.
- Business Strategy: Influence long-term organizational health by driving platform efficiency, managing engineering budgets, and leading strategic hiring and retention initiatives.
Skills, Knowledge and Expertise
Essential:
- Proven experience in a principal engineering role.
- Extensive experience with cloud data platforms such as Azure or AWS, with a focus on Databricks.
- Highly skilled with Pythonic data processing tools such as Pyspark and SparkSQL.
- Strong understanding of data modelling concepts relational and non-relational databases.
- Proficiency in SQL and experience with data integration and ETL tools.
- Excellent knowledge of big data technologies and frameworks.
- Strong knowledge of data governance and data security best practices.
- Strong analytical mindset with attention to detail and a consultative approach.
- Excellent communication and stakeholder management skills.
Benefits
- Remote-first working with flexibility around client needs.
- Private health insurance.
- Projects with global brands & public sector leaders, working on real-world impact.
- Exclusive access to AWS & Databricks certifications, training, and partner tools.
- A collaborative culture of technical excellence and continuous learning.
- A lead role in shaping delivery standards and future Data & Consulting practices within the firm.
- Competitive salary, bonus structure, and long-term growth opportunities.
About
We are passionate about helping businesses navigate the rapidly changing and complex world of emerging technologies. We create well-structured, secure, scalable solutions at speed to provide the foundation for groundbreaking change.
Similar Jobs
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Customer-embedded Principal Data Scientist who leads account-aligned delivery: translate business needs into technical approaches, build and ship production-grade solutions, influence senior stakeholders, prepare transitions to FDE crews, and operate with speed and entrepreneurial ownership to drive sustained business outcomes.
Cloud • Information Technology
Client-facing Principal Data Engineer leading design and delivery of enterprise Databricks-based data platforms. Provide architecture leadership, mentor engineering teams, drive platform optimisation, define standards, support technical governance, and deliver across multiple consultancy engagements.
Top Skills:
AWSAzureDatabricksPysparkSparksqlSQL
Edtech
Lead data architecture and strategy across OLTP, OLAP, and AI systems. Drive AI-first foundations (LLM orchestration, RAG, real-time inference), ensure DataOps/CI-CD, mentor technical leads, run architectural reviews, partner with product and engineering leadership, and optimise platform security, observability and costs.
Top Skills:
AWSCi/CdDataopsDebeziumEncryption (At Rest/In Transit)Federated LearningGitInfrastructure As CodeLlm OpsLlm OrchestrationMlopsOlapOltpPrivacy-Enhancing TechnologiesPrompt EngineeringRagReal-Time Model InferenceSnowflakeUnstructured Data
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
