Intetics Logo

Intetics

1104 | Senior Data Engineer (Databricks)

Posted 21 Days Ago
Remote
Hiring Remotely in United Kingdom
Senior level
Remote
Hiring Remotely in United Kingdom
Senior level
Own and operate Databricks production data pipelines for a predictive CRM platform: monitoring, incident response, cost and performance optimization, migrating legacy ETL, onboarding customers, enforcing Delta Lake architecture and multi-tenant isolation, and applying CI/CD, security, and observability best practices to ensure reliable, scalable data delivery.
The summary above was generated by AI

Intetics Inc., a global technology company providing custom software application development, distributed professional teams, software product quality assessment, and “all-things-digital” solutions, is seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team on a full-time basis.

About the Project

We are redefining CRM for the age of AI.

We’re delivering on the original promise of CRM - turning fragmented customer and revenue signals into clear, prioritized action. Instead of more dashboards or surface-level insights, we help teams focus on what matters most and know exactly what to do next.

More than two decades after our founding, we’re entering a new chapter with clarity and momentum - building intelligent, intuitive solutions that work within the flow of how teams actually sell and serve. We’re focused on solving complex, real-world challenges where relationships, context, and precision make all the difference.

Our global team is united by a shared commitment to impact, ownership, and continuous growth. We create an environment where thoughtful ideas move quickly, where people are trusted to lead, and where flexibility supports how great work gets done.

If you’re excited to help shape what’s next in AI-driven CRM - and build technology that drives real outcomes - we’d love to meet you.

Where You Fit In

The predictive data platform powers revenue intelligence for mid-market enterprises by fusing ERP and CRM data into actionable insights.

As a Senior Data Engineer, you will own the Databricks pipelines that make this possible, driving production reliability, cost efficiency, and platform growth through customer onboarding and legacy modernization.

You will work closely with ML engineers, product teams, and the Enterprise Architecture team to ensure the data backbone behind the predictive platform is always fast, clean, and ready to deliver at a global scale.

Impact You Will Make in the Role
  • Own Databricks production support for the predictive data platform, including monitoring, alerting, and incident response across all production data flows.
  • Maintain and report on SLA performance metrics for data pipeline delivery, ensuring visibility into platform health and accountability across internal and external stakeholders.
  • Identify and implement pipeline optimizations that reduce Databricks compute costs, improve throughput, and reduce processing windows while tracking impacts through measurable KPIs.
  • Migrate legacy ETL/ELT pipelines to Databricks, building automation tooling to reduce manual intervention and ensure uninterrupted data delivery during transitions.
  • Support new customers onboarding by provisioning, validating, and hardening tenant data pipelines that deliver reliable, isolated data from day one.
  • Design and build high-performance Databricks pipelines that ingest, transform, and serve ERP and CRM data at scale across both Azure and AWS environments.
  • Own the Delta Lake architecture including schema design, partitioning strategies, data quality enforcement, and incremental processing patterns.
  • Enforce data security best practices across Databricks environments, including role-based access control, secrets management, and compliance requirements for enterprise CRM and ERP data.
  • Implement data quality monitoring and observability across pipeline health and ML model inputs, ensuring data integrity that directly supports model prediction accuracy.
  • Apply and enforce multi-tenant data isolation patterns ensuring reliable, secure data delivery across enterprise customers.
  • Partner with the Enterprise Architecture team to ensure data pipelines integrate seamlessly with the broader product ecosystem.
  • Support a globally distributed operation through on-call rotation and after-hours incident response, meeting SLAs across multiple time zones.
  • Maintain technical documentation, runbooks, and architectural decision records, contributing to team knowledge sharing and operational readiness across on-call and incident response scenarios.
  • Apply CI/CD best practices to data pipeline development, including version control, automated testing, and deployment tooling to ensure reliable and repeatable pipeline delivery.

Requirements
  • 4+ years of data engineering experience.
  • At least 2 years on Databricks or the Apache Spark ecosystem across Azure and/or AWS.
  • Proficiency in PySpark, SQL, and Python with a strong track record building and operating production-grade pipelines under SLA constraints.
  • Hands-on experience with Delta Lake including schema evolution, ACID transactions, optimize/vacuum lifecycle, and both incremental and streaming processing patterns.
  • Hands-on experience with pipeline performance tuning and compute optimization in production Databricks environments.
  • Solid working knowledge of PostgreSQL including query optimization, schema design, and use as a source or sink in production data pipelines.
  • Experience supporting and maintaining legacy ETL tooling (SSIS, Informatica, custom Python/SQL pipelines, or similar) in production.
  • Experience supporting large-scale multi-tenant architectures with a focus on tenant isolation, per-tenant performance, and data privacy, including navigating tools and platforms that default to single-tenant assumptions.
  • Proven ability to work collaboratively across Data Science, Product, and Infrastructure teams, owning end-to-end delivery in a cross-functional environment.
  • Strong understanding of data governance, security, and compliance principles, including access control, data privacy, and protection of sensitive enterprise data across multi-tenant environments.
Preferred Qualifications / Experience
  • Experience operating Databricks workspaces across both Azure and AWS, including cost governance, cluster management, and cross-cloud data access.
  • Experience optimizing Databricks workloads in a Serverless environment, including compute cost governance and performance tuning for serverless compute.
  • Experience with Microsoft SQL Server in a data engineering or ETL context.
  • Exposure to ML feature engineering or feature stores (Databricks Feature Store, Feast, or similar) supporting predictive analytics.
  • Experience with customer onboarding automation or IaC patterns for provisioning tenant data pipelines at scale.
  • Databricks Certified Data Engineer Associate or Professional certification.

Similar Jobs

47 Minutes Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads Pfizer’s enterprise applied AI strategy, architecture, governance, operating model, and transformation efforts. Drives portfolio-level technical decisions, reusable capabilities, standards, and measurable business outcomes. Provides hands-on architecture and code review using modern AI and agent frameworks while leading engineers, contractors, and vendors. Oversees quality, security, performance, spending, and technical direction, mentors technical leaders, and evaluates emerging technologies and industry trends.
Top Skills: Agentic SystemsAi GovernanceAi GuardrailsArtificial IntelligenceData ArchitectureGenerative AiLarge Language ModelsMachine LearningModern Ai And Agent FrameworksMonitoringNeural NetworksObservabilityRetrieval ArchitectureTracing
4 Hours Ago
Remote or Hybrid
United Kingdom
Senior level
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Lead strategic identity security engagements across EMEA, advising executive stakeholders on risk, regulation, governance, access controls, and operational priorities. Shape complex sales opportunities, define identity roadmaps, facilitate executive workshops, align business and technical teams, and translate identity programs into measurable outcomes. The role requires influencing C-level decisions, working through ambiguity, partnering with sales and delivery teams, and representing SailPoint at industry events.
Top Skills: Cloud SecurityIdentity And Access Management (Iam)Identity Security
8 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Enterprise Web • Hardware • Internet of Things • Software
Embed with manufacturing customers to design, build, and deploy Tulip solutions. Lead OT/IT integrations (PLCs, MES/ERP, quality systems), troubleshoot production issues, and deliver scalable, production-ready applications. Advise on architecture, document solutions, and represent customer needs to Product and Engineering.
Top Skills: Cloud-NativeEmbedded AiErpMachine Data IntegrationsMesNo-Code PlatformPlcsQuality SystemsTulip Frontline Operations Platform

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account