Photon Logo

Photon

Data Engineer | London, UK

Reposted One Month Ago
Remote
Hiring Remotely in United Kingdom
Mid level
Remote
Hiring Remotely in United Kingdom
Mid level
Support ledger migration and data lake cleanup by extracting, transforming, reconciling and validating large datasets. Develop and validate SQL queries, batch jobs and processing logic, perform regression testing, document mappings and validation rules, and collaborate with engineering, product and business teams to ensure production readiness and post-migration validation.
The summary above was generated by AI

Role Summary 

We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment. 

Key Responsibilities 

  • Support ledger migration activities, including data extraction, transformation, reconciliation and validation. 

  • Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds. 

  • Develop, enhance and validate SQL queries, batch jobs and data processing logic. 

  • Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration. 

  • Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues. 

  • Document data mapping, validation rules, test results and migration exceptions clearly. 

  • Support production readiness, defect triage and post-migration validation activities. 

Required Skills and Experience 

  • Strong hands-on experience with SQL and data analysis across large datasets. 

  • Experience with batch processing, batch regression testing and data reconciliation. 

  • Working knowledge of Spark or similar distributed data processing technologies. 

  • Experience working with data lakes, reporting platforms, feeds and data migration programmes. 

  • Ability to identify data inconsistencies, investigate root causes and support remediation. 

  • Strong understanding of data quality, controls, validation and auditability in enterprise environments. 

  • Good communication skills with the ability to work across engineering, business and product stakeholders. 

Preferred Experience 

  • Prior experience in financial services, banking, ledger systems or regulatory data environments. 

  • Experience supporting enterprise-scale migration, modernisation or platform transformation programmes. 

  • Exposure to reporting, dashboards, data views and operational data feeds. 

  • Ability to work in distributed teams across London, Bangalore and Singapore. 

Similar Jobs

28 Days Ago
In-Office or Remote
United Kingdom
Mid level
Mid level
Blockchain • Hardware • Software • Energy • Cryptocurrency • Big Data Analytics
The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.
Top Skills: AirflowClickhouseDockerKafkaKubernetesPl/PgsqlPostgresPythonRedpandaTrino
42 Minutes Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Install, configure, integrate, test, and deploy the Ericsson Fintech Platform in customer environments. Ensure interoperability with internal/external systems, execute unit and white/black-box tests, produce MOPs and test reports, collaborate with architects and PMs, and support production activities across time zones.
Top Skills: DockerEricsson Fintech Platform (Efp)KubernetesLinuxMicroservicesMiddlewareMobile App IntegrationsMonitoring And ObservabilityMySQLPayment GatewayPublic CloudRestShell Scripting (Bash)SmsSoapTcp/IpTransaction Processing SystemsUnixUssdXml Apis
2 Hours Ago
Remote or Hybrid
Bournville, Birmingham, England, GBR
Senior level
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead the R&D strategy and product development portfolio for Cote d'Or chocolate across the MEU region. Drive innovation, quality improvement, brand maintenance, productivity, consumer-centric design, and cross-functional execution from concept through commercialization. Collaborate with commercial, supply chain, manufacturing, procurement, marketing, regulatory, and global R&D teams while influencing senior stakeholders across a matrix organization. Mentor talent, strengthen brand equity, and develop scalable processes for delivering products from bench to shelf.
Top Skills: Chocolate Product DevelopmentFood TechnologyPackaging DevelopmentProduct Development

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account