CloudQuery Logo

CloudQuery

Senior Software Engineer (Data Pipelines)

Sorry, this job was removed at 05:18 p.m. (GMT) on Wednesday, Jan 15, 2025
Be an Early Applicant
United Kingdom
United Kingdom

Similar Jobs

2 Hours Ago
Hybrid
3 Locations
Mid level
Mid level
Cloud • Information Technology • Security • Software • Cybersecurity
The Security Engineer will secure Cloudflare's global network, deploy security tools, ensure compliance with standards, and protect infrastructure from attacks.
Top Skills: AnsibleAzure)BashGoLinuxmacOSPublic Cloud Security (GcpPythonTerraformWindows
2 Hours Ago
Hybrid
3 Locations
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Responsible for enhancing developer experience on Durable Objects by building tools and APIs, mentoring engineers, and resolving technical issues.
Top Skills: AWSAzureC++Cloudflare WorkersGCPJavaScriptRustTypescript
2 Hours Ago
In-Office
London, Greater London, England, GBR
Mid level
Mid level
Information Technology • Software • Financial Services
Design, implement, and maintain market data feed handlers, optimize system performance, and collaborate with traders and engineers to ensure data integrity.
Top Skills: C++Distributed SystemsLinuxMultithreading

Description

CloudQuery is a growing Series A startup in the data space and the creator of the open-source, high-performance ELT framework powered by Apache Arrow. CloudQuery enables data movement for SREs, platform teams and security teams in Fortune 500 companies. We're looking for a skilled Backend/Data Engineer to join our core team. This role involves building, optimizing and deploying custom data pipelines, working on our flagship project, and helping make our self-hosted cloud asset inventory an industry standard.

Responsibilities:

  • Collaborate with the engineering team, CEO, and Product team on developing both existing and new features.
  • Design, implement, and maintain efficient data pipelines to ensure data integrity and reliability.
  • Lead features end-to-end from RFC → Implementation → Testing → Documentation → Release.
  • Enhance CloudQuery’s Core SDK and contribute new features to establish our open-source cloud asset inventory as an industry standard.
  • Contribute to our managed services, which run atop our open-source foundation.
Requirements
  • 6+ years of experience in software engineering with a focus on backend and data engineering.
  • Strong experience with real-time data pipelines (using Kafka, SQS, etc), data warehouses and SQL for data storage and processing.
  • Skilled in working with one or more major cloud providers (AWS/GCP/Azure).
  • Self-motivated, resourceful, and an excellent communicator.
  • Proficient in automation to streamline development processes and improve velocity.
  • Experienced in designing and developing real-time and batch data transformation pipelines.
  • Strong written and spoken English to produce clear, detailed documentation.
  • Experience with Go is a plus.
Benefits
  • Remote-first company with flexible working arrangements.
  • Competitive salary with substantial equity upside.
  • A collaborative, remote-friendly culture with regular team events to stay connected.
  • High-impact role with ample opportunities for career growth.

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account