CloudQuery Logo

CloudQuery

Senior Software Engineer (Data Pipelines)

Sorry, this job was removed at 05:18 p.m. (GMT) on Wednesday, Jan 15, 2025
Be an Early Applicant
United Kingdom
United Kingdom

Description

CloudQuery is a growing Series A startup in the data space and the creator of the open-source, high-performance ELT framework powered by Apache Arrow. CloudQuery enables data movement for SREs, platform teams and security teams in Fortune 500 companies. We're looking for a skilled Backend/Data Engineer to join our core team. This role involves building, optimizing and deploying custom data pipelines, working on our flagship project, and helping make our self-hosted cloud asset inventory an industry standard.

Responsibilities:

  • Collaborate with the engineering team, CEO, and Product team on developing both existing and new features.
  • Design, implement, and maintain efficient data pipelines to ensure data integrity and reliability.
  • Lead features end-to-end from RFC → Implementation → Testing → Documentation → Release.
  • Enhance CloudQuery’s Core SDK and contribute new features to establish our open-source cloud asset inventory as an industry standard.
  • Contribute to our managed services, which run atop our open-source foundation.
Requirements
  • 6+ years of experience in software engineering with a focus on backend and data engineering.
  • Strong experience with real-time data pipelines (using Kafka, SQS, etc), data warehouses and SQL for data storage and processing.
  • Skilled in working with one or more major cloud providers (AWS/GCP/Azure).
  • Self-motivated, resourceful, and an excellent communicator.
  • Proficient in automation to streamline development processes and improve velocity.
  • Experienced in designing and developing real-time and batch data transformation pipelines.
  • Strong written and spoken English to produce clear, detailed documentation.
  • Experience with Go is a plus.
Benefits
  • Remote-first company with flexible working arrangements.
  • Competitive salary with substantial equity upside.
  • A collaborative, remote-friendly culture with regular team events to stay connected.
  • High-impact role with ample opportunities for career growth.

Similar Jobs

2 Hours Ago
Hybrid
3 Locations
Mid level
Mid level
Cloud • Information Technology • Security • Software • Cybersecurity
As an AI Engineer, you'll develop AI solutions for Cloudflare's developer platform, enhance AI observability, and collaborate on projects like code generation and model inference.
Top Skills: AIAi ObservabilityCloudflare WorkersEdge ComputingLlms
3 Hours Ago
Hybrid
Staines, Surrey, England, GBR
Entry level
Entry level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves resolving infrastructure issues, integrating AI into processes, and improving system reliability through automation and better design.
Top Skills: JavaScriptLinuxNetworkingPython
3 Hours Ago
Easy Apply
Remote
35 Locations
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
This role involves leading the design and evolution of GitLab’s multi-tenant platform, ensuring high availability and performance while mentoring team members. Responsibilities include backend API design and fostering a collaborative engineering culture.
Top Skills: Cloud ComputingGoRuby

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account