CloudQuery Logo

CloudQuery

Senior Software Engineer (Data Pipelines)

Sorry, this job was removed at 05:18 p.m. (GMT) on Wednesday, Jan 15, 2025
Be an Early Applicant
United Kingdom
United Kingdom

Description

CloudQuery is a growing Series A startup in the data space and the creator of the open-source, high-performance ELT framework powered by Apache Arrow. CloudQuery enables data movement for SREs, platform teams and security teams in Fortune 500 companies. We're looking for a skilled Backend/Data Engineer to join our core team. This role involves building, optimizing and deploying custom data pipelines, working on our flagship project, and helping make our self-hosted cloud asset inventory an industry standard.

Responsibilities:

  • Collaborate with the engineering team, CEO, and Product team on developing both existing and new features.
  • Design, implement, and maintain efficient data pipelines to ensure data integrity and reliability.
  • Lead features end-to-end from RFC → Implementation → Testing → Documentation → Release.
  • Enhance CloudQuery’s Core SDK and contribute new features to establish our open-source cloud asset inventory as an industry standard.
  • Contribute to our managed services, which run atop our open-source foundation.
Requirements
  • 6+ years of experience in software engineering with a focus on backend and data engineering.
  • Strong experience with real-time data pipelines (using Kafka, SQS, etc), data warehouses and SQL for data storage and processing.
  • Skilled in working with one or more major cloud providers (AWS/GCP/Azure).
  • Self-motivated, resourceful, and an excellent communicator.
  • Proficient in automation to streamline development processes and improve velocity.
  • Experienced in designing and developing real-time and batch data transformation pipelines.
  • Strong written and spoken English to produce clear, detailed documentation.
  • Experience with Go is a plus.
Benefits
  • Remote-first company with flexible working arrangements.
  • Competitive salary with substantial equity upside.
  • A collaborative, remote-friendly culture with regular team events to stay connected.
  • High-impact role with ample opportunities for career growth.

Similar Jobs

3 Hours Ago
Easy Apply
Hybrid
London, England, GBR
Easy Apply
Senior level
Senior level
Cloud • Software
Manage a team of AI engineers to design, implement, and assess large-scale AI/ML pipelines, focusing on model training, evaluation, and data engineering.
Top Skills: AIDeep LearningLarge Language ModelsMlPythonPyTorchTensorFlow
3 Hours Ago
Hybrid
Glasgow, City of Glasgow, Scotland, GBR
Mid level
Mid level
Financial Services
The Python Software Engineer III designs and delivers technology products, ensures code quality, and improves applications using large data sets, with a focus on agile methodology and best practices.
Top Skills: Artificial IntelligenceCi/CdCloud TechnologiesDatabase Querying LanguagesMachine LearningPython
4 Hours Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Financial Services
This role involves designing data tooling, integrating data management tools, and guiding data usage within Markets to enhance data strategies.
Top Skills: AWSAzureGCPPython

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account