Senior Data Engineer - Data Corpus

Posted Yesterday
Be an Early Applicant
London, Greater London, England
Senior level
Music • Software
The Role
The Senior Data Engineer will build and maintain SoundCloud’s GCP data warehouse, Corpus, facilitating data access and reporting for diverse teams. Responsibilities include designing data architecture, building ETL pipelines with Airflow, and ensuring data quality for analytics and business KPIs.
Summary Generated by Built In

SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400+ million tracks from 40+ million artists, the future of music is SoundCloud.

We are looking for an experienced Senior Data Engineer (Level 3) to join the Data Foundations department in our Data Corpus team. You will help us continue building our unified and standardized data warehouse, Corpus, which is used across SoundCloud for reporting, data science, and analytics, building data products, or simply answering questions. You will also help us build out our business-ready data layer to be used in dashboarding and for simplified data usage. You can read more about Data Corpus in our blog post.

About the role

The Data Corpus team is responsible for building and maintaining SoundCloud’s petabyte-scale GCP data warehouse. You will build and maintain the warehouse to abstract the complexity of SoundCloud’s vast data ecosystem to exploit and get value from data. You will work closely with business reporting, data science, and product teams. You will gather and refine requirements, design data architecture and solutions, and build ETL pipelines using Airflow to land data in BigQuery and beyond. You will model and build out the business-ready data layer, designed to feed dashboarding tools with KPIs and simplify data access for business and product stakeholders. You will have knowledge and passion for analytics engineering. You are a strong individual contributor who thrives in a dynamic environment and is motivated by solving challenging data problems.

About you

As a Senior individual contributor, you will be able to manage stakeholders, plan and lead technical projects, and identify and focus the business value of projects. 

Must have:

  • Senior Level Data Professional
    • +6 years experience ideal, +4 years minimum experience.
  • Experience working with Cloud technologies
    • GCP (required)
    • AWS/Azure is also nice to have
  • Experience working with BigQuery
  • Advanced SQL knowledge
  • Python experience
  • Airflow experience
  • Experience working with big data (terabyte/petabyte scale)
  • Experience in Data Architecture/solution design
  • Experience working in Agile methodology, ideally working with Jira.
  • Experience in data warehousing and analytical data modelling.
  • Experience working with CI/CD pipelines and code repositories (Git preferred)
  • Experiencing in building complex and high-reliability ETL pipelines
  • Experience building data for BI Tools (Looker preferred)
  • Experience building datasets for product and business KPIs
  • Knowledge of basic statistical concepts and methods
  • Experience producing high-quality technical documentation
  • Excellent English-speaking communicator and demonstrator

Nice to have:

  • Experience in basic QA engineering and testing methodologies
  • Experience with experimentation (A/B testing) tools and processes
  • Experience working with subscription-based businesses
  • Experience integrating third-party tools and systems
  • Data visualisation skills
  • Experience with terraform

About us

  • We are a multinational company with offices in the US (New York and Los Angeles), Germany (Berlin), and the UK (London)
  • We provide a flexible work culture that offers the opportunity to collaborate and connect in person at our offices as well as accommodating work from home
  • We are deeply committed to ensuring diversity, equity and inclusion at all levels of our organization and fostering a community where everyone’s voice, perspective and experience is respected and heard
  • We believe a strong team is made by investing in employees through mentorship, workshops and enrichment opportunities

Benefits

  • Not located in Berlin? No worries, we offer extensive relocation support including allowances, one way flights, temporary accommodation and, by partnering with Expath, on the ground support on arrival
  • Interested in a gym membership, photography course or book? We have a Creativity and Wellness benefit!
  • Employee Stock Ownership Plan
  • Generous professional development allowance
  • Fertility and Family Building program
  • Flexible vacation and public holiday policy where you can take up to 35 days of PTO annually
  • 16 paid weeks for all parents (birthing and non-birthing), regardless of gender, to welcome newborns, adopted and foster children
  • We offer free German courses at beginning, intermediate and advanced
  • Various snacks, goodies, and 2 free lunches weekly when at the office

Diversity, Equity and Inclusion at SoundCloud

SoundCloud is for everyone. Diversity and open expression are fundamental to our organization; they help us lead what’s next in music by understanding and empowering our creators and fans, no matter their identity. We acknowledge the challenges in the music industry, and strive to influence an inclusive culture where everyone can contribute respectfully and thrive, especially the historically marginalized communities that many of our creators, fans and SoundClouders identify with. We are dedicated to creating an inclusive environment at SoundCloud for everyone, regardless of gender identity, sexual orientation, race, ethnicity, migration background, national origin, age, disability status, or care-giver status.

At SoundCloud you can find your community or elevate your allyship by joining a Diversity Resource Group. Diversity Resource Groups are employee-organized groups focused on supporting and promoting the interests of a particular underrepresented community in order to build a more inclusive culture at SoundCloud. Anyone can join, whether you share the identity or strive to be an ally.


Top Skills

Python
SQL
The Company
HQ: Berlin
1,710 Employees
On-site Workplace
Year Founded: 2007

What We Do

SoundCloud is a next-generation music entertainment company powered by an ecosystem of artists, fans, and thriving communities. As one of the world’s most influential cultural platforms, SoundCloud holds a singular market position as both a music-streaming service with the largest catalog of music, and an artist services and distribution business to help artists grow long-term, successful careers.

Similar Jobs

BenchSci Logo BenchSci

Senior Software Engineer, Data

Artificial Intelligence • Software • Biotech • Pharmaceutical
Remote
London, Greater London, England, GBR
326 Employees

Smarkets Logo Smarkets

Senior Data Engineer

Fintech • Software • Sports
London, Greater London, England, GBR
150 Employees

WISE Logo WISE

Machine Learning Scientist - Fraud

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
6000 Employees

WISE Logo WISE

Data Analyst Lead - Treasury

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
6000 Employees

Similar Companies Hiring

InterSystems Thumbnail
Software • Machine Learning • Healthtech • Database • Big Data • Artificial Intelligence • Analytics
Boston, MA
1800 Employees
Trustpilot Thumbnail
Software • Sales • Information Technology • Consumer Web
Copenhagen, DK
950 Employees
TravelPerk Thumbnail
Travel • Software • HR Tech
Barcelona, Barcelona
1300 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account