As a Lead Data Engineer, you will shape the future of online car markets, leading complex data projects, organizing teams, and designing new data solutions while working closely with engineers and management in a collaborative environment.
About the project:
Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.
Requirements:
- 8+ years of experience in software engineering
- English - Upper-Intermediate+
- Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
- Extensive expertise in AWS services, especially Glue, Athena
- Proficiency in Python, PySpark, GCP
- SQL, Airflow, data streaming frameworks (Kafka or Firehose)
- Experience in building and maintaining data pipelines
- Experience in building data platforms, not just using them
- Proficiency in data modeling techniques and best practices
Responsibilities:
- Simplify existing tools, make them more modular, work with technical debt
- Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
- Work closely with a team of Senior Engineers, Product Manager and Engineering Manager
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
Pyspark
Python
SQL
Similar Jobs
The Data Engineer will architect and lead the transition from on-premises batch architecture to a cloud-based streaming data platform, focusing on data warehousing, ETL pipelines, and data governance. The role involves collaboration with cross-functional teams and fostering a culture of technical excellence.
As a Data Engineer at Vaayu, you will transform customer data into standardized formats, contribute to improving transformation pipelines, and assist the team with customer data inquiries. Your role will be crucial in supporting the mission of reducing environmental impact through effective data handling.
.png)
Be an Early Applicant
The Principal Data Engineer will build data foundations for an AI-powered architecture design product, creating optimized data systems and robust data pipelines that support rapid experimentation and decision-making processes, and collaborating with cross-functional teams to meet data needs.
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
