Senior Machine Learning Engineer (GenAI)
The Data + Science Team
At Deliveroo we have a world-class data & science organisation, with a mission to enable the highest quality human and machine decision-making. We have over 250 Machine Learning Engineers, Data Scientists, Data Analysts, and Analytics Engineers working throughout the company in product, business and platform teams.
We have a strong, active data science community; a robust technical review process; a career progression framework; and plenty of opportunities to learn new things.
The Role
We are hiring for a Senior MLE position in our Agentic AI platform team, working on Agentic AI frameworks which will be used by multiple teams across the business. The role is a mix of platform tooling development and applied research, with the main focus on developing and implementing Agentic AI evaluation techniques, using strategies such as LLM-as-judge.
As an MLE, you will work within a multidisciplinary team of machine learning engineers and software engineers building the Agentic AI platform, and liaise closely with downstream teams using the platform to build agentic applications. These applications range from consumer-facing chatbots to intelligent backend systems, and use techniques such as RAG and multimodal input / output. Your team has independence and the platform enables some of the most difficult problems at the intersection of our three-sided marketplace (riders, consumers, and restaurants). Your work will contribute to creating the company-wide Agentic AI evaluation strategy and ensure that agentic applications being developed are compliant, robust and well-engineered.
The role includes:
Developing, assessing and evaluating agentic systems built with a variety of LLM providers, including OpenAI, Anthropic & Google.
Research and implementation of new GenAI evaluation techniques.
Contributions to the development of software packages and evaluation harnesses to allow downstream teams to develop their own evaluation datasets and metrics.
Development of common tooling to support the above, including labelling UIs and associated tooling.
Defining best practices for GenAI evaluations across the business and working closely with downstream teams and product partners to align evaluation strategies with business needs.
Requirements
5+ years' experience as an ML Engineer or Data Scientist
5+ years' experience writing production code in Python
Experience using tools like Git, Docker, Kubernetes, CircleCI
Experience productionising Generative AI workstreams or Agentic AI projects
You know the fundamentals of Generative AI and have a good understanding of the science behind it, including LLMs, VLMs, transformers and fine-tuning techniques.
A robust understanding of traditional ML and evaluation techniques, and a good understanding of the research and developments around Generative AI evaluation techniques.
You get satisfaction from seeing your work shipped and driving measurable impact to the business
Experience mentoring others in the team.
You have a bias to simplicity, where you care most about achieving impact
Bonus
Experience with evaluation harnesses and frameworks for Generative AI
Experience with observability, monitoring, and safety techniques for deployed GenAI systems
Experience in strongly typed languages such as Go
The Company
Our mission is to be the definitive food company. We are transforming the way the world eats by making food more convenient and accessible. We are a technology-driven company at the forefront of the most rapidly expanding industry in the world. We are still a small team, making a very large impact, looking to answer some of the most interesting questions out there. We move fast, value autonomy and ownership, and we are always looking for new ideas.
Workplace & Benefits
At Deliveroo we know that people are the heart of the business and we prioritise their welfare. Benefits differ by country, but we offer many benefits in areas including healthcare, well-being, parental leave, pensions, and generous annual leave allowances, including time off to support a charitable cause of your choice. Benefits are country-specific, please ask your recruiter for more information.
Diversity
At Deliveroo, we believe a great workplace is one that represents the world we live in and how beautifully diverse it can be. That means we have no judgement when it comes to any one of the things that make you who you are - your gender, race, sexuality, religion or a secret aversion to coriander. All you need is a passion for (most) food and a desire to be part of one of the fastest-growing businesses in a rapidly growing industry.
We are committed to diversity, equity and inclusion in all aspects of our hiring process. We recognise that some candidates may require adjustments to apply for a position or fairly participate in the interview process. If you require any adjustments, please don't hesitate to let us know. We will make every effort to provide the necessary adjustments to ensure you have an equitable opportunity to succeed.
