CAST AI Logo

CAST AI

Senior Software Engineer - AI Enabler

Reposted Yesterday
Be an Early Applicant
Remote
5 Locations
Senior level
Remote
5 Locations
Senior level
The Senior Software Engineer will optimize LLM management in Kubernetes, enhance performance, and build software for cost efficiency across cloud platforms.
The summary above was generated by AI
Why Cast AI?

Cast AI is the leading Application Performance Automation (APA) platform, enabling customers to cut cloud costs, improve performance, and boost productivity – automatically.
Built originally for Kubernetes, Cast AI goes beyond cost and observability by delivering real-time, autonomous optimization across any cloud environment. The platform continuously analyzes workloads, rightsizes resources, and rebalances clusters without manual intervention, ensuring applications run faster, more reliably, and more efficiently.
Headquartered in Miami, Florida, Cast AI has employees in more than 32 countries worldwide and supports some of the world’s most innovative teams running their applications on all major cloud, hybrid, and on-premises environments. Over 2,100 companies already rely on Cast - from BMW and Akamai to Hugging Face and NielsenIQ.
What’s next? Backed by our $108M Series C, we’re doubling down on making APA the new standard for DevOps and MLOps, and everything in between.

About the role

AI Enabler – Helps customers deploying and managing LLMs in their Kubernetes cluster and optimizes their workloads by providing cost visibility and intelligent routing for LLM requests to the most cost-effective compute resources (e.g., Grok, self-hosted LLAMA models).

Here are some of the tools we use daily:
  • Languages: GoLang (primary), Python (secondary for some cases)
  • Cloud & Orchestration: Kubernetes, AWS, GCP, Azure
  • Databases & Storage: PostgreSQL, Cloud Object Storage
  • PostgreSQL and Cloud Object Storage for persistence
  • Messaging & APIs: GCP Pub/Sub, gRPC for internal communication, REST for public APIs
  • Observability: Prometheus, Grafana, Loki, Tempo
  • CI/CD & GitOps: GitLab CI with ArgoCD.
Requirements:
  • Strong software engineering skills with experience in distributed systems and backend development (ideally GoLang, but not a hard requirement as long as you’re willing to transition to it)
  • Strong debugging, optimization, and performance-tuning skills
  • Deep understanding of cloud platforms: hands-on experience with cloud platforms like AWS, Google Cloud Platform (GCP), Microsoft Azure, and tools such as Kubernetes for containerization and orchestration
  • CI/CD and DevOps practices experience
  • Strong English skills, both verbal and written
  • Ability to work independently and collaboratively within a team
  • Startup mindset: adaptable, proactive, and comfortable with ambiguity
  • A proactive, problem-solving mindset with a "yes we can" attitude.
What’s in it for you?
  • Competitive salary (€6,500 - €9,000 gross, depending on the level of experience)
  • Enjoy a flexible, remote-first global environment.
  • Collaborate with a global team of cloud experts and innovators, passionate about pushing the boundaries of Kubernetes technology.
  • Enjoy a flexible, remote-first global environment.
  • Equity options.
  • Private health insurance.
  • Get quick feedback with a fast-paced workflow. Most feature projects are completed in 1 to 4 weeks.
  • Spend 10% of your work time on personal projects or self-improvement. 
  • Learning budget for professional and personal development - including access to international conferences and courses that elevate your skills.
  • Annual hackathon to spark new ideas and strengthen team bonds.
  • Team-building budget and company events to connect with your colleagues.
  • Equipment budget to ensure you have everything you need.
  • Extra days off to help maintain a healthy work-life balance.
    #LI-Remote

#LI-Remote

Top Skills

Argocd
AWS
Azure
Cloud Object Storage
GCP
Gcp Pub/Sub
Gitlab Ci
Go
Grafana
Grpc
Kubernetes
Loki
Postgres
Prometheus
Python
Rest
Tempo

Similar Jobs

6 Days Ago
Remote
5 Locations
Senior level
Senior level
Artificial Intelligence • Productivity • Software • Automation
The Sr. Product Marketing Manager will create go-to-market strategies for Zapier MCP, focusing on developer and enterprise audiences, leading strategic launches, enhancing product positioning, and building community engagement.
Top Skills: Ai ToolsAPIsZapier Mcp
9 Hours Ago
Easy Apply
In-Office or Remote
2 Locations
Easy Apply
Senior level
Senior level
Artificial Intelligence • Biotech
The Head of IT will design and implement corporate IT infrastructure, oversee cybersecurity, manage compliance, and lead the IT team at Bioptimus.
Top Skills: AWSCybersecurityIaasIdentity ManagementNetworkingSaaS
9 Hours Ago
Easy Apply
Remote
EU
Easy Apply
Senior level
Senior level
Software • Consulting
Seeking a Senior Software Engineer skilled in Go to build innovative products and mentor teams while ensuring high standards in software engineering within an Agile environment.
Top Skills: DockerFluxGoKubernetesRed PandaTerraform

What you need to know about the Edinburgh Tech Scene

From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account