Lead the design, development, deployment, and operation of production-grade ML, LLM, and generative AI services. Build secure RAG and agentic pipelines, MCP integrations, AI libraries, monitoring, evaluation, and model optimization strategies. Collaborate with product managers, data scientists, and engineers to prioritize use cases and establish scalable engineering standards. Mentor engineers, communicate technical results, and drive secure, reliable enterprise AI adoption.
The Applied Artificial Intelligence and Machine Learning (Applied AI/ML) team within Infrastructure Platforms is transforming how the firm delivers strategic infrastructure platforms-based solutions—both by applying AI/ML within engineering workflows and by building scalable AI hosting platforms and capabilities for enterprise use.
As an Applied ML and Generative Lead within J.P.Morgan, you will operate as a hands-on engineering leader responsible for designing, building, and running production-grade ML and Generative AI services, while setting technical direction that scales across multiple workstreams. You will remain close to the code and architecture decisions, establish delivery and engineering standards, and ensure solutions meet enterprise expectations for security, stability, and operational rigor.
The ideal candidate brings a strong foundation in software engineering and AI/ML, along with proven experience leading the development and production operation of AI-enabled systems in secure, enterprise environments.
In this role, you will collaborate closely with Infrastructure Platforms AI teams to address priority use cases, design and build services, and promote best practices for scalable, resilient, and secure AI adoption. You will also mentor engineers, contribute to firmwide standards and thought leadership, and help ensure the organization stays at the forefront of AI engineering advancements.
Job Responsibilities
- Provide hands-on technical leadership by designing, developing, and deploying ML/LLM/GenAI solutions from concept through production, maintaining ownership for reliability and operability once deployed
- Work closely with product managers, data scientists, ML engineers, and other stakeholders to understand requirements and prioritize use cases.
- Develop secure, testable services and libraries that integrate LLMs, tool use, RAG, and agentic workflows.
- Build end-to-end RAG/Agentic RAG pipelines: chunking and indexing, retrieval tuning, re-ranking, grounding checks.
- Implement optimization strategies to fine-tune generative models for specific NLP use cases, ensuring high-quality outputs in summarization and text generation.
- Mentor and uplift junior engineers through design reviews, code reviews, pairing, and coaching, raising engineering quality and delivery discipline across the team.
- Implement monitoring mechanisms to track AI solution performance in real-time to ensure reliability and compliance.
- Communicate AI/ML/LLM/GenAI capabilities and results to both technical and non-technical audiences.
- Stay informed about the latest trends and advancements in the latest AI/ML/LLM/GenAI research, implement cutting-edge techniques, and leverage external APIs for enhanced functionality.
Required qualifications, capabilities, and skills
- Proven delivery of LLM-enabled applications using agentic patterns, including tool use, orchestration, guardrails, and structured outputs.
- Hands-on experience building and operating MCP integrations reliably in production.
- Hands-on experience on data-driven software/systems engineering experience delivering production services in secure, regulated environments.
- Expertise in Python engineering skills, including production-grade design, testing, debugging, and performance tuning/optimization.
- Advanced prompt engineering capabilities, including system prompts, few-shot prompting, tool/function calling, and schema-constrained outputs (e.g., JSON Schema).
- Understanding of agentic AI system layers and concepts, such as context management, harness design, and loop engineering.
- Experience building conversational AI solutions, including RAG, Agentic and Graph RAG techniques
- Experience building and scaling AI/ML workloads using distributed training/serving frameworks (e.g., Ray) and GPU acceleration (e.g., CUDA) environments.
- Proficiency with modern AI system architectures and patterns, including RAG, agentic RAG, and multi-agent systems.
- Familiarity with LLM evaluation methodologies across quality, safety, and reliability, including guardrails, content filtering, and Responsible AI practices.
- Proficiency in GenAI/agentic AI engineering practices, including data sensitivity, secure handling of inputs/outputs, and adherence to resiliency and security requirements
- Demonstrated success driving adoption of enterprise-approved AI-assisted engineering tools (coding, review, testing, troubleshooting
Preferred qualifications, capabilities, and skills
- Financial Services industry experience
- Understanding of Finops for LLMs
- Good to have Java programming experience
About UsJ.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Database • Analytics
Implements InterSystems healthcare software solutions by assessing customer processes, advising on standard product fit, minimizing customization, and guiding successful adoption. Conducts customer training, workshops, and presentations; creates functional documentation; maps business processes; collaborates with multidisciplinary teams; and supports product implementation. The role requires strong customer-facing and consultative skills, healthcare information systems knowledge, and willingness to travel extensively, potentially spending up to five days away from home weekly.
Top Skills:
Artificial IntelligenceClinical WorkflowsHealthcare Information SystemsIntersystems ProductsLaboratory Information Systems
Fintech • Software • Financial Services
Delivers interactive instructor-led, virtual, and web-based learning experiences for onboarding and employee development. Partners with HR and business leaders to address performance challenges, creates and curates training content, evaluates learning effectiveness, analyzes feedback, and manages readiness, reinforcement, communications, and follow-up. Provides technology and job-specific training, supports train-the-trainer sessions, develops learning paths, and applies adult learning principles to improve employee performance and productivity.
Top Skills:
MS Office
2 Hours Ago
Easy Apply
Easy Apply
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Supports third-party risk management by assessing vendor security, maintaining risk registers and control mappings, and communicating technical and program risks. Builds automated and AI-enabled workflows using GRC and procurement platforms, partners with Procurement, Legal, Privacy, Engineering, and Security teams, and helps implement security controls across SaaS platforms. The role also coordinates with auditors and translates technical findings into clear business risks and requirements.
Top Skills:
Ai Workflow AutomationGoogle WorkspaceIso 27001Nist Cybersecurity FrameworkOktaSalesforceSlackSoc 2VantaZip
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
