Lead Software Engineer - MLOps

Job summary

As a Lead Software Engineer at JPMorgan Chase within the International Consumer Bank MLOps team, you will design, build, and deploy scalable AI/ML solutions to enhance banking experiences. You will collaborate with data scientists, product managers, and engineering teams to translate business initiatives into robust, customer-focused systems. Your work will leverage foundational AI and machine learning models to improve services within a diverse, inclusive, and geographically distributed team.

Qualifications

• Formal training or certification on software engineering concepts and proficient advanced experience
• Recent hands-on experience as a back-end software engineer, especially with customer-facing, LLM-powered microservices
• Proficiency in Java and Python programming languages
• Experience designing and implementing effective tests (unit, component, integration, end-to-end, performance)
• Excellent written and verbal communication skills in English
• Familiarity with advanced AI/ML concepts and protocols, such as Retrieval-Augmented Generation, agentic system architectures, and Model Context Protocol
• Strong interest in building generative AI applications and tooling
• Experience with cloud technologies, distributed systems, RESTful APIs, and web technologies
• Understanding of event-based architecture, data streaming, and messaging frameworks
• Proficiency in operating, supporting, and securing mission-critical software applications
• Understanding of various data stores (relational, non-relational, vector)
• Ability to mentor team members on coding practices, design principles, and implementation patterns
• Ability to manage stakeholders and prioritize deliverables across multiple work streams
• Background in STEM with exposure to productionizing machine learning systems
• Experience with MLOps tools and platforms (e.g., MLflow, Amazon SageMaker, Databricks, BentoML, Arize)
• Proficiency in cloud-native microservices architecture
• Hands-on experience with Amazon Web Services (AWS)
• Previous experience as a Platform engineer
• Experience working in highly regulated environments or industries

Responsibilities

• Deliver end-to-end cloud-native microservices and data pipelines using modern technologies and best practices
• Structure software for clarity, testability, and ease of evolution
• Build scalable solutions that avoid single points of failure
• Develop secure code to protect customers and the organization
• Investigate and resolve issues promptly to prevent recurrence
• Ensure zero-downtime releases for end-users
• Monitor model and system performance, identifying and solving problems effectively
• Build reliable, easy-to-operate systems
• Continuously update and upgrade technologies and patterns
• Maintain and improve deployed AI/ML models and microservices throughout the software development lifecycle, including production and incident management
• Ensure compliance and security in AI/ML solution deployment and operation

Skills

Certifications

Degrees

Languages

Industry

Relocation