Job Title: DevOps Engineer – AI/ML Platform
Experience: 8–12+ years
 

About the Role

We are seeking a skilled DevOps Engineer with experience in AI/ML infrastructure to design, build, and maintain scalable, secure, and reliable cloud platforms that support AI and machine learning workloads. The ideal candidate will have strong expertise in cloud-native technologies, CI/CD, infrastructure automation, Kubernetes, and MLOps practices.

Key Responsibilities:

• Design, implement, and manage cloud infrastructure for AI/ML applications and services.

• Build and maintain CI/CD pipelines for application and machine learning model deployments.

• Automate infrastructure provisioning using Infrastructure as Code (IaC) tools.

• Deploy and manage containerized workloads using Kubernetes.

• Implement MLOps workflows for model training, validation, deployment, and monitoring.

• Optimize cloud resources for performance, scalability, and cost efficiency.

• Monitor platform health, troubleshoot production issues, and ensure high availability.

• Implement security best practices, including secrets management, IAM, and compliance controls.

• Collaborate with data scientists, ML engineers, software developers, and platform teams.

• Establish observability solutions using logging, monitoring, and tracing tools.

Required Skills:

DevOps & Cloud

• Strong experience with at least one major cloud platform:

  • Amazon Web Services (AWS)

  • Microsoft (Azure)

  • Google (GCP)

• Expertise in Linux system administration.

• Experience with containerization technologies such as:

  • Docker

  • Kubernetes

• Strong knowledge of Infrastructure as Code:

  • Terraform

  • Ansible

• CI/CD tools such as:

  • Jenkins

  • GitHub Actions

  • GitLab CI/CD

AI / MLOps

• Experience supporting AI/ML workloads in production.

• Knowledge of MLOps frameworks and tools:

  • MLflow

  • Kubeflow

• Experience with model deployment, model serving, and monitoring.

• Understanding of GPU-based infrastructure and distributed training environments.

• Familiarity with vector databases, LLM applications, and generative AI workflows.

• Experience integrating AI services and APIs.

Monitoring & Security

• Monitoring and observability:

  • Prometheus

  • Grafana

  • OpenTelemetry

• Security and secrets management:

  • HashiCorp Vault

• Knowledge of DevSecOps practices.

Preferred Qualifications:

• Experience with Large Language Models (LLMs) and Generative AI platforms.

• Experience with Retrieval-Augmented Generation (RAG) architectures.

• Certifications in AWS, Azure, GCP, Kubernetes, or Terraform.

• Experience managing multi-cloud or hybrid-cloud environments.

Nice-to-Have:

• Python scripting and automation.

• Experience with data pipelines and streaming technologies.

• Knowledge of cost optimization for AI infrastructure.

• Experience building internal developer platforms and self-service infrastructure.

Success Criteria

• Highly available and secure AI/ML platform.

• Automated deployment pipelines for applications and models.

• Reduced infrastructure provisioning time through automation.

• Improved reliability, observability, and operational efficiency of AI workloads. 

Why this job is important to us

The team you will be joining is a part of Charles River Development (or CRD), that became a part of State Street in 2018. CRD helps create enterprise investment management software solutions for large institutions in the areas of institutional investment, wealth management, and hedge funds. Together we have created the first open front-to-back platform - State Street Alpha, that was launched in 2019.

Why this job is important to us

The team you will be joining is a part of Charles River Development (or CRD), that became a part of State Street in 2018. CRD helps create enterprise investment management software solutions for large institutions in the areas of institutional investment, wealth management and hedge funds. Together we have created the first open front-to-back platform - State Street Alpha, that was launched in 2019.

Responsibilities:

• Strong experience in enterprise application architecture and platform‑based solution design.

• Demonstrated ability to deliver complex platforms into production, not just define architecture.

• Drive technical excellence by working to analyse, design, develop, test, and debug large and complex software enhancements and solutions within Charles River’s business and technical problem domains including modifications to core frameworks and other primary facilities critical to system operation

• Collaborate with Business Analysts and Product Managers to create simple and sustainable software solutions for complex problems

• Provide thought leadership in the design of product architecture within and beyond the team’s scope of responsibility

• Direct problem solving for projects or major phases of projects to resolve advanced software technical issues

• Develop, test, debug, and implement software programs, applications and projects using Java, C#, SQL, JavaScript, or other related software engineering languages as well as keeping abreast of emerging technologies impactful to CRDs business

• Provide informed guidance and critical analysis of proposed changes during code reviews

• Write unit and automation tests to ensure a high-quality end product

• Contribute to written design and API documentation, and participate in customer documentation process

• Identify ways of improving development test methodologies contribute to and related test methodology frameworks

• Develop automate test and conduct manual tests to ensure a high-quality product

• Provide expert level troubleshooting on large, mission critical client implementations

• Actively assist team leaders in the agile software development process by adhering to and advancing the CRD scrum methodology, including attending all daily standups, sprint planning, backlog grooming, and retrospectives

• Plan and coordinate cross-team activities groups to complete assignments

Preferred qualifications and education:

• B.S. degree (or foreign education equivalent) in Computer Science, Engineering, Mathematics, and Physics or other technical course of study required. MS degree strongly preferred.

Experience:

• Experience with the Spring Boot Microservices and familiarity with the service deployment in cloud environments.

• A minimum of 12 years of progressively responsible professional software engineering experience

• Ideally, a minimum of 3 years of experience in financial services developing solutions for Portfolio Management, Trading, Compliance, Post-Trade, IBOR or Wealth Management is strongly desired

• Authoritative experience with object-oriented programming, compiler or interpreter technologies, embedded systems, operating systems, relational databases (RDBMS), scripting and new/advanced programming languages

• Experience in the development of cloud-native services (Azure experience a bonus)

• Experience of microservice architectures and Kubernetes

• Knowledge and experience working with Kafka and message-based systems

• Experience with Snowflake will be a strong asset.

• Experience with Postgres SQL is preferred

• Demonstrated problem solving abilities involving multi-tiered, high-performance database applications

• Demonstrated ability to design and develop simple software solutions to business and technical problems of high complexity

• Outstanding written and verbal communication skills

• Able to work well with peers in a collaborative team environment

• A minimum of 3 years working with an Agile development methodology

About Charles River Development:

Charles River Investment management System in a platform that provides many Front-Office functions including Portfolio Management, Order Management and Execution, Compliance, Performance & Attribution, Modelling, Scenario Analysis, and Wealth Management.

We are part of the State Street Bank. State Street is one of the largest custodian banks, asset managers, and asset intelligence companies in the world. From technology to product innovation, we’re making our mark in the financial services industry. For more than two centuries, we’ve been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading, and investment management to institutional clients.

Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary in location, but you may expect generous medical care, insurance and savings plans among other perks. You’ll have access to flexible Work Program to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.

Inclusion, Diversity and Social Responsibility. We truly believe our employees’ diverse backgrounds, experiences and perspective are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.

State Street is an equal opportunity and affirmative action employer. Discover more at StateStreet.com/careers.

Interested in learning more about us? Visit our  www.statestreet.com www.crd.com LinkedIn page: State Street on LinkedIn

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement