DevOps Engineer (AI/ML Platform) – Job Description

Job Title: DevOps Engineer – AI/ML Platform
Experience: 10+ years
 

About the Role

We are seeking a skilled DevOps Engineer with experience in AI/ML infrastructure to design, build, and maintain scalable, secure, and reliable cloud platforms that support AI and machine learning workloads. The ideal candidate will have strong expertise in cloud-native technologies, CI/CD, infrastructure automation, Kubernetes, and MLOps practices.

Key Responsibilities

• Design, implement, and manage cloud infrastructure for AI/ML applications and services.

• Build and maintain CI/CD pipelines for application and machine learning model deployments.

• Automate infrastructure provisioning using Infrastructure as Code (IaC) tools.

• Deploy and manage containerized workloads using Kubernetes.

• Implement MLOps workflows for model training, validation, deployment, and monitoring.

• Optimize cloud resources for performance, scalability, and cost efficiency.

• Monitor platform health, troubleshoot production issues, and ensure high availability.

• Implement security best practices, including secrets management, IAM, and compliance controls.

• Collaborate with data scientists, ML engineers, software developers, and platform teams.

• Establish observability solutions using logging, monitoring, and tracing tools.

Required Skills

DevOps & Cloud

• Strong experience with at least one major cloud platform:

  • Amazon Web Services (AWS)

  • Microsoft (Azure)

  • Google (GCP)

• Expertise in Linux system administration.

• Experience with containerization technologies such as:

  • Docker

  • Kubernetes

• Strong knowledge of Infrastructure as Code:

  • Terraform

  • Ansible

• CI/CD tools such as:

  • Jenkins

  • GitHub Actions

  • GitLab CI/CD

AI / MLOps

• Experience supporting AI/ML workloads in production.

• Knowledge of MLOps frameworks and tools:

  • MLflow

  • Kubeflow

• Experience with model deployment, model serving, and monitoring.

• Understanding of GPU-based infrastructure and distributed training environments.

• Familiarity with vector databases, LLM applications, and generative AI workflows.

• Experience integrating AI services and APIs.

Monitoring & Security

• Monitoring and observability:

  • Prometheus

  • Grafana

  • OpenTelemetry

• Security and secrets management:

  • HashiCorp Vault

• Knowledge of DevSecOps practices.

Preferred Qualifications

• Experience with Large Language Models (LLMs) and Generative AI platforms.

• Experience with Retrieval-Augmented Generation (RAG) architectures.

• Certifications in AWS, Azure, GCP, Kubernetes, or Terraform.

• Experience managing multi-cloud or hybrid-cloud environments.

Nice-to-Have

• Python scripting and automation.

• Experience with data pipelines and streaming technologies.

• Knowledge of cost optimization for AI infrastructure.

• Experience building internal developer platforms and self-service infrastructure.

Success Criteria

• Highly available and secure AI/ML platform.

• Automated deployment pipelines for applications and models.

• Reduced infrastructure provisioning time through automation.

• Improved reliability, observability, and operational efficiency of AI workloads. 

About Charles River Development

Charles River Investment management System in a platform that provides many Front-Office functions including Portfolio Management, Order Management and Execution, Compliance, Performance & Attribution, Modelling, Scenario Analysis, and Wealth Management.

We are part of the State Street Bank. State Street is one of the largest custodian banks, asset managers, and asset intelligence companies in the world. From technology to product innovation, we’re making our mark in the financial services industry. For more than two centuries, we’ve been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading, and investment management to institutional clients.

Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary in location, but you may expect generous medical care, insurance and savings plans among other perks. You’ll have access to flexible Work Program to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.

Inclusion, Diversity and Social Responsibility. We truly believe our employees’ diverse backgrounds, experiences and perspective are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.

State Street is an equal opportunity and affirmative action employer. Discover more at StateStreet.com/careers.

Interested in learning more about us? Visit our  www.statestreet.com www.crd.com LinkedIn page: State Street on LinkedIn

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement