Data Engineer, Senior Associate
State StreetRole Summary
Design, build, and support trusted analytical data products for Core Reference Data, Security Master, IBOR Holdings & Transactions, DataHub, Stamford Data Warehouse and may other data initiatives. Develop end-to-end batch/stream pipelines, logical and physical data models, and production-grade curation of reference and application data using open Lakehouse technologies, in partnership with domain SMEs, architects, and platform teams.
Key Responsibilities
· Build and operate scalable batch and streaming pipelines using the Snowflake and/or Databricks tech stack, Spark, or Informatica ETL (where reused) to deliver analytics-ready datasets
· Implement Iceberg-based tables, partitions, and metadata structures for consistent and performant analytical access
· Implement processing, storage, and delivery for reference and application data domains including security data and IBOR holdings/transactions, integrating source feeds (RKS, PORTIA, Aladdin, CRD Cloud) into curated analytical datasets
· Implement automated data validation, data quality rules, reconciliation checks, and lineage capture to ensure trusted analytical outcomes
· Build and publish curated semantic layer data models (serving models, marts) and expose them via governed BI endpoints and/or consumption APIs, ensuring consistent metrics and business definitions
· Develop data product interfaces for consumption (schemas, SLAs, documentation, versioning and backward compatibility) to support stable API and BI integrations
· Work with Platform Engineering to standardize deployment via CI/CD, productionize jobs, and adopt platform guardrails and observability patterns
· Collaborate with architects and application teams to define data strategies and deliver logical/physical data models aligned to analytical workloads
· Participate in on-call / major incident management, perform backfills where required, and support production stability for owned data products
Qualifications
· Strong data engineering programming skills in Python, Java, and SQL
· Solid programming skills in Spark & SQL, with hands-on knowledge of optimization and debugging
· Hands-on experience with Snowflake and Databricks as data platforms
· Good understanding of open table formats such as Apache Iceberg, catalogs (any of Polaris, Horizon, Unity), or metadata frameworks
· Experience building production-grade services in cloud environments; AWS,GCP and/or Azure is preferred
· Basic understanding of data modeling and data product concepts
· Solid debugging and performance-tuning skills for data pipelines
· Financial services or enterprise data platform background is beneficial but not required
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement