Sr. Data Engineer - Integrations

At The Coca‑Cola Company, we believe data is the foundation for creating personalized experiences and powering sustainable growth in today’s digital-first world. As consumers engage with our brands in more connected ways than ever before, we are investing in advanced data and analytics platforms to unlock deeper insights, accelerate decision-making, and enable seamless innovation at scale. 

In this role as a Sr. Data Engineer - Integrations, you will drive the technical strategy and architecture for how data flows across our enterprise ecosystem. By leveraging your expert-level proficiency in Spark, Scala/Java development, and JVM-based engineering, you will design scalable data products. 

Core Responsibilities 

• Architect and oversee enterprise-scale data integration pipelines and data products. Establish Medallion architecture patterns (Bronze, Silver, Gold) within Microsoft Fabric to ensure data quality, scalability, and reusability. 

• Optimization: Act as the ultimate escalation point for complex Spark performance tuning. Deep-dive into Catalyst optimizer query plans, JVM memory profiling, and advanced partitioning strategies to resolve platform-wide bottlenecks and maximize cost efficiency. 

• Complex Backend System Design: Lead the system design and architecture of highly available, REST-based microservices and APIs on the JVM, enabling seamless, low-latency interoperability between complex internal and external systems. 

• Engineer modular, testable, and maintainable code applying functional programming principles and industry-best patterns for reliability and performance. 

• Optimize workflows through data partitioning strategies, storage formats, and platform configurations to enable high-performance querying and cost efficiency. 

• Engineering Excellence & Mentorship: Champion the "You Build It, You Run It" philosophy. Define the standards for functional programming and SOLID principles in Scala. Conduct architectural reviews, lead code quality initiatives, and mentor Grade 10 and junior engineers. 

• CI/CD & Automation: Architect and maintain robust CI/CD pipelines using GitHub Actions, Maven, and SBT to automate testing, deployment, and configuration of data artifacts. 

Required Qualifications & Experience 

• Expert Scala & JVM Architecture: Expert-level proficiency in Scala programming and JVM internals. Demonstrated ability to design concurrent, modular systems using advanced functional programming concepts. 

• Advanced Spark Expertise (5+ years): Deep, hands-on experience building, debugging, and optimizing enterprise-grade distributed computing applications using Apache Spark (Scala preferred). Proven track record of solving complex data skew and memory management issues at scale. 

• Data Architecture & Strategy: Extensive experience designing scalable data models (STAR, Vault, Tabular) and building out Medallion architectures for complex enterprise analytics and structured streaming applications. 

• Backend & API Engineering: Proven experience architecting and scaling REST-based microservices and robust backend applications on the JVM. 

• Synapse/Fabric Leadership (4-5+ years combined): Deep architectural experience transforming large data ecosystems using Azure Data Services (Synapse, Fabric, ADF, Azure Functions). 

• DevOps & CI/CD Mastery: Proven ability to architect automated release cycles and infrastructure deployment. Hands-on expertise with Git, GitHub Actions, build tools (Maven/SBT), and configuring environments for parallel development. 

• Delivery: Experience in Agile development (Scrum, lean techniques) and collaborating with global engineering teams.