Senior Data Engineer

Senior Data Engineer

  

This role has been designed as ‘Hybrid’ with an expectation that you will work on average 2 days per week from an HPE office.

Job Description:

   

We are looking for a highly skilled Senior Data Engineer with strong architectural expertise to design and evolve our next-generation data platform. You will define the technical vision, build scalable and reliable data systems, and guide the long-term architecture that powers analytics, operational decision-making, and data-driven products across the organization.

This role is both strategic and hands-on. You will evaluate modern data technologies, define engineering best practices, and lead the implementation of robust, high-performance data solutions—including the design, build, and lifecycle management of data pipelines that support batch, streaming, and near-real-time workloads.

🔧 What You’ll Do

Architecture & Strategy

• Own the architecture of our data platform, ensuring scalability, performance, reliability, and security.
• Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management.
• Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy.
• Collaborate with engineering and product leadership to shape the technical roadmap.

Engineering & Delivery

• Design, build, and manage scalable, resilient data pipelines for batch, streaming, and event-driven workloads.
• Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows.
• Implement data quality, lineage, observability, and automated testing frameworks.
• Build ingestion patterns for APIs, event streams, files, and third-party data sources.
• Optimize compute, storage, and transformation layers for performance and cost efficiency.

Leadership & Collaboration

• Serve as a senior technical leader and mentor within the data engineering team.
• Lead architecture reviews, design discussions, and cross-team engineering initiatives.
• Work closely with analysts, data scientists, software engineers, and product owners to define and deliver data solutions.
• Communicate architectural decisions and trade-offs to technical and non-technical stakeholders.

✅ What We’re Looking For

• 6–10+ years of experience in Data Engineering, with demonstrated architectural ownership.
• Expert-level experience with Snowflake (mandatory), including performance optimization, data modeling, security, and ecosystem components.
• Expert proficiency in SQL and strong Python skills for pipeline development and automation.
• Experience with modern orchestration tools (Airflow, Dagster, Prefect, or equivalent).
• Strong understanding of ELT/ETL patterns, distributed processing, and data lifecycle management.
• Familiarity with streaming/event technologies (Kafka, Kinesis, Pub/Sub, etc.).
• Experience implementing data quality, observability, and lineage solutions.
• Solid understanding of cloud infrastructure (AWS, GCP, or Azure).
• Strong background in DataOps practices: CI/CD, testing, version control, automation.
• Proven leadership in driving architectural direction and mentoring engineering teams

Nice to Have

• Experience with data governance or metadata management tools.
• Hands-on experience with DBT, including modeling, testing, documentation, and advanced features.
• Exposure to machine learning pipelines, feature stores, or MLOps.
• Experience with Terraform, CloudFormation, or other IaC tools.
• Background designing systems for high scale, security, or regulated environments.

Cloud Architectures, Cross Domain Knowledge, Design Thinking, Development Fundamentals, DevOps, Distributed Computing, Microservices Fluency, Full Stack Development, Release Management, Security-First Mindset, User Experience (UX)

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.

Unconditional Inclusion

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Job:

Engineering

Job Level:

TCP_05

    

    

Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.

   

HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.

   

Recruitment Fraud Alert

We have become aware of an increase in fraudulent recruitment activities in which individuals impersonate our company or authorized recruitment agencies to offer fake employment opportunities. These scams may occur through false websites, emails, social media, or chat-based applications and often aim to obtain personal information or money. Please note that Hewlett Packard Enterprise (HPE), its direct and indirect subsidiaries and affiliated companies, and its authorized recruitment agencies/vendors will never charge a candidate a registration fee, hiring fee, or any other fee in connection with its recruitment and hiring process. We also never request personal information such as back account details, Social Security numbers, or national IDs via social media or chat applications.

All legitimate job opportunities will come through official company channels, and candidates are responsible for verifying the credentials of any third party claiming to represent the company. Any reliance on fraudulent communication is at the individual’s own risk, and HPE disclaims legal liability for any resulting damages. If you suspect recruitment fraud, do not share personal information or make any payments and report the incident to your local authorities immediately.