Lead Engineer, Data & Analytics - BI Architecture

About the Team 

Our Business Intelligence organization is structured across PMO, Analytics, Development, and DevOps; operating as a unified, cross-functional team that delivers high-quality, trusted, and scalable data products for Comcast Business. The Solutions Architecture workstream lives in our DevOps team and serves as a strategic connector across the department. In this role, you’ll collaborate daily with our data engineers, analysts, PMO, infrastructure, and production support to ensure our solutions are consistent, resilient, and ready for long-term success. 

How We Work 

We balance speed with intentional design, operating in a fast-paced, iterative environment grounded in discipline and strong engineering fundamentals. Our culture emphasizes autonomy, thorough documentation, predictable delivery, and a “measure twice, cut once” approach to solution design. We take pride in being a low-ego, high-ownership team where coaching, mentoring, and continuous improvement are embedded in how we operate. We also prioritize sustainable work/life balance 

What Makes This Team Special 

We are a mature, stable organization with well-defined processes, but we are also a place where innovation thrives. As part of BDI, you’ll have direct visibility with leadership and meaningful influence over our future-state architecture, standards, frameworks, and best practices. You’ll be key in shaping how data flows, how BI works, how platforms scale, and how we maintain trust in the data that powers business decisions across the company. 

What We Expect 

This role is ideal for someone who: 

• Brings architectural rigor and a long-term, systems-thinking mindset 

• Thrives on cross-team coordination and being the connective tissue across engineering, DevOps, and support 

• Enjoys coaching, guiding, and raising the bar for engineers and analysts 

• Can simplify complex systems and provide clarity in ambiguous situations 

• Is comfortable making balanced architectural decisions and saying “no” when needed 

• Is forward-thinking and passionate about designing for scale, stability, and maintainability 

• This role does no development/data engineering in the day-to-day responsibilities 

If you’re looking for a place where your architectural leadership can have departmentwide impact, and where you can help shape a scalable data ecosystem, this is the role for you. 

Solutions Architecture – Team Responsibilities  

Solution Architecture Leadership & Accountability 

• Accountable for consistent end-to-end designs that adhere to Data Warehousing and BDI best practices across all teams and workstreams. 

• Ensure all architectural designs meet business, functional, technical, privacy, and compliance requirements, including alignment to Comcast Secure Development Lifecycle (SDL). 

• Ensure designs allow for simple, long-term support from DevOps and Production Support teams. 

• Responsible for a holistic architectural approach across BDI; recommend optimal design solutions that support long-term maintainability, consistent frameworks, scalability, and alignment to data model and toolset standards. 

Design Governance, Reviews & Standards 

• Lead solution design review meetings, Ensure requirements and architectural documentation is complete.  

• Conduct solution design and code walkthroughs for ETL pipelines and reporting solutions. 

• Ensure consistency in execution across teams; code standards, report look-and-feel, common dimensions, and elimination of duplicative efforts. 

• Ensure all designs follow established Data Warehousing, BDI principles, and architectural patterns. 

• Establish and support design approaches for database design and self-service BI capabilities. 

• Ensure connects are scheduled during established meeting blocks with agendas defined in advance to avoid ad-hoc interruptions and respect workload capacity. 

Best Practices, Frameworks & Continuous Improvement 

• Recommend standards, frameworks, and best practices that support long-term maintainability, scalability, evolving business needs, and evolving technologies within Comcast. 

• Participate in cross-BDI, DevOps, platform, and technology discussions (including TCO) to define and refine best practices. 

• Ensure recommendations support BDI as a whole and align across Development, Infrastructure, and Production Support teams. 

• Support the implementation and adoption of recommended best practices and architectural improvements. 

• Stay up-to-date on new technologies, platforms, and engineering patterns that could benefit BDI’s future-state architecture. 

Collaboration & Engagement Model 

• Facilitate structured working sessions with SMEs and stakeholders 

• Participate as part of a cross-functional team with representation from Development, Infrastructure, and Production Support. 

• Support Data Governance and Data Management initiatives, providing architectural insight and ensuring compliance requirements are met. 

Skills & Competencies 

Technical & Architectural Skills – Must Have 

ETL/ELT Pipeline Design & Patterns 

• Strong design skills for full load, incremental load, and CDC-based ingestion patterns in an OLAP environment. 

• Experience building meta-data-driven ingestion and transformation frameworks for scale. 

• Proficiency in SQL/TSQL for pipeline development and optimization. 

• Experience building resilient data pipelines with proper logging, auditing, and lineage. 

OnPrem Data Systems 

• Experience with SQL Server on-prem and SSIS, Stored Procedures. 

BI, Self-Service & Semantic Layer 

• Designing BI-ready data products for Tableau and OAS including extracts, live connections, semantic models, RLS, and governed datasets. 

• Expertise in semantic layer modeling and supporting certified datasets for enterprise analytics consumption. 

Security, Privacy & Compliance 

• Ensure designs align to secure coding practices, threat modeling, and enterprise privacy expectations. 

DevOps, SDLC/STLC & Deployment Practices 

• Deep understanding of SDLC and STLC within data engineering and BI workflows. 

• Experience with Source Control 

• Ensures deployments are stable, repeatable, and maintain environment consistency across dev/uat/prod. 

Performance, Scalability & Reliability 

• Designs data pipelines and models capable of handling largescale data volumes with performance SLAs. 

• Ensures architectures support day-to-day operational ease: observability, alerting, runbooks, job dependencies, and troubleshooting workflows. 

• Incorporates resilience, fault tolerance, and system stability into all designs. 

Leadership & Influence Skills 

• Leads complex, cross-team initiatives and serves as the primary architectural authority for projects. 

• Establishes and enforces architectural standards, coding frameworks, and best practices used across teams. 

• Guides teams through largescale migrations (e.g., on-prem SQL/SSIS to cloud/Databricks; BI/semantic refactors). 

• Integrates business priorities, functional objectives, governance requirements, and platform constraints into holistic solution designs. 

• Coaches and mentors engineers and developers across the team; builds reusable patterns and architectural guardrails. 

• Represents department in architecture councils, review boards, workshops, and cross-department forums. 

• Makes balanced architectural decisions (performance, cost/TCO, security/privacy, supportability, scalability, timelines). 

Collaboration, Communication & Behaviors 

• Strong communicator that produces clear design docs, ADRs, standards, and recommendations consumable by technical and nontechnical stakeholders. 

• Facilitates structured connects and multistakeholder meetings; documents decisions and actions; respects calendar capacity (non-adhoc). 

• Systems thinker with a long-term lens: simplicity, predictability, consistency, and sustainability. 

• Reliability & ownership mindset that ensures solutions meet expectations for stability, supportability, and ease of day-to-day operations. 

Technical & Architectural Skills – Preferred but not required additional skills 

ETL/ELT Pipeline Design & Patterns 

• Proficiency in Spark and Python  

Cloud, Hybrid & OnPrem Data Systems 

• Hands-on experience with AWS S3 for storage layer design (partitioning, layout, security, lifecycle policies). 

• Databricks expertise: Delta Lake, cluster/job optimization 

• Familiarity with Kubernetes/EKS and Docker for containerized data workloads 

• Skilled in designing solutions that operate across on-prem + cloud hybrid ecosystems. 

BI, Self-Service & Semantic Layer 

• Designing BI-ready data products for Tableau and OAS including extracts, live connections, semantic models, RLS, and governed datasets. 

• Expertise in semantic layer modeling and supporting certified datasets for enterprise analytics consumption. 

Security, Privacy & Compliance 

• Strong working knowledge of PII handling, privacy standards, SDL, and secure architecture patterns (encryption, IAM, RLS/CLS). 

DevOps, SDLC/STLC & Deployment Practices 

• Experience with GitHub, PR reviews, branch strategies, and CI/CD pipelines for data platforms. 

Performance, Scalability & Reliability 

• Skilled in Spark, SQL, and Delta optimization techniques to reduce time, cost, and resource utilization. 

Primary Tools & Technologies 

SQL Server (on-prem); SSIS; AWS S3; EKS; Databricks (Workflows/Jobs); Tableau; Oracle Analytics Server (OAS); GitHub; Python; Spark (PySpark/SQL); PowerShell; SQL/TSQL; Kubernetes; Docker.