Software Engineer II

Job Introduction: 

Designs and builds robust, scalable data pipelines and data platform solutions across Tekion's enterprise data platform. Works independently on complex data engineering features and systems while collaborating with peers to deliver high-quality, AI-assisted data products, optimize pipeline performance, and continuously improve data engineering practices. Brings a strong eye for data quality and builds pipelines that are end-to-end reconcilable by design.

Key Role and Responsibilities:

• Designs, develops, and maintains data pipelines, data models, and data platform services across the Bronze, Silver, and Gold layers.

• Writes clean, efficient, and well-documented transformation logic using dbt and Databricks Delta Live Tables (DLT), with a focus on scalability, maintainability, and data correctness.

• Participates in data architecture discussions and contributes to decisions around pipeline design, data modeling, and platform component design.

• Builds and enforces data quality checks at every layer of the pipeline, including schema validation, null checks, referential integrity, and business rule assertions, ensuring issues are caught early and never silently passed downstream.

• Designs pipelines with end-to-end reconciliation in mind, ensuring row counts, aggregates, and key metrics can be traced and validated from source systems through to Gold layer outputs.

• Monitors and responds to data quality alerts, investigates anomalies, performs root cause analysis, and drives permanent fixes rather than temporary patches.

• Develops and maintains data quality SLAs and works with upstream data owners to resolve source-level issues that impact downstream data products.

• Develops and maintains data quality checks, pipeline tests, and end-to-end validation to ensure data product reliability and accuracy.

• Collaborates with cross-functional teams including business stakeholders, analysts, and product managers to gather requirements and translate them into well-defined data products.

• Troubleshoots production pipeline failures and supports root cause analysis to drive platform reliability and SLA adherence.

• Builds and maintains analytical dashboards using Tableau or Databricks AI/BI, enabling self-serve insights for business teams.

• Designs, builds, and optimizes Databricks Genie spaces to support natural language querying of Gold layer data.

• Develops and optimizes AI agents and data agents, leveraging AI coding assistants to accelerate pipeline development and reduce time to delivery.

Basic Qualifications:

• 4 to 6 years of experience in data engineering or a closely related discipline

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field

• Hands-on experience building and operating data pipelines on Databricks or an equivalent AI-first data platform

• Proficiency in Python and SQL; experience with dbt and Databricks Delta Live Tables (DLT) for real-time and near-real-time pipeline development

• Experience designing and implementing data quality frameworks including schema validation, null and duplicate checks, referential integrity enforcement, and business rule assertions

• Demonstrated ability to build end-to-end reconcilable pipelines where row counts, aggregates, and key metrics can be validated at every stage from source to Gold

• Experience with relational and/or NoSQL databases, REST APIs, and cloud-based data services

• Strong understanding of lakehouse architecture, data modeling, testing practices, and CI/CD pipelines for data workflows

• Demonstrated ability to build and optimize Databricks Genie spaces and AI/BI dashboards for business consumption

• Experience building, deploying, and optimizing AI agents, with the ability to use AI coding agents efficiently to accelerate development

• Ability to understand business requirements, engage confidently with stakeholders, and translate those requirements into reliable data products

• Strong communication and collaboration skills across both technical and non-technical audiences

Perks and Benefits