Data Engineer III - Python/PySpark/Databricks/AI

Job responsibilities

• Supports review of controls to ensure sufficient protection of enterprise data
• Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request
• Updates logical or physical data models based on new use cases
• Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
• Uses enterprise-authorized AI capabilities within the work environment to accelerate data pipeline/design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
• Applies reuse-first, AI-assisted practices to strengthen SDLC-quality routines for data pipelines (e.g., test generation and control validation), ensuring traceability/auditability and alignment to resiliency and security expectations.

Required qualifications, capabilities, and skills

• Formal training or certification on data engineering concepts and 3+ years applied experience
• Experience across the data lifecycle
• Advanced at SQL (e.g., joins and aggregations)
• Working understanding of NoSQL databases
• Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
• Ability to review and validate AI-assisted outputs (e.g., query suggestions, test ideas, or model change summaries) before use, escalating when uncertain and following data handling requirements.
• Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
• Experience customizing changes in a tool to generate product

• Exposure to cloud technologies
• Exposure to AI Driven development