Data Engineer – Claims Data & AI Enablement Senior Consultant II

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

The Data Engineer supports the design, development, and delivery of scalable data solutions that power claims analytics, reporting, and AI-driven initiatives at Allstate. This role supports making structured and unstructured data available and usable to enable advanced analytics, reporting, and data science solutions, including emerging AI use cases. This role executes moderately complex workstreams and contributes to the development of data solutions under guidance from senior team members.

Key Responsibilities

• Develop and enhance data ingestion, transformation, and processing workflows across batch and transactional environments.
• Contribute to solutions that ingest, store, and process structured and unstructured data to support analytics and data science use cases, including select AI-driven applications.
• Prepare and deliver curated data sets to support advanced analytics, reporting, and data science initiatives, including machine learning and emerging AI capabilities.
• Works within defined work tracks and partners with team members to deliver data solutions aligned to business and analytics needs.
• Leverages best practices and receives coaching to support solution development and delivery .
• Integrate data from claims systems, APIs, databases, and third-party platforms to create consistent, accessible data assets.
• Contribute to scalable data solutions that support claims reporting, operational insights, and decision-making.
• Apply version control, testing, CI/CD, and monitoring to ensure high-quality, reliable data pipelines.
• Partner with data scientists, analysts, and technology teams to understand requirements and support analytics, reporting, and data science use cases, including AI where applicable.
• Identify opportunities to improve data access, performance, and scalability while supporting evolving AI and data platform needs.

Education

• Masters Degree/Bachelor Degree (Mandatory)

Primary Skill-

• 8 or more years of experience (Preferred)
• Experience working with claims or insurance data (Preferred)
• Exposure to unstructured data pipelines (e.g., text, audio, image processing) (Preferred)
• Familiarity with orchestration tools such as Airflow or Dagster (Preferred)
• Experience supporting AI/ML or generative AI initiatives (Preferred)
• Experience with modern data platforms (e.g., Lakehouse, Microsoft Fabric) (Preferred)

• In lieu of the above education requirements, an equivalent combination of education and experience may be considered.

FUNCTIONAL SKILLS

• Experience building or supporting data pipelines and ETL/ELT processes
• Proficiency in Python and SQL, with familiarity in Spark or similar frameworks
• Experience working with cloud data platforms such as AWS, Azure, or Microsoft Fabric
• Understanding of structured and unstructured data processing concepts
• Knowledge of data modeling and relational databases
• Familiarity with DevOps and CI/CD practices
• Strong problem-solving and collaboration skills

Primary Skills

Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others

Shift Time

Recruiter Info

Hiral Parag Rughani

hparb@allstate.com

About Allstate

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger – a winning team making a meaningful impact.

The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.

Learn more about Allstate India here.