This position is required for working on the data migration and ongoing support for data platform for Applied Machine Learning enterprise systems at Apple China. The main deliverables will be:
• Work with SRE on setting up and testing/validating new cluster, pipelines, applications, frameworks, connectivity and privacy and governance
• Identify China specific datasets, migrate the datasets to China cluster
• Modify and enhance existing applications and frameworks for China cluster
The offered position requires at least 5 years subsequent data engineering experience including the following:
• Writing advanced SQL for large scale relational data warehouses and data lakes.
• Designing data pipelines for structured and semi-structured data.
• Programing data engineering solutions in Python, Java, or Scala.
• Working with distributed frameworks including Apache Kafka and Apache Spark and Flink
• Designing reporting solutions with Tableau, Streamlit or Superset.