ShanghaiFull TimeMid-levelPosted Today
Summary
This position is required for working on the data migration and ongoing support for data platform for Applied Machine Learning enterprise systems at Apple China. The main deliverables will be:• Work with SRE on setting up and testing/validating new cluster, pipelines, applications, frameworks, connectivity and privacy and governance
• Identify China specific datasets, migrate the datasets to China cluster
• Modify and enhance existing applications and frameworks for China cluster
Description
The offered position requires at least 5 years subsequent data engineering experience including the following:• Writing advanced SQL for large scale relational data warehouses and data lakes.
• Designing data pipelines for structured and semi-structured data.
• Programing data engineering solutions in Python, Java, or Scala.
• Working with distributed frameworks including Apache Kafka and Apache Spark and Flink
• Designing reporting solutions with Tableau, Streamlit or Superset.
Preferred Qualifications
Developing software system testing and validation procedures and documentation by writing efficient code that results in performant solutions;Conferring with data processing or project managers to obtain and refine system requirements.
Monitoring existing software to correct errors, adapt it to new platform requirements, and implement new functionality.
Minimum Qualifications
The offered position requires at least a bachelor's degree or equivalent in Computer Science, Information Systems, or a related field.The beneficiary has at least 5 years of subsequent data engineering experience across the required skills.
Architecting scalable data processing systems for real-time, near-real-time, and batch data pipelines.
Develop data engineering solutions in Python and advanced SQL.
Develop self service data engineering applications for business users.
Design complex Python, PySpark, SQL and data processing for large-scale data platforms including Snowflake and Apache Spark with SparkSQL.