"This offshore Platform Engineer role focuses on administering and operating Databricks environments, including clusters, jobs, and workflows, to support enterprise Agentic AI solutions.
Key responsibilities include managing Unity Catalog for data governance, implementing CI/CD pipelines, and enforcing security and cost controls through cluster policies.
The engineer will also oversee Spark Structured Streaming pipelines, ensuring reliable data ingestion from messaging services like Kafka.
Monitoring platform health via Azure Monitor and Dynatrace, alongside troubleshooting performance and scaling issues, is critical to the role.
Candidates require 4+ years of Databricks/Spark experience, proficiency in Terraform and Git-based CI/CD, and strong skills in Python and SQL.
The position demands a bachelor’s degree, with preferred skills including Databricks certifications and familiarity with ITIL service management processes"