Bangalore, Karnataka, IndiaFull TimePosted Today
Required Skills
- Strong experience in Python programming.
- Hands-on expertise with PySpark for large-scale data processing.
- Experience with Google Cloud Platform (GCP) services:
- BigQuery
- Dataproc
- Dataflow
- Cloud Storage
- Pub/Sub
- Cloud Composer (Airflow)
- Strong SQL skills and experience with relational databases.
- Experience building batch and real-time data pipelines.
- Good understanding of Data Lake and Data Warehouse concepts.
- Knowledge of distributed computing and Spark optimization techniques.
- Experience with Git, CI/CD pipelines, and Agile methodologies.