Associate - Data Engineer-Data Engineering-Big Data Engineering

5-7 Years

Save

Early Applicant

Job Description

Required Skills & Experience

57 years of experience in data engineering, with at least 23 years of Databricks hands-on experience.
Strong expertise in Apache Spark (PySpark/Scala/SQL) and distributed data processing.
Solid experience with Delta Lake, Lakehouse architecture, and data modeling.
Hands-on experience with at least one cloud platform: Azure Data Lake, AWS S3, or GCP BigQuery/Storage.
Strong proficiency in SQL for data manipulation and performance tuning.
Experience with ETL frameworks, workflow orchestration tools (Airflow, ADF, DBX Workflows).
Good understanding of CI/CD, Git-based workflows, and DevOps practices.
Exposure to MLOps and MLflow is a strong plus.
Knowledge of data governance, cataloging, and security frameworks.