Key Skills:
Technical Skills:
- Proficiency with Data bricks Lakehouse platform, Delta Lake, Genie, ML Flow (e.g., Data bricks Certified Data Engineer Associate) is a plus.
- SQL and NoSQL: Experienced working with both SQL and NoSQL data sources (e.g., MySQL, PostgreSQL, MongoDB etc.)
- Strong knowledge of Spark, especially in PySpark or Scala, for data transformation.
- Proficiency in Python, R and other programming languages used in data processing.
- Experience with cloud platforms like Azure, AWS, particularly Azure storage & services
- Knowledge of ML Pipelines, data streaming platforms (e.g., Apache Kafka, AWS Kinesis).
- Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker)
Educational Qualification:
- Education: Bachelors degree in Computer Science, Engineering/MCA, or a related field (Masters preferred)
- 3+ years of experience as a Data Engineer, with hands-on experience in Databricks
