T
Azure Databricks
Search Jobs
Search by job, company or skills
Search by job, company or skills
Locations:
Experience Range:
Must-Have
• 7+ years of experience in data engineering with strong expertise in Azure Data Lake, Databricks, and ADF.
• Hands-on expertise in SQL and PySpark or Scala for building complex ETL/ELT solutions.
• Proven track record with batch & real-time ingestion, Kafka, and large-scale big data processing.
• Experience with relational and NoSQL engines: SQL Server, Oracle, Azure SQL, and Cosmos DB.
• Experience with Informatica PowerCenter, Informatica IDMC, or equivalent cloud data integration tools.
Good-to-Have
• Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data).
• Experience with Azure DevOps (AzDO) and GitHub-based CI/CD pipelines.
• Practical usage of Copilot for data engineering and development productivity.
• Exposure to Generative AI / GenAI use cases in data platforms and analytics.
• Familiarity with Maestro or similar enterprise schedulers, and data tools like Precisely or equivalent.
Job ID: 152952421
Skills:
Spark SQL, Pyspark, SQL Server, Azure Databricks, Azure Sql, ELT, Azure Data Factory, Python, Etl, Azure DevOps, Lakehouse Architecture, Azure Data Lake Storage Gen2, GitHub Actions, Delta Lake
Skills:
Sql, Big Data Technologies, Azure Synapse Analytics, Azure Data Factory, Apache Spark, Pyspark, Azure Databricks, Spark SQL, Python, Terraform, ARM Templates, Data Mesh, Event Driven Architectures, ADLS Gen2, Infrastructure as Code, Delta Lake, Real Time Data Processing, Structured Streaming, Lakehouse Architecture, Medallion Architecture
Skills:
Data Modelling, Scala, Azure Databricks, Encryption, Sql, Azure Data Factory, Azure Synapse Analytics, Spark, Python, GDPR Principles, IaC, CI CD, Azure Data Lake Storage, rbac, Data Security Compliance
Skills:
Sql, Databricks, Azure Synapse Analytics, Azure Data Factory, Pyspark, Hive, Python, Azure Data Lake, Scala, Delta Lake, ADLS, ETL workflows, Data Validation
Skills:
data engineering , Spark SQL, Data Modeling, Pyspark, Performance Tuning, Apache Spark, Azure Databricks, Sql, Query Optimization, Python, Data Governance frameworks, Lakehouse Architecture, Medallion Architecture, ETL ELT pipeline development, Unity Catalog, Azure Data Factory ADF, batch and streaming data processing, Caching, Analytics data structures, Delta Lake, partitioning
