Search by job, company or skills

Azure Databricks Engineer

Azure Databricks Engineer

Tata Consultancy Services
6-10 Years
Not Disclosed
  • Posted an hour ago
  • Be among the first 10 applicants

Job Description

Position - Azure Databricks Engineer

Skill Set - Azure Databricks, Pyspark, ADF, SQL,Devops

Experience - 6 - 10 years

Location - Bangalore / Chennai

Notice Period - Immediate Joiner

Job Descriptions :

  • Design, develop, and optimize scalable batch and streaming data pipelines using Azure Databricks.
  • Develop data processing frameworks using PySpark and Spark SQL.
  • Implement Delta Lake-based storage solutions to ensure high reliability and data consistency.
  • Build and maintain Bronze, Silver, and Gold data layers within a Lakehouse architecture.
  • Ingest data from APIs, databases, Azure storage, and streaming platforms.
  • Develop scalable data models supporting analytics and reporting requirements.
  • Implement data quality, validation, and reconciliation processes.
  • Monitor and optimize Spark workloads for performance and cost efficiency.
  • Establish and support data governance practices through Unity Catalog and related solutions.
  • Orchestrate and integrate data workflows using Azure Data Factory, Airflow, and Databricks Workflows.
  • Collaborate with business and technical stakeholders to gather requirements and deliver enterprise-grade data solutions.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

8-12 yrs
Bengaluru, India
Skills:
Pyspark, Azure Databricks, Data Modeling, Data Governance, Python, Data Quality, Data Warehousing, Sql, Azure Data Factory, MLops, Lakehouse architecture, Generative AI, Delta Lake, ETL ELT pipelines, AI ML technologies
5-8 yrs
Bengaluru, India
Skills:
Pyspark, Azure Databricks, Sql, Git, Data Quality Governance, ADLS Gen2, Medallion Architecture, DLT, Auto Loader, Unity Catalog, Delta Lake, Structured Streaming, CI-CD, Databricks Workflows
6-12 yrs
Bengaluru, India
Skills:
Pyspark, Azure Databricks, Sql, ELT, Git, Azure Data Factory, Data Warehousing, Etl, Medallion Architecture, CI CD, Azure Data Lake Storage, Delta Lake
5-8 yrs
Bengaluru, India
Skills:
Spark SQL, Pyspark, SQL Server, Azure Databricks, Azure Sql, ELT, Azure Data Factory, Python, Azure DevOps, Etl, Lakehouse Architecture, Azure Data Lake Storage Gen2, GitHub Actions, Delta Lake
5-15 yrs
Bengaluru, India
Skills:
snowflake , Denodo, Adf, Databricks, Sql, Python