Search by job, company or skills

Happiest Minds Technologies

SENIOR DATA ENGINEER - Azure Databricks

Save
new job description bg glownew job description bg glow
  • Posted 22 hours ago
  • Be among the first 30 applicants
Early Applicant

Job Description

We are seeking a hands on Data Engineer to build reliable scalable Databricks pipelines. You will translate requirements into production ELT or ETL jobs Delta Lake tables and reusable components. You will refine reference patterns optimize Spark for performance and cost apply Unity Catalog best practices orchestrate workflows and deliver high quality well documented code that empowers teams. Core qualifications include Bachelors degree in CS Engineering or related field and 5 years experience in software or data engineering with 2 years working with Databricks and Spark. Strong skills in Python SQL and PySpark required along with AWS or Azure knowledge. Experience with Databricks Lakehouse Workflows SQL and dbt preferred. Solid understanding of Lakehouse and data warehousing architecture AI or ML pipeline support and familiarity with Terraform or CloudFormation valued. Experience ingesting data using APIs preferred or strong understanding of APIs. Exposure to dbt and MLOps or DevOps is a plus.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 148677315

Similar Jobs

Bengaluru, India

Skills:

catalog AdfLoggingPysparkELTPythonAzure DevOpsWorkflowsVersion ControlTestingSqlDatabricksEtllineagedata quality frameworksobservability toolsdistributed data processing frameworksAccess Controldata governance conceptsMonitoringADLSNotebooksDelta LakeAzure data services