Search by job, company or skills

Data Engineer (Databricks)

  • Posted 10 days ago
  • Over 50 applicants have applied

Job Description

Job Title: Data Engineer

Experience: 3–6 Years (Mid-Level)

Job Location: Hyderabad, India

Job Summary

OSI Digital is looking for a Data Engineer with strong expertise in Azure Databricks, PySpark, SQL, and Power BI to build scalable data pipelines and analytics solutions. The ideal candidate will design modern Lakehouse architectures, transform raw data into actionable insights, and develop high-performance reporting solutions.

Responsibilities

  • Design and develop end-to-end data pipelines using Azure Databricks and PySpark
  • Build and optimize Delta Lake tables using Medallion Architecture (Bronze, Silver, Gold)
  • Develop scalable ETL/ELT workflows for large-scale data processing
  • Create interactive Power BI dashboards and reports using DAX and Power Query
  • Write and optimize SQL queries for data transformation and analytics
  • Collaborate with business analysts to translate business requirements into technical solutions
  • Ensure data quality, performance, and scalability across data platforms
  • Support deployment, monitoring, and troubleshooting of data engineering solutions

Required Skills

  • 3–6 years of experience in Data Engineering
  • Strong expertise in Python, PySpark, and Spark SQL
  • Hands-on experience with Azure Databricks, Delta Lake, Unity Catalog, and Delta Live Tables
  • Experience with Azure Databricks Workflows and Lakehouse architecture
  • Strong SQL development and query optimization skills
  • Expertise in Power BI, DAX, and Power Query
  • Strong analytical, troubleshooting, and communication skills

Good To Have

  • Experience with Azure Data Factory, Azure Synapse Analytics, or Azure Data Lake
  • Knowledge of CI/CD and DevOps practices for data platforms
  • Microsoft Azure Data Engineering Certification
  • Experience working in Agile/Scrum environments

We Are Not Looking For Someone Who

  • Has never worked directly with business stakeholders
  • Lacks hands-on experience with Azure Databricks and PySpark
  • Has limited exposure to Power BI and SQL-based data analytics

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151356419

Similar Jobs

Hyderabad, India

Skills:

RangerYarnImpalaHiveGcpTerraformAnsibleKerberosSparkOozieDatabricksAzureTlsAWSInfrastructure as CodeATLASChefHDFSDelta LakeCloudera CDP

Hyderabad, India

Skills:

Machine LearningData ModellingArtificial IntelligenceSoapJsonSqlRESTDatabricksVersion Control SystemsPythonAWSEtlData PipelinesReporting and Visualization tools

Hyderabad, India

Skills:

Spark SQLYamlPysparkJsonSqlJenkinsGitBitbucketDockerDatabricksRest ApisPythonCI CDUnity CatalogDatabricks Asset BundlesDelta LakeDatabricks Workflows

Hyderabad, India

Skills:

Spark SQLYamlPysparkJsonSqlJenkinsGitBitbucketDockerDatabricksRest ApisPythonCI CDUnity CatalogDatabricks Asset BundlesDelta LakeDatabricks Workflows

Hyderabad, India

Skills:

snowflake PysparkKafkaSqlKinesisTerraformDatabricksRest ApisAzurePythonAWSAirflowEvent HubDelta Live TablesUnity CatalogdbtCI CD pipelines