Search Jobs

Search by job, company or skills

Lead Data Engineer

Lead Data Engineer

Kanerika Inc
Early Applicant
  • Posted 11 days ago
  • Be among the first 10 applicants

Job Description

Role:

We are looking for a Data Engineer Lead with 8+ years of experience in designing and implementing modern data platforms, ETL/ELT pipelines, and cloud-based analytics solutions. The role requires strong expertise in Microsoft Fabric, Databricks, Snowflake, and Power BI, along with proficiency in SQL and Python/Scala. The candidate will lead data architecture initiatives, optimize data lake and warehouse solutions, enforce data governance and security standards, and collaborate with business and analytics teams to deliver scalable, high-performance data solutions.

What You Will Do:

Following are high level responsibilities that you will play but not limited to:

  • Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes.
  • Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
  • Enable business analytics and self-service reporting through Power BI and other visualization tools.
  • Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions.
  • Implement and enforce best practices for data governance, data quality, and security.
  • Mentor and guide junior data engineers; establish coding and design standards.
  • Evaluate emerging technologies and tools to continuously improve the data ecosystem.

Required Qualifications:

  • Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
  • Bachelor's/Master's degree in Computer Science, Information Technology, Engineering, or related field.
  • 8+ years of experience in data engineering or data platform development, with at least 2–3 years in a lead or architect role.
  • Strong hands-on experience in one or more of the following:
  • Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse)
  • Databricks (Spark, Delta Lake, PySpark, MLflow)
  • Snowflake (Data Warehousing, Snow Pipe, Performance Optimization)
  • Power BI (Data Modeling, DAX, Report Development)
  • Proficiency in SQL and programming languages like Python or Scala.
  • Experience with Azure, AWS, or GCP cloud data services.
  • Solid understanding of data modeling, data governance, security, and CI/CD practices.

Preferred Qualifications:

  • Familiarity with data modeling techniques and practices for Power BI.
  • Knowledge of Azure Databricks or other data processing frameworks.
  • Knowledge of Microsoft Fabric or other Cloud Platforms.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

10-12 yrs
Hyderabad, India
Skills:
Azure Data Lake Storage (ADLS), Github, Data Factory, Power Bi, Pyspark, Data Governance, Data Warehouse, Sql, ELT, Spark, Databricks, Python, Azure DevOps, Etl, OneLake, Real-Time Intelligence, Azure AI Services, Dimensional data modeling, Microsoft Purview, CI/CD pipelines, Lakehouse, Synapse Analytics, Microsoft Fabric
10-12 yrs
Hyderabad, India
Skills:
Devops, Microsoft Tfs, T-sql, Pyspark, Data Lake, Visual Studio, Azure Databricks, SSIS, Advanced Python Programming, Delta Lake, Unity Catalog
10-12 yrs
Hyderabad, India
Skills:
snowflake , Git, Terraform, Openflow, PostgreSQL, Python, Sql, AWS, Apache Nifi, dbt
7-10 yrs
Hyderabad, India
Skills:
Data Factory (ADF), T-sql, Microsoft Tfs, Pyspark, Scala, Visual Studio, Azure Databricks, SSIS, Azure Sql, Devops, Spark, Data Lake, Advanced Python Programming, ADLS Gen2, Unity Catalog, Delta Lake
12-14 yrs
Hyderabad, India
Skills:
Apache Flink, Advanced Analytics, Agile Methodologies, Scala, Data Warehousing, Cosmos, Sql, Machine Learning, Apache Kafka, Data Transformation, Databricks, MongoDB, Azure, Python, Data security patterns, Ai, DataOps, ETL processes