Search by job, company or skills

Lead Data Engineer

  • Posted 23 hours ago
  • Be among the first 10 applicants

Job Description

Job Purpose:

Design, build, and optimize scalable data engineering solutions that enable reliable, high-performance data platforms. Lead the development of modern data pipelines, cloud-native architectures, and data infrastructure while collaborating with cross-functional teams to deliver robust, client-focused data solutions.

Who You Are:

  • 8+ years of experience in Data Engineering, with at least 2+ years in a Technical Lead or supervisory role
  • Prior experience working in software services, IT consulting, or agency environments, managing multiple client engagements
  • Strong proficiency in Python, SQL, and PySpark or Scala for large-scale data processing
  • Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its data ecosystem (e.g., AWS Glue, Redshift, EMR, Azure Data Factory, Synapse, GCP BigQuery)
  • Advanced experience working with modern data platforms such as Snowflake, Databricks, or Delta Lake
  • Strong expertise in designing and building scalable ETL/ELT pipelines and data transformation workflows
  • Experience with workflow orchestration tools such as Apache Airflow, dbt, or Prefect
  • Hands-on experience with real-time data streaming technologies like Apache Kafka or Spark Streaming
  • Good understanding of software engineering best practices, version control, testing, and CI/CD processes
  • Excellent communication and stakeholder management skills with the ability to lead technical discussions and mentor engineering teams

What Will Excite Us:

  • Experience designing enterprise-scale data platforms and modern cloud data architectures
  • Strong expertise in Databricks, Snowflake, or Delta Lake implementations
  • Experience building real-time data pipelines using Kafka, Spark Streaming, or similar technologies
  • Hands-on experience with DevOps and Infrastructure-as-Code tools such as Docker, Kubernetes, Terraform, GitHub Actions, Azure DevOps, or Jenkins
  • Experience optimizing data pipeline performance, scalability, reliability, and cost efficiency
  • Strong understanding of data governance, data quality, security, and performance optimization
  • Experience leading technical teams, conducting code reviews, and mentoring data engineers
  • Exposure to modern DataOps practices and automation frameworks
  • Ability to work across multiple client projects while ensuring high-quality delivery

What Will Excite You:

  • Opportunity to architect and build large-scale cloud-native data platforms for global clients
  • Work with modern technologies including Databricks, Snowflake, Kafka, Airflow, and leading cloud ecosystems
  • Lead technical initiatives while mentoring and growing high-performing engineering teams
  • Solve complex data engineering challenges involving large-scale data processing and real-time analytics
  • Collaborate with cross-functional teams in a fast-paced, innovation-driven environment
  • Competitive compensation, continuous learning opportunities, and significant career growth

Location: Ahmedabad (Work From Office)

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151691469

Similar Jobs

Remote

Skills:

GitSqlAwsdbt

Ahmedabad, India

Skills:

TerraformAnsibleMySQLPostgreSQLLogstashKafkaAWSFlywayOpenSearch