Exp: 6+ Years
Location: Noida (WFO)
Timings: Mon-Fri; 10:30 AM - 7:30 PM
About The Role
We are looking for an experienced Lead Data Engineer with strong technical expertise and proven leadership capabilities. The ideal candidate has 6+ years of experience in building large-scale data systems, is proficient in Python, SQL, PySpark, and Databricks, and has hands-on experience working with AWS or Azure cloud environments. This role involves leading a team of data engineers while driving architecture, best practices, and scalable data solutions.
Key Responsibilities
- Lead and mentor a team of data engineers to deliver end-to-end data solutions.
- Design, develop, and maintain ETL/ELT pipelines for ingestion, transformation, and analytics.
- Architect and manage scalable data lake and data warehouse environments.
- Build and optimize distributed data processing workflows using PySpark and Databricks.
- Collaborate with analytics, product, and data science teams to understand requirements.
- Define and implement best practices for coding standards, CI/CD, and data governance.
- Establish data quality checks and monitoring frameworks to ensure reliability.
- Troubleshoot performance bottlenecks and provide technical leadership across projects.
- Evaluate new tools and technologies to strengthen the organization's data capabilities.
Required Skills & Experience
- 6+ years of professional experience in data engineering.
- Strong skills in Python, SQL, PySpark, and Databricks.
- Hands-on experience with cloud platforms such as AWS or Azure.
- Proven experience leading or mentoring a data engineering team.
- Strong understanding of distributed computing principles.
- Experience in building scalable ETL/ELT pipelines.
- Knowledge of CI/CD processes and version control using Git.
- Experience with data modeling and data warehousing concepts.
Preferred Qualifications
- Certifications from Databricks, Snowflake, AWS, or Azure.
- Experience with orchestration tools such as Airflow, ADF, or Prefect.
- Familiarity with delta architecture and modern data stack tools.
- Experience working in Agile environments.
