Lead Data Engineer

Company Description

Tudip Technologies is a value-driven software services company that delivers innovative, high-quality, and scalable solutions tailored to meet business goals. Renowned for its expertise in web and mobile development, IoT, cloud infrastructure, and DevOps, Tudip provides practical solutions that drive success for clients. Focused on building enduring client relationships, the company ensures confidentiality and guarantees on-time, on-budget delivery. Tudip stands apart as a strategic consulting partner in defining comprehensive business processes and technology solutions for both small and large organizations.

Role Description

We are looking for an experienced Lead Data Engineer to design, build, and manage scalable data pipelines and platforms. The ideal candidate will lead the data engineering team, collaborate with cross-functional stakeholders, and ensure high-quality, reliable, and secure data solutions that support business and analytics needs. Hands-on experience with Databricks is mandatory for this role.

Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

7+ years of experience in data engineering or related roles

Mandatory hands-on experience with Databricks (Delta Lake, Databricks SQL, notebooks, jobs, workflows)

Strong experience with Apache Spark and distributed data processing

Proficiency in SQL and programming languages such as Python, Scala, or Java

Experience with cloud platforms (AWS, Azure, or GCP)

Expertise in data warehousing solutions (Snowflake, Redshift, BigQuery, etc.)

Experience with ETL/ELT tools and orchestration frameworks (Airflow, dbt, etc.)

Strong understanding of CI/CD, version control, and DevOps practices

Excellent leadership, communication, and problem-solving skills