Lead Data Engineer

Description

We are seeking a Lead Data Engineer to join our dynamic team in India. The ideal candidate will have extensive experience in designing and managing data systems and will play a crucial role in driving our data strategy. This position requires a strong technical background, leadership skills, and a passion for data-driven decision-making.

Responsibilities

• Design, implement, and maintain scalable data pipelines and architectures.
• Collaborate with data scientists and analysts to understand data needs and ensure data quality.
• Optimize data storage and retrieval processes for performance and efficiency.
• Lead data governance initiatives to ensure compliance with data privacy regulations.
• Mentor and guide junior data engineering team members.
• Evaluate and integrate new data technologies and tools into existing systems.
• Perform data modeling and create data flow diagrams to visualize data architecture.

Skills and Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 8-15 years of experience in data engineering or related fields.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Proficient in SQL and experience with relational databases like MySQL, PostgreSQL.
• Familiarity with data warehousing solutions like Amazon Redshift, Google BigQuery, or Snowflake.
• Knowledge of data modeling techniques and ETL processes.
• Experience with cloud platforms such as AWS, Google Cloud, or Azure.
• Strong problem-solving skills and ability to work in a fast-paced environment.