Description
We are seeking a highly experienced Director of Data Engineering to lead our team of data engineers and develop scalable, robust, and efficient data solutions. The ideal candidate will have 10-20 years of experience in the job market context of India, and will be responsible for managing the design, development, testing, and deployment of data engineering solutions.
Responsibilities
- Lead a team of data engineers to develop and implement data engineering solutions
- Design and develop scalable, robust, and efficient data pipelines to support business needs
- Ensure data quality and integrity by developing and implementing data validation and cleansing processes
- Collaborate with cross-functional teams to identify and prioritize data engineering requirements
- Manage and optimize data storage and retrieval solutions
- Stay up-to-date with emerging data engineering technologies and trends, and recommend new tools and technologies to improve data engineering processes
Skills and Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 10-20 years of experience in data engineering, with at least 5 years in a management role
- Experience with big data technologies such as Hadoop, Spark, and Kafka
- Proficiency in programming languages such as Python, Java, or Scala
- Experience with data warehousing and ETL tools such as Informatica, Talend, or DataStage
- Strong understanding of database technologies such as SQL, NoSQL, and Oracle
- Experience with cloud-based data solutions such as AWS, Azure, or Google Cloud Platform
- Excellent leadership, communication, and collaboration skills
- Strong problem-solving and analytical skills
