Summary:
The
Senior Data Engineer will play a pivotal role in driving the creation of innovative AI solutions within a collaborative and agile team environment. The primary objective is to develop efficient data architectures and scalable data pipelines to support analytics and machine learning applications.
Responsibilities:
- Collaborate with product managers, designers, and engineers to build AI-enabled product features.
- Design, build, and maintain scalable data pipelines and ETL/ELT workflows.
- Develop and optimize data models and storage solutions for analytics and machine learning.
- Implement monitoring and validation tools to ensure data quality and reliability.
- Integrate modern data technologies to enhance the data ecosystem.
- Engage in code reviews and promote data engineering best practices.
- Stay updated on emerging data technologies and industry trends.
Key Requirements:
- 7+ years of experience as a Data Engineer or similar role.
- Proven track record in building scalable data platforms and pipelines.
- Hands-on experience with data orchestration tools like Airflow.
- Expertise in Python, with additional skills in SQL, Scala, or Java.
- Experience with data modeling and management, including SQL and NoSQL databases.
- Proficiency in cloud-based data infrastructure management (specifically Azure Fabric).
- Knowledge of modern data frameworks such as Spark or Databricks.
- Understanding of AI/ML data needs and MLOps workflows.
- Experience with streaming and real-time systems like Kafka, Kinesis, etc.
Nice to Have:
- Knowledge of distributed systems and data governance.
- Agile experience, particularly with SCRUM methodologies.
- Familiarity with project management tools like JIRA or Trello.
- Cloud certifications (a plus).
- Fluency in English, proficiency in French (a plus).
Other Details:
- Location: Pune, India (Hybrid working model - 3 days in office)
- Reporting Line: Reports to the Technical Lead
- Working Hours: CET Timezone
