Associate/Jr Data Engineer - Data Engineering

Job description

Experience : 2 Years

Responsibilities :

• Develop and optimize scalable data pipelines for efficient data migration from relational databases to data lakes and data warehouses.
• Design, build, and manage ETL processes to support business needs and ensure high data availability.
• Perform complex data transformations using SQL and Spark to enable insightful data analysis.
• Conduct performance tuning to improve the speed and reliability of data pipelines.
• Implement data validation and quality checks to ensure data integrity and accuracy throughout the migration process.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver high-quality solutions.
• Troubleshoot and resolve issues in data pipelines and ETL processes to minimize downtime and maintain data consistency.