ETL Developer

Summary We are looking for highly skilled Data Engineers with 3 to 5 years of experience in building and managing advanced data solutions. The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata and Google Cloud Platform (GCP).

Key Responsibilities

Be the part of the team towards design, development, and optimization of large-scale data pipelines, ensuring they meet business and technical requirements.

Implement data solutions using SQL, Ab-Initio, Teradata and GCP; ensuring scalability, reliability, and performance. Mentor and guide the colleagues in the development and execution of ETL processes and data integration solutions.

Take ownership of end-to-end data workflows, from data ingestion to transformation, storage, and accessibility.

Lead performance tuning and optimization efforts for complex SQL queries and Teradata database systems.

Design and implement data governance, quality, and security best practices to ensure data integrity and compliance.

Manage the migration of legacy data systems to cloud-based solutions on Google Cloud Platform (GCP).

Ensure continuous improvement and automation of data pipelines and workflows. Troubleshoot and resolve issues related to data quality, pipeline performance, and system integration.

Stay up-to-date with industry trends and emerging technologies to drive innovation and improve data engineering practices within the team.

Required Skills

4 to 6 years of experience in data engineering or related roles.

Strong expertise in SQL, Teradata, and Ab-Initio.

Proficient and good hands on experience in using the Ab-Initio development products - GDE, Conduct>IT, Control Center, Continuous Flows, EME, M-HUB, etc.

Hands-on experience over Unix/Shell scripting.

Proficient in scheduling and analyzing jobs using Autosys (or any similar) Scheduler. In-depth experience with Google Cloud Platform (GCP), including tools like BigQuery, Cloud Storage, Dataflow, etc.

Proven track record of leading teams and projects related to data engineering and ETL pipeline development.

Experience with data warehousing and cloud-native storage solutions.

Strong analytical and problem-solving skills.

Experience in setting up and enforcing data governance, security, and compliance standards. Preferred (good to have) Skills

Familiarity with other cloud platforms/services (AWS, Azure).

Familiarity with any other ETL tools like Informatica, Datastage, Alteryx, etc.

Knowledge of Big Data technologies like Hadoop, Spark, Hive, Scala, etc. Strong communication skills and the ability to collaborate effectively with both technical and non-technical teams.