Overview:
TekWissen is a global workforce management provider throughout India and many other countries in the world. The below client is a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place – one that benefits lives, communities and the planet
Job Title: Data Engineering Engineer III
Location: Chennai
Work Type: Hybrid (4 Days work From Office)
Position Description:
Roles & Responsibilities:
- Responsible for gathering business requirements and designing ETL systems to meet application needs
- Work closely with stakeholders to gather requirements and provide technical guidance on the migration process
- Collaborate with the data engineering teams to understand the existing JCL/ETL jobs and their dependency.
- Design and implement migration strategies for moving ETL to GCP native services.
- Develop, test, and deploy data pipelines and workflows, ensuring scalability, reliability, and performance
- Troubleshoot and resolve any production issues or challenges that arise during the migration
- Delivering product features as part of roadmap and business needs
- Lead in Effort estimation for the new developments and enhancements.
- Co-create test plan and lead execution and code deployment. Lead performance tuning to optimize the job execution.
- Responsible for validating, running, scheduling and monitoring jobs using data stage director
- Responsible for debugging Ticketing issues in the production phase
Skills Required:
- Big Query,, ETL, Google Cloud Platform
- Biq Query, Data Flow, Dataproc, Data Fusion,
- TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API
Experience Required:
- Engineer III Exp: 7+ years Data Engineering work experience
Experience Preferred:
- The candidate will be responsible for designing the transformation and modernization of big data solutions on the GCP cloud.
- The candidate must have experience leading large-scale solutions and the operationalization of data warehouses, data lakes, and analytics platforms on a cloud platform, GCP preferred.
- We seek individuals with a wide range of technology skills in these domains, capable of designing the right solutions using a mix of GCP and third-party technologies for deployment on the GCP cloud.
- 7+ years of Data Engineering experience
- 5+ years of Cloud experience (GCP preferred) with solutions designed and implemented at production scale
- Strong understanding of key GCP services, especially those related to data processing [Batch/Real Time] Big Query, Cloud Scheduler, Airflow, Postgres, Data Flow, Pub/Sub, Cloud Logging and Cloud Monitoring
- Experience with infrastructure as code Terraform/ GitHub
- Experience in design, development and implementation of data pipelines using Data Warehousing applications
- Experience in integrating various data sources like Oracle, Teradata, DB2, Big Query & Flat files
- Hands on experience in performance tuning and debugging ETL jobs
- Involving in review meetings and coordinating with the team in job designing and fine-tuning the job performance.
Education Required:
Education Preferred:
TekWissen® Group is an equal opportunity employer supporting workforce diversity.
