Job Description
Duties
Enhancements, new development, defect resolution and production support of ETL development using AWS native services.
Integrate data sets using AWS services such as Glue, Lambda functions.
Use AWS SNS to send emails and Alerts.
Author ETL processes using Python, Pyspark.
ETL process monitoring using CloudWatch events.
Connecting with different data sources like S3 and validating data using Athena.
Skills
Deep technical skills in AWS Glue (Crawler, Data Catalog): 5 years.
Hands on experience on Python: 2 years.
PL/SQL experience: 2 years.
CloudFormation and Terraform: 1 year.
CI/CD Github actions : 1 year
Good understanding of AWS services like S3, SNS, Secret Manager, Athena and Lambda: 1 years.
Additionally, familiarity with any of the following highly desirable: Jira, Github, Python, Snowflake.
Education
Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus
