AWS Data Engineer

Roles and Responsibilities:

Technical Skills :

Must have Strong experience in AWS Data Services like Glue , Lambda, Even bridge, Kinesis, S3/ EMR , Redshift , RDS, Step functions, Airflow & Pyspark

Strong exposure to IAM, Cloud Trail , Cluster optimization , Python & SQL

Should have expertise in Data design, STTM, understanding of Data models , Data component design, Automated testing, Code Coverage, UAT support , Deployment and go live

Experience with version control systems like SVN, Git.

Create and manage AWS Glue crawlers and jobs to automate data cataloging and ingestion processes across various structured and unstructured data sources.

Strong experience with AWS Glue building ETL pipelines, managing crawlers, and working with Glue data catalogue.

Proficiency in AWS Redshift designing and managing Redshift clusters, writing complex SQL queries, and optimizing query performance.

Enable data consumption from reporting and analytics business applications using AWS services (ex: QuickSight, Sagemaker, JDBC / ODBC connectivity, etc.)