Description
We are seeking an experienced AWS Data Engineer to join our team in India. In this role, you will be responsible for designing and implementing robust data pipelines and ETL processes to support our data analytics initiatives. The ideal candidate will have a strong background in AWS technologies and a passion for working with large datasets.
Responsibilities
- Design and implement data pipelines using AWS services such as AWS Glue, AWS Lambda, and Amazon Redshift.
- Develop and maintain ETL processes to extract, transform, and load data from various sources.
- Optimize and monitor data storage and processing performance within AWS.
- Collaborate with data analysts and data scientists to understand data requirements and deliver appropriate solutions.
- Ensure data quality and integrity by implementing validation checks and error handling mechanisms.
- Document data processes and workflows for reproducibility and compliance.
Skills and Qualifications
- 6-10 years of experience in data engineering or a related field.
- Strong proficiency in AWS services including S3, RDS, DynamoDB, Redshift, and Glue.
- Experience with ETL tools and frameworks, preferably within the AWS ecosystem.
- Proficiency in programming languages such as Python, Java, or Scala.
- Solid understanding of SQL and experience with database management systems.
- Familiarity with data warehousing concepts and technologies.
- Experience with data modeling and data architecture best practices.
- Knowledge of big data technologies such as Apache Spark or Hadoop is a plus.
