Description
We are seeking a skilled AWS Data Engineer with 8-10 years of experience to join our dynamic team. The ideal candidate will be responsible for designing and implementing data pipelines and ETL processes on AWS to support our data-driven initiatives.
Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS.
- Implement data ingestion processes from various sources into data lakes and warehouses.
- Optimize data storage and retrieval for performance and cost efficiency.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
- Ensure data quality and integrity by implementing appropriate validation and monitoring systems.
- Automate repetitive tasks and processes to improve data engineering efficiency.
Skills and Qualifications
- 8-10 years of experience in data engineering or related field.
- Strong proficiency in AWS services such as S3, Redshift, Glue, Lambda, and EMR.
- Experience with ETL tools and frameworks, preferably AWS Glue or Apache Airflow.
- Proficient in SQL and experience with relational databases like PostgreSQL or MySQL.
- Familiarity with big data technologies such as Spark or Hadoop is a plus.
- Experience with programming languages such as Python or Java for data manipulation and automation.
- Knowledge of data modeling, data warehousing concepts, and data architecture best practices.
- Strong analytical and problem-solving skills, with attention to detail.
