AWS Data Pipeline Engineer

Roles and Responsibility

• Managing data storage solutions on AWS, including Amazon S3, Amazon Redshift, and Amazon DynamoDB.
• Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR, and AWS Lambda.
• Collaborating with Spotfire Engineers and business analysts to ensure data accessibility and usability for analysis and visualization.
• Working with other engineers and business stakeholders to understand requirements and deliver solutions.
• Writing code in languages like SQL, Python, or Scala to build and maintain data pipelines and applications.
• Using Infrastructure as Code (IaC) tools to automate the deployment and management of data infrastructure.

Job Requirements

• Strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework.
• Experience with data pipeline design and development using AWS services.
• Knowledge of SQL, Python, or Scala programming languages.
• Familiarity with Infrastructure as Code (IaC) tools.
• Understanding of data integration and workflow optimization techniques.
• Ability to work closely with data engineers and other stakeholders to understand data requirements.