Job Description
Data Engineer
Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors.
Create, build, and maintain data processing systems and pipelines on AWS, using services like Glue, EMR, Lambda, and S3
Construct and manage data warehouses and data lakes using AWS services such as Redshift, Lake Formation, and Glue.
Develop and maintain Extract, Transform, and Load (ETL) processes using AWS Glue and Lambda.
Implement data governance and security policies, and ensure data is clean, reliable, and optimized for analysis.
Work with cross-functional teams, including data scientists and business analysts, to understand data requirements and build solutions.
S3
Glue streaming
EMR
Spark
ETL Concepts
