AWS Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Key Responsibilities
. Design, develop, and maintain scalable data pipelines using PySparkon AWS.
. Build and orchestrate ETL/ELT workflows using AWS Glueand AWS Step Functions.
. Develop serverless applications and automation using AWSLambda.
. Write clean, efficient, and maintainable Python/PySpark codefollowing engineering best practices.
. Provision and manage cloud infrastructure using Terraform(Infrastructure as Code).
. Implement and maintain CI/CD pipelines to automate codedeployment, testing, and infrastructure changes.
. Monitor, troubleshoot, and optimize data pipelines forperformance, reliability, and cost efficiency.
. Collaborate with business stakeholders to deliver datasolutions.
. Follow DevOps, security, and coding standards throughout theengagement.
Required Skills
. Strong hands-on experience with PySpark and Python fordata engineering.
. Experience developing ETL pipelines using AWS Glue.
. Proficiency with AWS Step Functions for workfloworchestration.
. Experience building serverless solutions using AWS Lambda.
. Hands-on experience with Terraform for Infrastructure asCode (IaC).
. Experience implementing CI/CD pipelines using tools suchas GitLab, GitHub Actions, Jenkins, or similar.
. Good understanding of AWS services, data lakes, IAM, S3,CloudWatch, and monitoring.
Headquartered in Singapore and offices in Malaysia and India, we partner with the multinational companies to provide comprehensive cutting edge technology and business process outsourcing solutions. We aims to be a premier international technology and BPO services and solutions company by providing the best value to clients, employees and associates in an honest, open and ethical environment.
We provide services to many of the world’s leading companies. We are committed to creating positive long term outcomes for our clients.
Our core value is our customer orientation and this value permeates across our entire organization. We strongly believe that strong focus towards customers and their needs is critical to our long-term growth and success. Our success has always been measured on our ability to satisfy our customers and exceed their expectations on an on-going basis.
Job ID: 151802411
Skills:
Aws Lambda, Amazon Kinesis, Amazon S3, Scala, AWS Glue, Sql, Amazon Redshift, Python, Amazon EventBridge, AWS Step Functions, AWS Lake Formation, AWS AppFlow
Skills:
Aws Lambda, Amazon S3, Scala, Amazon Kinesis, AWS Glue, Sql, Amazon Redshift, Python, Amazon EventBridge, AWS Step Functions, AWS Lake Formation, AWS AppFlow
Skills:
Aws Lambda, S3, Aws Services, Pyspark, AWS Glue, Sql, Jenkins, Cloudwatch, Terraform, Iam, Gitlab, Data Modelling, AWS, Airflow, AWS Step Functions, GitHub Actions, data lakes, dbt, CI CD pipelines, Lakehouse data lake architecture
Skills:
S3, Aws Lambda, Aws Services, Pyspark, AWS Glue, Jenkins, Cloudwatch, Terraform, Iam, Gitlab, Python, AWS Step Functions, Monitoring, CI CD, data lakes, GitHub Actions
Skills:
Aws Lambda, Amazon S3, Scala, Amazon Kinesis, AWS Glue, Data Governance, Sql, Metadata Management, Amazon Redshift, Python, Amazon EventBridge, AWS Step Functions, AWS Lake Formation, AWS AppFlow, Data cataloguing
