T
AWS Data Engineer (Pyspark)_Indore,Pune,Hyderabad,,_6 to 9 yrs
Search Jobs
Search by job, company or skills
Search by job, company or skills
Key Responsibilities
ETL & Pipeline Development: Design and optimize scalable ETL batch pipelines in AWS for high performance and reliability.
Orchestration: Manage data workflows using tools like AWS Glue, MWAA, or Step Functions.
Data Processing: Develop large-scale processing jobs using PySpark while ensuring data quality and integrity.
Infrastructure as Code (IaC): Automate and manage AWS infrastructure using Terraform.
Containerization: Deploy and manage applications using Amazon EKS and Docker.
Required Skills & Qualifications
AWS Services: Hands-on expertise with Glue, S3, IAM, KMS, SNS, Athena, Lambda, SQS, CloudWatch, and EC2.
Programming: Proficiency in PySpark for complex data transformations.
Migration: Proven experience moving data from on-premises systems to AWS.
DevOps Tools: Skilled in Terraform for IaC and Docker/Containers for application packaging.
Job ID: 152955137
Skills:
Docker, Prometheus, Grafana, Kubernetes, Linux Server Administration
Skills:
Spring Boot, Automated Testing, Microservices, Angular, React, Typescript, Docker, Python, Authentication, Java, Django, Application Security, FastAPI, Rest Apis, Kubernetes, embeddings, LLM integration, vector databases, Retrieval-Augmented Generation, enterprise integration patterns, event-driven architecture, observability, NoSQL databases, prompt engineering, Generative AI solutions, agentic AI workflows
Skills:
snowflake , Automated Testing, Terraform, Databricks, Azure DevOps, security governance, Snowflake Roles, Databricks Unity Catalog, rbac, BICEP ARM, ABAC, observability
Skills:
PostgreSQL, Spring Boot, Angular, Nosql, React, Javascript, Docker, MySQL, AWS, Java, Hibernate, Css3, Sql, Jenkins, Git, Vue.JS, Gcp, Html5, MongoDB, Restful Apis, Jpa, Azure, Kubernetes, Microservices architecture, Red Hat OpenShift
Skills:
snowflake , Pyspark, Apache Spark, Databricks, Sql, ELT, Etl, Data Engineering concepts
