Data Engineer - Bangalore

Job Description

We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.

Key Responsibilities

• Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.
• Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.
• Implement containerisation and deployment using Docker and Kubernetes.
• Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.
• Ensure data quality, governance, monitoring, and performance optimisation.
  
  

Required Skills

AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins.

Note: Candidates must be comfortable working from the Bangalore office 4 days a week.

Skills: terraform,python,sql,aws kinesis,kafka,git,spark,docker,aws,snowflake,jenkins,ckad,databricks,airflow