Search by job, company or skills

3-5 Years
Not Disclosed
  • Posted 3 hours ago
  • Be among the first 10 applicants

Job Description

JOB DESCRIPTION

We are looking for a Data Engineer with 3–5 years of hands-on experience to join our DataStore Migration Factory team. The engineer will work on end-to-end migration of on-premises Data Lake workloads to an AWS-hosted Lakehouse, including data extraction, transformation, reconciliation, schema management, and performance optimization.

Must-Have Skills
  • 3–5 years of hands-on Data Engineering / development experience
  • Strong SQL and troubleshooting skills
  • Python or Java
  • Data Modeling, including SCD Type 2
  • Data Pipeline / Data Migration experience
  • AWS / Cloud Data Migration
  • Apache Spark
  • Snowflake and/or Apache Iceberg
  • Understanding of partitioning, clustering, and schema evolution
  • Experience with SDLC, CI/CD and Kubernetes (K8s)
Good-to-Have
  • Kafka
  • Hadoop – HDFS/Hive
  • Sybase IQ
  • FTP
  • Data formats: JSON, Avro, Parquet
Education

Bachelor's or Master's degree in Computer Science, Engineering, Applied Mathematics, or a related quantitative discipline.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Apache Iceberg

Parquet

AWS Cloud Data Migration

Schema Evolution

CI/CD

Hadoop – HDFS Hive

Kubernetes (K8s)

Similar Jobs

6-10 yrs
Bengaluru, India
Skills:
Agile Methodologies, Pyspark, Sql, Big Data Technologies, Microservices, Git, Gcp, Apache Kafka, Spark, Rest Apis, Azure, Python, AWS, Kafka Connect, CI CD tools, ETL ELT pipelines, Kafka Streams
5-8 yrs
Bengaluru, India
Skills:
BigQuery, Pyspark, Dataproc, Data Modeling, Sql, ELT, Git, Python, Etl, GCP data services, Cloud Dataflow, Pub Sub, Cloud Composer, CI CD tools, performance optimization, partitioning, GCS
6-8 yrs
Bengaluru, India
Skills:
Azure Data Factory (ADF), T-sql, Data Warehouse Concepts, Pyspark, SQL Server, Sql, Git, Python, Star Schema, Azure DevOps, Generative AI, AI-Assisted Development, Claude Claude Code, Fact Dimension modeling, Azure SQL Database, Stored Procedures, CI/CD, Microsoft Fabric
7-11 yrs
Bengaluru, India
Skills:
PostgreSQL, Sql, ELT, Python, Etl, canonical data modeling, orchestration tools, data contracts, AI coding assistants, lakehouse concepts, data-quality validation, cloud data platforms, config-driven architecture
3-5 yrs
Bengaluru, India
Skills:
Machine Learning, Sql, Automated Testing, Deep Learning, DevSecOps, Terraform, Databricks, MongoDB, Oracle, Aws S3, Agile SCRUM methodologies, Batch-based manufacturing processes, Relational Databases, Source-code versioning, Data Science workflows