Data Engineer
Data Engineer
claidsphere solutions- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
JOB DESCRIPTION
We are looking for a Data Engineer with 3–5 years of hands-on experience to join our DataStore Migration Factory team. The engineer will work on end-to-end migration of on-premises Data Lake workloads to an AWS-hosted Lakehouse, including data extraction, transformation, reconciliation, schema management, and performance optimization.
Must-Have Skills- 3–5 years of hands-on Data Engineering / development experience
- Strong SQL and troubleshooting skills
- Python or Java
- Data Modeling, including SCD Type 2
- Data Pipeline / Data Migration experience
- AWS / Cloud Data Migration
- Apache Spark
- Snowflake and/or Apache Iceberg
- Understanding of partitioning, clustering, and schema evolution
- Experience with SDLC, CI/CD and Kubernetes (K8s)
- Kafka
- Hadoop – HDFS/Hive
- Sybase IQ
- FTP
- Data formats: JSON, Avro, Parquet
Bachelor's or Master's degree in Computer Science, Engineering, Applied Mathematics, or a related quantitative discipline.
More Info
Key Skills
Apache Iceberg
Parquet
AWS Cloud Data Migration
Schema Evolution
CI/CD
Hadoop – HDFS Hive
Kubernetes (K8s)



