Senior Data Engineer

Job Title: Senior Data Engineer

Experience: 5+ Years

We are looking for a Senior Data Engineer with 5+ years of experience in designing and building scalable batch and streaming data platforms. The ideal candidate should possess strong expertise in Python, advanced SQL, and hands-on experience with Apache Spark and PySpark for distributed data processing. Experience with cloud platforms such as AWS, Azure, or GCP is essential. The role involves developing ETL/ELT pipelines, implementing data ingestion, transformation, validation, and publishing workflows, and designing data lake, lakehouse, and data warehouse solutions. Candidates should have expertise in data modelling, performance optimization, change data capture (CDC), schema evolution, orchestration, monitoring, and data quality frameworks. Strong experience in managing production-grade data pipelines, operational reliability, and collaboration with analytics, AI/ML, and application teams is required. Excellent problem-solving and communication skills are essential.

Skills: apache spark,python,aws,sql