Senior Data Engineer
Senior Data Engineer
Team Geek SolutionsThis job is no longer accepting applications
Job Description
Position: Senior Data Engineer
Location: Chennai / Pune / Bangalore / Hyderabad
Working Type: WFO
Shift: UK Shift (2:00 – 11:00 PM)
Notice Period: Immediate Joiner/Serving Notice Period
Job Description:
Key Responsibilities
Required Qualifications:
Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
Manage large-volume ingestion and backfill operations
Implement Bronze to Silver transformation pipelines
Develop incremental load and CDC logic
Optimize Lakehouse performance and storage patterns
Implement monitoring (record counts, load duration, failure tracking)
Support Dev/Test/Prod promotion processes
Required Qualifications
Location: Chennai / Pune / Bangalore / Hyderabad
Working Type: WFO
Shift: UK Shift (2:00 – 11:00 PM)
Notice Period: Immediate Joiner/Serving Notice Period
Job Description:
Key Responsibilities
Required Qualifications:
Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
Manage large-volume ingestion and backfill operations
Implement Bronze to Silver transformation pipelines
Develop incremental load and CDC logic
Optimize Lakehouse performance and storage patterns
Implement monitoring (record counts, load duration, failure tracking)
Support Dev/Test/Prod promotion processes
Required Qualifications
- 7+ years of data engineering experience
- Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory
- Strong experience with Fivetran or similar ELT tools
- Experience handling high-volume datasets (hundreds of millions of records)
- Proficiency in SQL, Python, and data modeling concepts
- Strong understanding of Medallion architecture.
More Info
Key Skills
About Company
Skills:
Pyspark, AWS Glue, Data Modeling, Emr, Avro, Autosys, Sql, Cloudwatch, Terraform, Etl Tools, Databricks, Python, AWS, Airflow, Parquet, AWS Lake Formation, Iceberg
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
Skills:
stream processing , snowflake , Graphql, Apis, Kafka, Sql, ELT, REST, Spark, Databricks, Python, AWS, Etl
Skills:
Devops, Machine Learning, Pyspark, Apache Spark, Azure Databricks, Sql, Python, Azure Synapse SQL Server, Generative AI, RAG frameworks
Skills:
Java, Scala, Restful Apis, Sql, Python, Kubernetes, big data engineering