Data Engineer

Senior Data Engineer (68 Years)

Location: Hyderabad Experience: 68 Years

Summary:

Seeking a Senior Data Engineer to architect Azure-based solutions, lead migrations, and mentor junior engineers. Must have deep expertise in Azure Synapse, Databricks, and Informatica PowerCenter.

Key Responsibilities:

Design end-to-end Azure data architecture (Synapse, Databricks, ADLS Gen2).

Lead migration from Informatica to Azure; perform complexity analysis.( Very Mantodotry)

Build advanced pipelines with PySpark, Spark SQL, and ADF.

Implement SCD, CDC, UPSERT/MERGE, and data quality frameworks.

Optimize performance and cost; design partitioning strategies.

Mentor team, enforce coding standards, and drive GitHub Copilot adoption.

Required Skills:

Expert in Azure Synapse, Databricks, PySpark, Spark SQL, ADF.

Hands-on Informatica PowerCenter experience.

Advanced SQL (Oracle, SQL Server, PostgreSQL).

Git/GitHub, CI/CD, Azure DevOps.

Knowledge of medallion architecture, data governance, security (RBAC, Key Vault).

Preferred:

Streaming (Kafka/Event Hubs), Terraform, Power BI, ML integration.

Domain knowledge: Insurance/Financial services.

Soft Skills:

Leadership, stakeholder communication, Agile collaboration.