Senior Data Engineer

Key Responsibilities:

Lead the conversion of Informatica workflows, mappings, and scripts into Databricks

notebooks and pipelines.

Validate business logic by reviewing existing Informatica jobs using Informatica Developer

tools.

Design and implement scalable data pipelines in Azure Databricks leveraging Delta Lake

and relational databases.

JOB DESCRIPTION:

Collaborate with onsite teams to ensure deliverables meet business requirements.

Perform unit testing and support QA teams during initial quality checks.

Optimize performance and reliability of migrated jobs.

Provide technical guidance to junior data engineers and contribute to best practices.

Required Skills & Experience

5+ years of experience in data engineering with strong expertise in Azure Databricks.

Proficiency in PySpark, SQL, and Databricks workflows.

Hands-on experience with Informatica PowerCenter or similar ETL tools.

Familiarity with Oracle and PostgreSQL databases.

Strong understanding of Delta Lake architecture.

Experience with Lake Bridge (formerly Blade Bridge) or similar migration automation tools

(highly desirable).

Knowledge of Azure services (Data Lake, Data Factory, Key Vault, etc.).

Ability to troubleshoot and optimize large-scale data pipelines.

Nice-to-Have Skills

Experience with .NET development (C#, Node.js) for auxiliary tasks.

Exposure to data migration projects involving hybrid architectures.

Familiarity with CI/CD pipelines and DevOps practices in Azure.

Soft Skills

Strong communication and collaboration skills for working with global and onsite teams.

Ability to work independently and mentor junior engineers.

Problem-solving mindset with attention to detail

EOE:

Our client is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: We are committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at our client are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. We will not tolerate discrimination or harassment based on any of these characteristics