Senior Data Engineer

Role- Senior Data Engineer

Experience- 8-10 years

Location- Remote

Notice Period- Only Immediate joiners

Job Overview:

We are looking for an experienced Lead Data Engineer with 8-10 years of experience to join

the Professional Services team.

Key Responsibilities:

1. Data Integration and Management:

oLead initiatives for integrating, transforming, and managing large datasets.

oEnsure optimal data availability and performance.

2. Advanced SQL Queries:

oAnalyze and resolve data issues using complex SQL queries.

oProficient in writing ETL code.

3. Azure Data Factory:

oUse Azure Data Factory for orchestrating data workflows and pipelines.

oImplement cloud-based integration best practices.

4. Azure Pipelines Deployment:

oManage CI/CD pipelines to automate and streamline deployment processes.

5. Kubernetes Deployment:

oOversee deployment and management of data solutions in Kubernetes.

oEnsure application scalability, reliability, and security.

6. Python and Shell Scripting:

oDevelop scripts for data processing, automation, and system integration.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• 8-10 years of experience in data engineering and configuration management.

• Expertise in SQL, data warehousing, and cloud environments, preferably Microsoft

Azure.

• Hands-on experience with Azure Data Factory, Azure pipelines, Kubernetes, Python,

shell scripting, and Snowflake or similar technologies.

• Experience with extensive datasets and ETL code development for data import.

• Immediate availability is preferred.