Azure Data Engineer

Description

We are seeking an experienced Azure Data Engineer to join our team in India. The ideal candidate will have a deep understanding of data engineering principles and a strong background in Azure technologies. You will be responsible for designing, implementing, and maintaining data pipelines that ensure the availability and reliability of data for analytics and business intelligence.

Responsibilities

• Design and implement data pipelines using Azure Data Factory and Azure Databricks.
• Develop and maintain data models in Azure SQL Database and Azure Synapse Analytics.
• Ensure data quality and reliability through data validation and cleansing techniques.
• Collaborate with data scientists and business analysts to understand data requirements.
• Monitor and optimize data processing workflows for performance and cost efficiency.
• Implement data security measures to protect sensitive information.
• Document data architecture and processes for future reference and compliance.

Skills and Qualifications

• 12-18 years of experience in data engineering or a related field.
• Strong proficiency in Azure services, especially Azure Data Factory, Azure Databricks, and Azure SQL Database.
• Experience with ETL processes and data integration techniques.
• Proficiency in programming languages such as Python, SQL, or Scala.
• Knowledge of data warehousing concepts and best practices.
• Familiarity with big data technologies like Azure HDInsight or Apache Spark.
• Experience with data modeling and schema design.
• Strong problem-solving skills and ability to work independently as well as part of a team.
• Excellent communication skills to effectively convey technical concepts to non-technical stakeholders.