Data Engineer

An Azure Data Engineer designs, builds, and manages scalable data pipelines and cloud storage solutions on the Microsoft Azure platform.

Location- Chn/blr/hyd

Core Responsibilities

• Pipeline Development: Build and maintain ETL/ELT workflows using Azure Data Factory to move data from various sources into centralized storage.
• Data Processing: Transform, clean, and aggregate large datasets using Azure Databricks, Spark, and PySpark.
• Storage Management: Configure and optimize data lakes and warehouses via Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
• Performance & Quality: Monitor pipeline performance, troubleshoot query execution, and ensure data integrity and security (RBAC, encryption).

Key Skills & Tech Stack

• Languages: Advanced SQL and Python/PySpark.
• Azure Services: ADF, ADLS Gen2, Databricks, Synapse Analytics, and Stream Analytics.
• Data Modeling: Dimensional modeling, star/snowflake schemas, and data warehousing concepts.
• DevOps: Git version control and CI/CD pipeline integration.

If you are tailoring a resume or drafting a specific job posting, tell me:

• The experience level required (Junior, Mid-level, Senior)
• Any specific industry tools to include (like Snowflake, Terraform, or Kafka)