T
Data Engineer
T
- Posted 6 days ago
- Be among the first 20 applicants
Job Description
An Azure Data Engineer designs, builds, and manages cloud data pipelines, storage, and large-scale analytics solutions using Microsoft Azure services.
Exp-6+ years
Location-Chennai, Bangalore
Core Responsibilities
- Data Ingestion & Pipeline Development: Build automated ETL/ELT data pipelines using Azure Data Factory (ADF) to move data from various sources.
- Data Transformation & Processing: Process large datasets using Apache Spark via Azure Databricks or Azure Synapse Analytics.
- Data Modeling & Storage: Design data warehouses, data lakes (ADLS Gen2), and relational/NoSQL databases (Azure SQL, Cosmos DB).
- Monitoring & Governance: Ensure data quality, pipeline reliability, security, and compliance using tools like Azure Key Vault and DevOps.
Essential Tech Stack & Skills
- Languages: Advanced SQL, Python, or PySpark/Scala.
- Azure Services: Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, ADLS Gen2, Azure SQL, and Cosmos DB.
- DevOps & Tools: Git, CI/CD pipelines, and Azure DevOps.
- Certifications: Microsoft Certified: Azure Data Engineer Associate (Exam DP-203).
More Info
Key Skills
About Company
Skills:
S3, Aws Redshift, Pandas, Pyspark, AWS Glue, Python, Sql, Etl, ELT
Skills:
Adf, Scala, Data Warehousing, SQL Server, SSIS, Sql, azure devOPS, Git, Ssas, Spark, Data Governance, Data Lake, Databricks, Python, Etl, delta tables, unity catalog, CI CD workflows, OLAP Cubes, Security Architecture, R, Relational Databases
Skills:
snowflake , Data Architecture, Data Modeling, Linux Scripting, Adobe Analytics, Sql, Devops, Data Quality, Powerbi, Azure Data Lake, Databricks, Python, DBT framework, Azure Data Engineering
Skills:
BigQuery, Gcp, DataFlow, Sql, Python, Airflow, Dataform
Skills:
snowflake , Java, Hadoop, Scala, Kafka, Informatica, Sql, Apache Nifi, Nosql, Hive, Amazon Redshift, Spark, Talend, Python, Google BigQuery