Search by job, company or skills

Azure Data Engineer

Early Applicant
  • Posted 7 hours ago
  • Be among the first 10 applicants

Job Description

JD#1

Data Engineer with Azure Databricks (R2DS - JV Project)

Mandatory Skills

Data Warehousing, Azure Data Engineer, Azure Data Lake, Data Bricks, Pyspark, Python

Job Description

  • Proficiency in Databricks and experience with Spark for big data processing. - Solid programming skills in Python or Scala for developing data pipelines. - Knowledge of SQL and experience with relational databases and data warehousing concepts.
  • Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.
  • Understanding of data modeling, ETL processes, and data integration methodologies. - Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill Area Tools & Technologies

Data

Engineering

Databricks, Apache Spark, Delta Lake

Programming Python, SQL, PySpark

Cloud Platforms Azure

Education Qualificaiton

B Tech

Roles & Responsibilities

  • Develop and implement scalable data processing solutions using Azure Databricks, including ETL processes that efficiently handle large data volumes.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.
  • Optimize data storage and retrieval processes to enhance performance and reduce latency. - Ensure data quality and integrity by implementing best practices for data governance and

validation.

  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151872447

Similar Jobs

Bengaluru, India

Skills:

Spark SQLPower BiSqlELTAzure Data FactoryTerraformAzure Synapse AnalyticsDatabricksArmPythonEtlAzure DevOpsCI CDAzure Data Lake Gen2Bicep

Bengaluru, India

Skills:

Apache SparkAzure DatabricksAzure Cosmos DBAzure Data FactoryAzure Synapse AnalyticsAzure DevOpsAzure Blob StorageAzure SQL DatabaseAzure Data Lake StorageAzure Analysis ServicesAzure AutomationAzure Monitor

Bengaluru, India

Skills:

Hadoop EcosystemPysparkAzure DatabricksData ModelingAzure Synapse AnalyticsPythonAzure DevOpsSpark SQLData SecurityScalaSqlSparkData LakeAzure Data Lake Storage ADLS Gen2Log AnalyticsHDInsightencryption in Azuredistributed data processing frameworksAzure-native data servicesAzure Data Factory ADFrbacCI CD pipelinesETL ELT design patternsAzure Monitorlakehousedata warehouse architectures

Bengaluru, India

Skills:

PowerShellBashAzure DatabricksARM templatesDockerTerraformKubernetesPythonAzure DevOpsGit-based version controlCollibra Data Intelligence CloudAPI integrationsBicepAzure networking

Beware of Scammers

We don’t charge money for job offers