Search by job, company or skills

T

Azure Data Engineer

Save
  • Posted 12 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description


Roles and Responsibilities

  • Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions.
  • Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs.
  • Develop complex SQL queries to optimize database performance and troubleshoot issues in relational databases like SQL Server or Postgres.
  • Implement machine learning models using PySpark on Azure Databricks for advanced analytics capabilities.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 149057297

Similar Jobs

Bengaluru, India

Skills:

PysparkPythonSqlAzure servicesAzure Fabric

Bengaluru, India

Skills:

PysparkScalaAzure DatabricksApi IntegrationDimensional ModelingSqlELTGitQuery TuningAzure Synapse AnalyticsSparkStar SchemaPythonAzure DevOpsEtlSnowflake schemaDatabricks jobsAzure SQL DatabaseGitHub ActionsCaching strategiesPartitioningDelta LakeADF pipelines

Bengaluru, India

Skills:

GithubPower BiAzure DatabricksAzure Cosmos DBTerraformAzure Synapse AnalyticsAzure Data LakeArmAzure DevOpsAzure SQL DatabaseBICEPMicrosoft PurviewAzure Data EngineeringMicrosoft FabricEntra

Hyderabad, Bengaluru, Chennai

Skills:

AdbAdfSqlPysparkPythonSynapseDelta Tables

Bengaluru, India

Skills:

time travel PysparkKafkaSpark SQLPhoton autoscalingZ-ORDERLakehouse FederationDLTCI CDon-call readinessDelta SharingEvent Hubsenvironment promotionABACfile sizingWorkflows orchestrationunit data expectationssecretsPHI controlsUnity CatalogtestsPIIOPTIMIZEDeltarbacdbtSynapse integrationstreaming patternsMERGE SCD2 schema evolution enforcement