Search Jobs

Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

KPI Partners
  • Posted 43 minutes ago
  • Be among the first 10 applicants

Job Description


About the Company

We are a leading technology firm dedicated to innovation and excellence in data solutions. Our mission is to empower businesses through advanced data engineering and analytics, fostering a culture of collaboration and continuous improvement.

About the Role

We are seeking a Senior Fabric Data Engineer who can help with the design and building of data pipelines

Responsibilities

  • Building Data Factory pipelines in Fabric
  • Scheduling notebook, Copy Activity, and Dataflow Gen2 executions
  • Creating dependency chains between activities
  • Implementing retry policies and timeout handling
  • Passing parameters between pipelines
  • Using variables and dynamic expressions
  • Sending notifications on failures
  • Orchestrating Bronze → Silver → Gold processing

Qualifications

Education details related to data engineering or a relevant field.

Required Skills

  • Azure Databricks,Python,pyspark,sql,ADF
  • Proficiency in data pipeline design and implementation
  • Strong understanding of data factory and orchestration tools

Preferred Skills

  • Familiarity with advanced data processing techniques
  • Experience in cloud-based data solutions

Pay range and compensation package

Competitive salary based on experience and qualifications.

Equal Opportunity Statement

We are committed to diversity and inclusivity in our hiring practices and encourage applications from all qualified individuals.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Data factory and orchestration tools

Data Factory pipelines

Data pipeline design and implementation

About Company

Similar Jobs

Remote, Bengaluru, India
Skills:
GcpApache SparkDatabricksTableauPythonSqlAWSAirflowBitbucket Pipelinesdbt
Hyderabad, India
Skills:
Amazon S3PostgreSQLPysparkKafkaMySQLAzure Synapse AnalyticsOracleAWSApache HadoopFlumeApache SparkSQL ServerSqlJenkinsGcpAmazon RedshiftAzureClaudeGoogle BigQueryVertex AILangChainCopilotOpenAI APIAzure Data Lake StorageDelta LakeAmazon Bedrock
Hyderabad, India
Skills:
Data ArchitectureData IntegrationSqlELTEtlData Warehousing ConceptsDatabase Management Systemslarge-scale data managementcloud-based data servicesdata quality managementvalidation frameworksmonitoring solutionsdistributed data processing environments
Hyderabad, India
Skills:
snowflake PysparkAWS GlueSqlAws RdsGitlabOraclePythonAWS DMSCI CDETL Pipelinedbt
Hyderabad, India
Skills:
snowflake JavaPower BiScalaKafkaSqlELTGitKinesisGcpDatabricksAzurePythonAWSEtlSynapseEvent HubsDelta LakeMicrosoft Fabric