Search by job, company or skills

Staffice Global Private Limited

Data Engineer

5-8 Years

This job is no longer accepting applications

new job description bg glownew job description bg glow
  • Posted 2 months ago
  • Over 50 applicants

Job Description

This role is for a Data Engineer to design and implement end-to-end data engineering solutions on Azure. The ideal candidate will be responsible for developing and optimizing data pipelines, ensuring data quality and security, and collaborating with cross-functional teams to build scalable data architectures.

Responsibilities

  • Design and implement end-to-end data engineering solutions on Azure, utilizing services like Azure Data Factory (ADF), Azure Databricks, and Synapse Analytics.
  • Develop and maintain data pipelines (ETL) that extract, transform, and load data from various sources into Azure data repositories, including data lakes.
  • Optimize and fine-tune data pipelines for performance, scalability, and cost-efficiency.
  • Automate tasks and deploy production-standard code with unit testing, continuous integration, and versioning.
  • Load transformed data into various destinations, including data warehouses, high-speed indexes, and real-time reporting systems.
  • Ensure data quality and accuracy through testing and validation.
  • Implement data security measures, including encryption, access controls, and auditing.
  • Provide guidance and support for data governance, including metadata management and data lineage.
  • Collaborate with cross-functional teams to understand data requirements and translate them into scalable data architectures.
  • Troubleshoot and resolve data pipeline issues to ensure minimal downtime.
  • Utilize SQL for data transformation and perform data modeling when necessary.
  • Create and maintain comprehensive documentation of data processes and architectures.

Skills

Required Skills:

  • Expertise in ETL (Extract, Transform, Load) processes.
  • Strong skills in Data Analysis and Business Analysis.
  • Hands-on experience with Azure Data Factory (ADF) and Azure Databricks.
  • Proficiency in SQL for data transformation and modeling.
  • Experience with data security measures and data governance.
  • Ability to automate tasks and deploy production-standard code.
  • Strong communication and collaboration skills.

More Info

Job Type:
Employment Type:
Open to candidates from:
Indian

About Company

Our Staffing Expertise extends to a wide range of industries. We connect employers with highly skilled job seekers. With staffing consultants across India, ANZ and APAC, its easy to begin your Candidate Search today.

Job ID: 123711575

Similar Jobs

Bengaluru, India

Skills:

snowflake KibanaGcpElasticsearchApache KafkaDatabricksAzureSqlPythonAWSInformatica IICS

Bengaluru, India

Skills:

Power BiRequirement GatheringSqlWorkspace managementDaxPerformance OptimizationTranslating business problems into analytical solutionsData Visualization Best PracticesGateway configurationPower BI AdministrationModel size reductionSnowflake SchemaPower BI Advanced DashboardsQuery foldingKPI designDAX optimizationUnderstanding of Data ModelingDataset sharingStorytelling with dataUser persona designETL Data Transformation

Bengaluru, India

Skills:

S3GdprHadoopCloudformationPostgreSQLApache SparkAWS GlueHipaaInformaticaRedshiftSqlHiveGcpTerraformMySQLEtl ToolsTalendOracleAzureData encryption

Bengaluru, India

Skills:

SqlDatabricksAzure Data FactoryPythonAzure SynapsePysparkKafkaSparkADLSAzure related data services

Bengaluru, India

Skills:

Data TransformationData ModellingSqlOracle Cloud Data IntegrationETL pipelines