Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

infovision inc.
5-7 Years
Early Applicant
  • Posted 21 hours ago
  • Be among the first 10 applicants

Job Description

Exp- 5-8

Location- Pune

Hybrid work mode

Job Description

Azure Data Engineer

As an Azure Data Engineer in our team, you will be responsible for assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. You also will develop and support the implementation and integration of these new data sources into our Azure Data platform.

Responsibilities:

  • You are required to do detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness, and business value.
  • You are required to design, document, develop, implement, and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
  • You are required to participate in early state design and feature definition activities.
  • Responsible for implementing robust data pipeline using Microsoft toolset and Databricks Stack
  • Responsible for creating reusable and scalable data pipelines
  • You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Skills:

  • Advanced working knowledge and experience with relational and non-relational databases
  • Experience building and optimizing Big Data pipelines, architectures, and data sets
  • Strong analytic skills related to working with unstructured datasets
  • Expertise in Azure Datafactory, Databricks, Eventhub, Python, PySpark ,Azure Synapse and SQL.
  • Azure Devops experience mandatory to deploy the Data Objects.

Qualifications and Experience:

  • 7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience.
  • Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
  • Automotive domain experience is must.
  • Knowledge/Experience with Azure cloud stack.
  • Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage.
  • Bachelor's degree in Computers or allied field of study.
  • Certification on Azure platform toolsets will be considered as added advantage

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Eventhub

non-relational databases

Azure Datafactory

Big Data pipelines architectures

About Company

Similar Jobs

6-10 yrs
Pune, India
Skills:
BigQueryPysparkApache BeamDataprocDataFlowPythonSqlCloud ComposerDataplexdbtDataform
6-10 yrs
Pune, India
Skills:
Distributed ComputingBigQueryHadoopPysparkApache SparkGoogle CloudJenkinsHiveshell scriptingPython ProgrammingAWS ecosystemGit repositoryCDC operationsUNIX operating system conceptsAgile delivery modelCloudera Hortonworks Data PlatformData historical loadAWS S3 Filesystem operations
4-6 yrs
Pune, India
Skills:
snowflake JavaStreamingScalaELTClouderaAgileDatabricksAzurePythonAWSEtlData lakesMedallion-layered data structuresData pipeline frameworks
5-7 yrs
Pune, India
Skills:
PysparkAWS Glue