Search by job, company or skills

Lead Data Engineer

  • Posted 2 hours ago
  • Be among the first 10 applicants

Job Description

Lead Data Engineer, Enterprise Platform and Technology Services - LES Data Team

Organization Background

The ESI Enablement & Platform Technology - LES Team provides analytical services to business units and IS Stakeholders. In this role you will engineer, develop, and support the complete lifecycle of the Enterprise Data Archival and Electronic Data Conversion service, Caregiver Training, Data Warehouse, and a variety of Azure Services for ETL/ELT processes. The successful candidate will possess a strong understanding of Azure Data Services, Data Analysis, and ability to articulate findings and recommendations to stakeholders .

What will you be responsible for

  • Strong knowledge of SQL, Azure SQL, TSQL
  • Strong knowledge of database, datawarehouse and data analysis
  • Strong knowledge of Databricks, python, spark.
  • Working experience in writing scripts on C# or similar languages for API development
  • Integrate unstructured data from multiple systems to create a single source of truth
  • Develop, monitor, and manage report curation and data modeling
  • Creating/implementing/Adopting API Governance and Standards for Data Analytics
  • Creating APIs to integrate unstructured data from a variety of systems to create a single source of truth (SailPoint, ServiceNow, Project Online, ADO, Intune, Azure licensing, and other systems of records for single/bi-direction data sets)
  • Working on Azure Services like Azure Data Factory, Azure Workbook, Log Analytics, Azure Functions, and other data analytics tools
  • Leveraging various Azure Services such as Azure Storage, Logic Apps, Data Factory, Azure SQL SaaS, Runbooks, Automation, Graph API, and various other data tools Developing/maintaining microservice automation (Prisma Cloud/Kubernetes)
  • Working experience in data visualization, PowerBI, writing complex SQL queries

What would your day look like


  • Work closely with service teams to determine project engagement and priority, business data reporting and analysis requirements
  • Gather Requirements, Data analysis and modelling
  • Create scripts to support enhancements
  • Work with external vendors on bi-directional API integrations
  • Collaborate with DWH and Reporting teams on data analysis and integrity
  • Gather requirements, develop, and implement solutions across all endpoint technologies in the Microsoft stack

Who we are looking for


  • Minimum 6-9 years of experience in Azure Data Engineering
  • Minimum 6-9 years of experience in BI Development
  • 6-9 years of experience working in cloud technologies such as Azure/AWS/Google cloud service
  • Experience with Apache Spark and Azure Databricks
  • Working knowledge of Microsoft Fabric
  • Ability to troubleshoot technical problems, demonstrate problem solving
  • Ability to effectively communicate and excellent interpersonal skills
  • Experience working in Agile/sprints in a global team setup
  • Bachelor's Degree in Computer Science, Data Analytics, Business Management, or IS

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153800751

Similar Jobs

Hyderabad, India

Skills:

HiveHadoopPysparkSparkYarnPythonSqlMapreduceHDFS

Hyderabad, India

Skills:

snowflake AdfAPI designSqlELTPythonEtlAirflowMCP serversVisual Studio Cursor or similar IDEsCopilotAnthropicAzure OpenAIMicrosoft OpenAI modelsCI CD environment setupsCloud-native architecturesLLM-based workflowsOpenAI APIsGenAI solutioningAI orchestration

Hyderabad, India

Skills:

Apache AirflowOracle DatabasePl SqlPythonSqlELTEtlOracle 23aiGCP Cloud ComposerOCP SchedulerOIC

Hyderabad

Skills:

AWSDatabricksSqlPythonSparkKafka

Hyderabad, India

Skills:

BigQueryGitTerraformDataprocDataFlowPythonSqlELTEtlGCP Dataform

Beware of Scammers

We don’t charge money for job offers