Search by job, company or skills

Senior Data Engineer

Early Applicant
  • Posted 2 months ago
  • Be among the first 20 applicants

Job Description

Job Title: Data Engineer

Job Type: Full-Time

Location: On-site Hyderabad, Telangana, India

Job Summary:

We are seeking an accomplished Data Engineer to join one of our top customer's dynamic team in Hyderabad. You will be instrumental in designing, implementing, and optimizing data pipelines that drive our business insights and analytics. If you are passionate about harnessing the power of big data, possess a strong technical skill set, and thrive in a collaborative environment, we would love to hear from you.

Key Responsibilities:

  • Develop and maintain scalable data pipelines using Python, PySpark, and SQL.
  • Implement robust data warehousing and data lake architectures.
  • Leverage the Databricks platform to enhance data processing and analytics capabilities.
  • Model, design, and optimize complex database schemas.
  • Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
  • Lead and mentor junior data engineers and establish best practices.
  • Troubleshoot and resolve data processing issues promptly.

Required Skills and Qualifications:

  • Strong proficiency in Python and PySpark.
  • Extensive experience with the Databricks platform.
  • Advanced SQL and data modeling skills.
  • Demonstrated experience in data warehousing and data lake architectures.
  • Exceptional problem-solving and analytical skills.
  • Strong written and verbal communication skills.

Preferred Qualifications:

  • Experience with graph databases, particularly MarkLogic.
  • Proven track record of leading data engineering teams.
  • Understanding of data governance and best practices in data management.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 145130841

Similar Jobs

Hyderabad, India

Skills:

Data ArchitectureData IntegrationSqlELTEtlData Warehousing ConceptsDatabase Management Systemslarge-scale data managementcloud-based data servicesdata quality managementvalidation frameworksmonitoring solutionsdistributed data processing environments

Hyderabad, India

Skills:

snowflake PysparkAWS GlueSqlAws RdsGitlabOraclePythonAWS DMSCI CDETL Pipelinedbt

Hyderabad, India

Skills:

Regression TestingApi TestingData TestingPython

Hyderabad, India

Skills:

PysparkAzure DatabricksSqlClustersKubernetesPythonRBAC configurationAbility to debug and optimize PySpark SQL codeProgramming Data Processing using ScalaDatabricks Platform ExpertiseUnity CatalogAzure ServicesExperience in AWS using DockerCI CD with Azure DevOpsJobsSecure Coding principles in DatabricksBlob StorageData Governance and Compliance standardsNotebooksDelta LakeApache Spark optimization techniquesHelm framework

Hyderabad, India

Skills:

thermal modeling 6SigmaRoomFuture FacilitiesCFD modelingCRAHmicroclimate modelingCRACdata center standardsliquid coolingAnsys CFXAnsys Fluentair-side economizationopenfoam