Search by job, company or skills

Data Engineer

Early Applicant
  • Posted 17 days ago
  • Be among the first 30 applicants

Job Description

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Databricks Unified Data Analytics Platform

Good to have skills : AI Agents & Workflow Integration

Minimum 3 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, your typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. You will be responsible for creating efficient data pipelines that facilitate smooth data flow and ensure high data quality. Your role includes implementing extract, transform, and load processes to migrate and deploy data seamlessly across various systems, enabling reliable and scalable data infrastructure to support organizational needs.

Roles & Responsibilities:

  • Expected to perform independently and become an SME.
  • Required active participation/contribution in team discussions.
  • Contribute in providing solutions to work related problems.
  • Collaborate with cross-functional teams to understand data requirements and deliver appropriate solutions.
  • Monitor and optimize data workflows to improve performance and reliability.
  • Document data processes and maintain clear communication with stakeholders.
  • Support junior team members by sharing knowledge and assisting with technical challenges.

Professional & Technical Skills:

  • Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, AI Agents & Workflow Integration.
  • Good To Have Skills: Experience with AI Agents & Workflow Integration.
  • Strong knowledge of data pipeline architecture and best practices for data ingestion and transformation.
  • Experience with cloud-based data platforms and scalable data processing frameworks.
  • Ability to troubleshoot and resolve data quality issues effectively.
  • Familiarity with scripting and automation to streamline data operations.

Additional Information:

  • The candidate should have minimum 3 years of experience in Databricks Unified Data Analytics Platform.
  • This position is based at our Hyderabad office.
  • A 15 years full time education is required.

, 15 years full time education



More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151059265

Similar Jobs

Hyderabad, India

Skills:

Data GovernanceETL process designdata storage solutionsdata integration techniquesdistributed computing environmentscloud-based data platformsdata quality best practicesMicrosoft Azure Databricksdata pipeline architecture

Hyderabad, India

Skills:

SparkEmrDynamodbLambdaPysparkDeduplicationTerraformScalaPostgreSQLS3AWSPythonAdvanced Sqlresilient pipeline patternsAWS SagemakerGlueType 2 DimensionsMedallion ArchitectureLakehouseIdempotencyIncremental historical processinglate-arriving data handlingAWS data servicesStep FunctionsCDC Merge processingAurora

Hyderabad, India

Skills:

PysparkApache SparkKafkaEmrRedshiftSqlELTLambdaKinesisData Warehouse ArchitectureData LakePythonAws S3EtlAirflowCI CDLake Formationpipeline developmentGlueAWS SecurityAthenaReal-Time Data ProcessingCloud Optimization

Hyderabad, India

Skills:

data warehouses Machine LearningPysparkSqlELTData QualityGitDatabricksPythonEtlData LakesCloud-based Data PlatformsAiDelta Lake

Hyderabad, India

Skills:

SqlAWSAws RedshiftDynamodbPythonPostgreSQLMongoDBAWS BatchETL processesdata pipeline architecture