Search by job, company or skills

Data Engineer

Data Engineer

Accenture
3-5 Years
Not Disclosed

This job is no longer accepting applications

Job Description

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Databricks Unified Data Analytics Platform

Good to have skills : AI Agents & Workflow Integration

Minimum 3 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, your typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. You will be responsible for creating efficient data pipelines that facilitate smooth data flow and ensure high data quality. Your role includes implementing extract, transform, and load processes to migrate and deploy data seamlessly across various systems, enabling reliable and scalable data infrastructure to support organizational needs.

Roles & Responsibilities:

  • Expected to perform independently and become an SME.
  • Required active participation/contribution in team discussions.
  • Contribute in providing solutions to work related problems.
  • Collaborate with cross-functional teams to understand data requirements and deliver appropriate solutions.
  • Monitor and optimize data workflows to improve performance and reliability.
  • Document data processes and maintain clear communication with stakeholders.
  • Support junior team members by sharing knowledge and assisting with technical challenges.

Professional & Technical Skills:

  • Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, AI Agents & Workflow Integration.
  • Good To Have Skills: Experience with AI Agents & Workflow Integration.
  • Strong knowledge of data pipeline architecture and best practices for data ingestion and transformation.
  • Experience with cloud-based data platforms and scalable data processing frameworks.
  • Ability to troubleshoot and resolve data quality issues effectively.
  • Familiarity with scripting and automation to streamline data operations.

Additional Information:

  • The candidate should have minimum 3 years of experience in Databricks Unified Data Analytics Platform.
  • This position is based at our Hyderabad office.
  • A 15 years full time education is required.

, 15 years full time education



More Info

Job Type:
Industry:
Employment Type:

Key Skills

AI Agents Workflow Integration

Databricks Unified Data Analytics Platform

scalable data processing frameworks

cloud-based data platforms

scripting and automation

data pipeline architecture

About Company

Similar Jobs

5-7 yrs
Hyderabad, India
Skills:
snowflake , Performance Tuning, Data Modeling, Numpy, Query Optimization, Python, Version Control, Git, Pandas, Advanced Sql, Etl, Master-data governance, Schema modeling, Optimization, Workflow orchestration, Scikit-Learn, Cloud data warehouses, Lineage tracking, Normalization, Programming Automation, System-integration architecture, Tesseract OCR, Hadoop ecosystems, MCP design, ELT pipeline development, CI CD practices, Data Architecture Engineering, Relational Database Design
5-12 yrs
Hyderabad, India
Skills:
S3, Data Warehouse, Lambda, Docker, Data Lake, Kubernetes, Data Ingestion, Compute Engines, Processing and Orchestration tools, AWS PaaS platforms, AWS Cloud data-based development and migration, Amazon EKS, Cloud Components, Dms, Load balancer setup, Cloud and infrastructure components, Glue, Backup DR security and compliance, Serverless, Applications Migration to Cloud, CI CD Integration and deployment, Lake House Design Implementation, Cloud native Architecture
5-7 yrs
Hyderabad, India
Skills:
Pyspark, Azure Data Factory, Apache Kafka, Python, Sql, Azure DevOps, Azure Databricks, Azure cloud data services technologies, Logging and Monitoring using Azure Databricks services, Delta live tables, Data Modelling Architecture, ETL pipeline design, Unity Catalog
3-5 yrs
Hyderabad, India
Skills:
data engineering , Pyspark, Databricks Unified Data Analytics Platform, Building and managing scalable data pipelines and workflows, Data integration and ETL best practices, Data storage solutions, Data modeling techniques
4-6 yrs
Hyderabad, India
Skills:
data reconciliation , snowflake , Data Testing, Sql, Test Management Tools, Etl Tools, Python, AWS, scripting for test automation, data quality checks, data validation methodologies, cloud-based data platforms, ETL validation