Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

Accenture
  • Posted 3 hours ago
  • Be among the first 10 applicants

Job Description

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Databricks Unified Data Analytics Platform

Good to have skills : Python (Programming Language), PySpark

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support data generation, collection, and processing activities. The role includes creating efficient data pipelines to facilitate smooth data flow, ensuring the accuracy and reliability of data, and implementing processes to extract, transform, and load data across various systems. This position requires continuous collaboration with different teams to optimize data handling and support organizational data needs effectively.

Roles & Responsibilities:

  • Expected to be an SME, collaborate and manage the team to perform.
  • Responsible for team decisions.
  • Engage with multiple teams and contribute on key decisions.
  • Provide solutions to problems for their immediate team and across multiple teams.
  • Lead efforts to optimize data workflows and improve system performance.
  • Mentor junior team members to enhance their technical skills and project contributions.
  • Coordinate cross-functional initiatives to align data strategies with business objectives.

Professional & Technical Skills:

  • Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, Python (Programming Language), PySpark.
  • Good To Have Skills: Experience with Python (Programming Language), PySpark.
  • Strong knowledge of data pipeline architecture and ETL process design.
  • Experience in managing large-scale data processing and integration tasks.
  • Ability to troubleshoot and resolve complex data-related issues efficiently.
  • Familiarity with cloud-based data platforms and distributed computing environments.

Additional Information:

  • The candidate should have minimum 7.5 years of experience in Databricks Unified Data Analytics Platform.
  • This position is based at our Bengaluru office.
  • A 15 years full time education is required.




More Info

Job Type:
Industry:
Employment Type:

Key Skills

ETL process design

large-scale data processing

Databricks Unified Data Analytics Platform

distributed computing environments

cloud-based data platforms

Python Programming Language

data pipeline architecture

About Company

Similar Jobs

5-7 yrs
Bengaluru, India
Skills:
Spark SQLScipyPysparkAzure DatabricksNumpyPandasAzure Data LakePythonRDDsDatabricks NotebooksMLflowDataFramesSynapse AnalyticsDelta LakeBlob StorageSpark Pools
5-7 yrs
Bengaluru, India
Skills:
Data Architecturedata modeling principlesDatabricks Unified Data Analytics PlatformETL processesscripting and automationcloud-based data storage and processing solutions
4-7 yrs
Bengaluru, India
Skills:
file formats LoggingPysparkData ModelingRedshiftSqlGitData QualitySparkPythonAWSApache IcebergDBT CloudMonitoringalertingLakehouse Data Lake architecturespartitioningobservability
7-9 yrs
Bengaluru, India
Skills:
GitOracle Pl SqlPysparkPython
6-8 yrs
Bengaluru, India
Skills:
PysparkAzure Synapse AnalyticsApache SparkAzure DatabricksPythonSqlDatabricks Unity CatalogAzure Data Lake Storage ADLSDelta LakeAzure SQL DatabaseAzure Data Factory ADF