Search by job, company or skills

Data Engineer

Early Applicant
  • Posted a day ago
  • Be among the first 10 applicants

Job Description

We are looking for a Senior Data Engineer / Senior Specialist with 7–11 years of experience in Python and Google Cloud Platform (GCP). The ideal candidate should have hands-on experience in developing and optimizing data pipelines, building scalable data solutions using GCP services, and delivering data analytics solutions. The role requires expertise in Python, DataProc, Dataflow, Data Fusion, Dataform, DMS, SQL, and ETL/ELT pipelines, along with the ability to collaborate with cross-functional teams and mentor junior engineers.

Job Description

  • Develop, maintain, and optimize data pipelines using Python for data analytics.
  • Design and implement scalable data solutions using Google Cloud Platform (GCP).
  • Utilize GCP services such as DataProc, Database Migration Service (DMS), Dataform, Data Fusion, and Dataflow.
  • Analyze large datasets to generate actionable insights and support data-driven decision-making.
  • Collaborate with cross-functional teams to integrate data analytics solutions into business processes.
  • Ensure data quality, integrity, security, and governance throughout the data lifecycle.
  • Stay updated with the latest advancements in Python and GCP Data Analytics technologies.

Roles & Responsibilities

  • Lead the design and implementation of data analytics solutions using Python and GCP.
  • Architect, develop, and manage end-to-end data workflows using DataProc, DMS, Dataform, Data Fusion, and Dataflow.
  • Build and optimize scalable ETL/ELT data pipelines.
  • Troubleshoot and resolve performance bottlenecks in data processing pipelines.
  • Collaborate with business stakeholders to gather requirements and deliver technical solutions.
  • Mentor junior team members on Python programming and GCP data services.
  • Drive continuous improvements to enhance data processing efficiency, scalability, and reliability.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153393201

Similar Jobs

Hyderabad, India

Skills:

BigQueryDataFlowPythonSqlAPI scriptingAirflowComposer DAGsGoogle Cloud SDK

Hyderabad, India

Skills:

Data SecurityDatabase Management Systemsdata storage solutionsETL processesdata quality assurance techniquesMicroStrategy Business Intelligencedata pipeline architecturelarge-scale data environments

Hyderabad, India

Skills:

ApisPysparkVersion ControlData IntegrationSqlELTDatabricksMicrosoft AzurePythonEtlData Quality ChecksActiveBatch

Hyderabad, India

Skills:

ScalaApache KafkaDatabricksPythonSqlDatabricks SQLTimescaleDBStructured StreamingGreat ExpectationsDelta Live TablesUnity Catalog

Hyderabad, India

Skills:

snowflake GcpAzurePythonSqlAWSData lake architectures

Beware of Scammers

We don’t charge money for job offers