Search by job, company or skills

A

Data Engineer

3-5 Years
Save
  • Posted 8 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Google BigQuery, Microsoft SQL Server, Python (Programming Language)

Good to have skills : NA

Minimum 3 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role includes creating efficient data pipelines to facilitate smooth data flow, ensuring the accuracy and integrity of data, and implementing processes to extract, transform, and load data across various systems. The position requires continuous monitoring and optimization of data workflows to support organizational needs and enable seamless data migration and deployment.

Roles & Responsibilities:

  • Expected to perform independently and become an SME.
  • Required active participation/contribution in team discussions.
  • Contribute in providing solutions to work related problems.
  • Collaborate with cross-functional teams to understand data requirements and deliver scalable data solutions.
  • Monitor and troubleshoot data pipeline issues to maintain system reliability and performance.
  • Document data processes and workflows to ensure clarity and knowledge sharing within the team.
  • Assist junior team members by providing guidance and support in their tasks.

Professional & Technical Skills:

  • Must To Have Skills: Proficiency in Google BigQuery, Microsoft SQL Server, Python (Programming Language).
  • Strong experience in designing and implementing data pipelines and ETL processes.
  • Knowledge of data warehousing concepts and best practices for data storage and retrieval.
  • Ability to optimize queries and manage large datasets efficiently within cloud-based environments.
  • Familiarity with data quality assurance techniques and tools to maintain data integrity.
  • Experience working with distributed data processing frameworks and automation of data workflows.

Additional Information:

  • The candidate should have minimum 3 years of experience in Google BigQuery.
  • This position is based at our Pune office.
  • A 15 years full time education is required.

, 15 years full time education



More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 150900461

Similar Jobs

Pune, India

Skills:

GithubDatabase DesignMicrosoft Sql ServerData GovernanceData Warehousing ConceptsData Modelingdata storage solutionsETL processesdata quality best practicescloud platformsGoogle BigQuery

Pune, India

Skills:

data engineering archimate Ms Sql ServerData ProfilingData ModelingSqlGoogle CloudBpmnUmlData TransformationPythonSource-to-target mappingBigQuery SQLData pipelining

Pune, India

Skills:

JavaBigQueryScalaApache SparkMonitoring ToolsELTDevopsPythonEtlCloud SpannerInfrastructure as CodeGoogle Cloud DataprocCI CDGoogle Cloud Pub SubGoogle Cloud Dataflow

Pune, India

Skills:

Apache AirflowBigQueryPysparkDataprocInformaticaTalendSqlPythonNoSQL databasesdata warehousing solutionsGoogle Data Engineering services

Pune, India

Skills:

data engineering archimate Ms Sql ServerData ProfilingData ModelingSqlGoogle CloudBpmnUmlData TransformationAgileScrumPythonAI IntegrationSource-to-target mappingBigQuery SQLData pipelining