Search by job, company or skills

A

Data Engineer

7-9 Years
Save
  • Posted 13 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : AWS Glue, PySpark

Good to have skills : NA

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role requires creating efficient data pipelines and ensuring the integrity and quality of data throughout its lifecycle. The position also involves implementing extract, transform, and load processes to facilitate seamless migration and deployment of data across various systems, enabling smooth data flow and accessibility for multiple stakeholders within the organization.

Roles & Responsibilities:

  • Expected to be an SME, collaborate and manage the team to perform.
  • Responsible for team decisions.
  • Engage with multiple teams and contribute on key decisions.
  • Provide solutions to problems for their immediate team and across multiple teams.
  • Lead efforts to optimize data workflows and improve system performance.
  • Mentor junior team members to support their professional growth and skill development.
  • Coordinate cross-functional initiatives to align data engineering efforts with organizational goals.

Professional & Technical Skills:

  • Must To Have Skills: Proficiency in AWS Glue, PySpark.
  • Strong experience in building and managing scalable data pipelines and workflows.
  • Expertise in data integration, transformation, and migration techniques.
  • Familiarity with cloud-based data storage and processing solutions.
  • Ability to troubleshoot and resolve complex data processing issues efficiently.
  • Knowledge of best practices in data quality assurance and governance.

Additional Information:

  • The candidate should have minimum 7.5 years of experience in AWS Glue.
  • This position is based at our Pune office.
  • A 15 years full time education is required.




More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151082163

Similar Jobs

Pune, India

Skills:

JavaHadoopPysparkApache SparkKafkaCursorSqlSparkPythonAI development toolsCopilotClaudedata visualization toolsPig Scriptdata governance practices

Pune, India

Skills:

Power BiPysparkOracle Golden GateApache SparkSqlELTTerraformDockerAzure Synapse AnalyticsDatabricksPythonEtlAzure DevOpsAzure Data Lake Storage Gen2Delta LakeAzure Analysis Services

Pune, India

Skills:

snowflake Data WarehousingData GovernanceData ModelingSqldata quality validationELT pipelinesdbt

Pune, India

Skills:

snowflake S3Unit TestingTerradataKafkaLambdaKinesisPythonPysparkAws ServicesFunctional TestingRedshiftSqlBig Data TechnologiesJenkinsSparkAirflowDB ScriptStep FunctionsETL transformationsdata management processLake formationStreaming PipelineCI CD conceptsGlueAthena

Pune, India

Skills:

Microsoft SsisAzure CloudTechnical ArchitectShell scriptingSqlPythonAWSMicrosoft SQL server and Azure SQLData modelersTeam LeadData pipelines builder