Data Engineer

Data Engineer AEP Comptency

Position Summary

Experienced software engineer utilizing Big Data & Cloud technologies to program for

custom solutions for Adobe Experience Cloud customers and frameworks.

What you'll do

Develop low level design as per approved Tech Specification or equivalent

inputs provided.

Build and deliver technology deliverables as per Tech Specifications/low level

design or equivalent inputs.

Build and delivery technology deliverables compliant with functional

requirements.

Build and deliver technology deliverables in accordance with the best practices

to ensure compliance with non-functional aspects like scalability,

maintainability, performance etc.

Process technology deliverables through full development lifecycle.

Maintain and support existing solutions and technology frameworks.

Attend regular scrum events of equivalent and provide update on the

deliverables.

Work independently with none or minimum supervision.

Requirements

6+ years(6 year) of professional software engineering mostly focused on the following:

Developing ETL pipelines involving big data.

Developing data processinganalytics applications primarily using PySpark.

Experience of developing applications on cloud(AWS) mostly using services

related to storage, compute, ETL, DWH, Analytics and streaming.

Clear understanding and ability to implement distributed storage, processing

and scalable applications.

Experience of working with SQL and NoSQL database.

Ability to write and analyze SQL, HQL and other query languages for NoSQL

databases.

Proficiency is writing disitributed & scalable data processing code using PySpark,

Python and related libraries.

Data Engineer AEP Comptency

Experience of developing applications that consume the services exposed as

ReST APIs.

Special Consideration given for

Experience of working with Container-orchestration systems like Kubernetes.

Experience of working with any enterprise grade ETL tools.

Experience & knowledge with Adobe Experience Cloud solutions.

Experience & knowledge with Web Analytics or Digital Marketing.

Experience & knowledge with Google Cloud platforms.

Experience & knowledge with Data Science, ML/AI, R or Jupyter.