Data Engineer - AEP Comptency
Position Summary
Experienced software engineer utilizing Big Data & Cloud technologies to program for
custom solutions for Adobe Experience Cloud customers and frameworks.
What you ll do
- Develop low level design as per approved Tech Specification or equivalent
- inputs provided.
- Build and deliver technology deliverables as per Tech Specifications/low level
- design or equivalent inputs.
- Build and delivery technology deliverables compliant with functional
- requirements.
- Build and deliver technology deliverables in accordance with the best practices
- to ensure compliance with non-functional aspects like scalability,
- maintainability, performance etc.
- Process technology deliverables through full development lifecycle.
- Maintain and support existing solutions and technology frameworks.
- Attend regular scrum events of equivalent and provide update on the
- deliverables.
- Work independently with none or minimum supervision.
Requirements
- 6+ years(6 year) of professional software engineering mostly focused on the following:
- Developing ETL pipelines involving big data.
- Developing data processinganalytics applications primarily using PySpark.
- Experience of developing applications on cloud(AWS) mostly using services
- related to storage, compute, ETL, DWH, Analytics and streaming.
- Clear understanding and ability to implement distributed storage, processing
- and scalable applications.
- Experience of working with SQL and NoSQL database.
- Ability to write and analyze SQL, HQL and other query languages for NoSQL
- databases.
- Proficiency is writing disitributed & scalable data processing code using PySpark,
- Python and related libraries.
- Data Engineer - AEP Comptency
- Experience of developing applications that consume the services exposed as
- ReST APIs.
- Special Consideration given for
- Experience of working with Container-orchestration systems like Kubernetes.
- Experience of working with any enterprise grade ETL tools.
- Experience & knowledge with Adobe Experience Cloud solutions.
- Experience & knowledge with Web Analytics or Digital Marketing.
- Experience & knowledge with Google Cloud platforms.
- Experience & knowledge with Data Science, ML/AI, R or Jupyter
