As a Data engineer in the ADC Engineering team, you will: -
- Work alongside our engineers to help design and build scalable data pipelines while evolving the data surface.
- Help prove out and productionize Cloud Native Infrastructure and tooling to support scalable data cloud.
- Have fun as part of an awesome team.
Specific Responsibilities:
- Its a mix of backend application engineering (Python backend) including data engineering to build solution leveraging existing Data Framework
- Collaborating in a multi-disciplinary squad involving program and product managers, data scientists, and client professionals to expand the product offering based on business impact and demand
- Be involved from inception of projects, understanding requirements, designing & developing solutions, and incorporating them into the designs of our platforms
- Maintain excellent knowledge of the technical landscape for data & cloud tooling
- Assist in troubleshooting issues, support the operation of production software
- Write technical documentation
Required Skills
- 4+ years of industry experience in data engineering area.
- Passion for engineering and optimizing data sets, data pipelines and architecture.
- Ability to build processes that support data transformation, workload management, data structures, lineage, and metadata.
- Knowledge of SQL and performance tuning. Experience with Snowflake is preferred.
- Good working knowledge languages such as Python/Java
- Understanding of software deployment and orchestration technologies such as airflow etc.
- Experience in creating and evolving CI/CD pipelines with Gitlab or Azure Data Ops.