This is a
long-term role (23 years), preferably based in
Pune, though other offshore locations are acceptable.The candidate will
replace the incumbent onsite Data Engineer.The team is small and currently managing multiple application integrations, so we require someone with:
Strong hands-on skills on Python / Scala (approximately 80%)Remaining responsibilities include
collaboration with other teams and business stakeholders.
Responsibilities : - Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
- Architects, designs, implements and maintains reliable and scalable data infrastructure to move, process and serve data.
- Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
- Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
- Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline,
- Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
- Actively contributes to improve developer velocity.
Qualifications- BS degree in computer science or related field
- Deep and hands-on experience (typically 7 to 12 years) designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
- Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#)
- Hands on experience working on Databrick, Apache Spark,
- Advanced database and SQL knowledge
- Experience designing and implementing large-scale distributed data systems
- Skillful in building and scaling infrastructure services using Amazon Web Services or Microsoft Azure
- Deep knowledge and hands-on experience in technologies across all data lifecycle stages
- Strong stakeholder management and ability to lead initiatives through technical influence
- Continuous learning and improvement mindset
