Staff Data Engineer

Role: Staff Data Engineer

Location: Bengaluru, IND (Manyata Tech Park)

Essential Skills:

• 12+ years of experience in relevant field with expert level knowledge in following Tools/Languages
• Source Control systems such as Git
• Build & Deployment tools such as Jenkins, TeamCity, Octopus Deploy, Github Actions
• Hands on, Design and develop exceptionally reliable and scalable data & ML pipelines with comprehensive test coverage.
• Database – SQL, PL/SQL , Hadoop, Snowflake
• Strong experience in dbt (data build tool), Data warehousing, ETL, Cloud Data Platform
• Monitoring tools such as Splunk, AppDynamics, Observe, Obstack
• AWS Architecture and Certification (Required)
• AWS (Amazon Web Services) Cloud (working experience with some of the core services EMR, EC2, S3, Auto-scaling, etc.) desirable.
• Experience with large migration programs and automating things to scale up migrations from on-prem to cloud.
• Hands on, Design and develop exceptionally reliable and scalable data pipelines and data platforms with comprehensive test coverage.
• Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
• Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud Lake houses to enable data predictions and models and reporting and visualization analysis via data integration tools and frameworks.

Roles & responsibilities:

• Work with the team to understand our customers core business objectives and deliver quality data centric solutions within committed timeframes
• Contribute to thought leadership enabling analytics teams to deliver world class data centric solutions and analytics by championing sustainable and re-useable data assets
• Design and build group data assets by integrating diverse data from internal and external sources.
• Help to promote best in class coding standards and practices to ensure high quality and minimum risk.
• Collaborating and communicating with business and delivery stakeholders and working without supervision.
• Identify and escalate Technical Debt through simple processes to support effective planning and risk management.
• Risk Mindset – All employees are expected to proactively identify and understand, openly discuss and act on current and future risks.
• Able to build solutions that are fit for purpose, perform well with large data volume and complex data transformation rules, and reliable to operate
• Understanding of the development and release cycle following Change Management processes.
• Strong capability and experience with modern engineering practices and techniques
• Experience with Agile working practices is beneficial
• Prior experience working in Financial Services industry would be highly regarded, but not essential.