Specialist - Data Engineering

Role Description

Location- Bangalore

We are looking for a Data Engineer to join our team and help us to improve the platform that supports one of the best experimentation tools in the world

The selected candidate will work side by side with other data engineers and site reliability engineers to improve the reliability scalability maintenance and operations of all the data products that are part of the experimentation tool

Day to day work includes but is not limited to maintenance and operations of data pipelines and products that handles data at big scale the development of capabilities for monitoring ing testing and troubleshooting of the data ecosystem of the experiment platform and the delivery of data products that produce metrics for experimentation at scale The selected candidate will collaborate with colleagues in Amsterdam to achieve results the right way This will include engineering managers product managers engineers and data scientists

Key Responsibilities and Duties

Take ownership of multiple data pipelines and products and provide innovative solutions to reduce the operational workload required to maintain them

Rapidly developing nextgeneration scalable flexible and highperformance data pipelines

Contribute to the development of data platform capabilities such as testing monitoring debugging and ing to improve the development environment of data products

Solve issues with data and data pipelines prioritizing based on customer impact

Endtoend ownership of data quality in complex datasets and data pipelines

Experiment with new tools and technologies driving innovative engineering solutions to meet business requirements regarding performance scaling and data quality

Provide selforganizing tools that help the analytics community discover data assess quality explore usage and find peers with relevant expertise

Serve as the main point of contact for technical and business stakeholders regarding data engineering issues such as pipeline failures and data quality concerns

The job requirements

Minimum 5 years of handson experience in data engineering as a Data Engineer or as a Software Engineer developing data pipelines and products

Bachelors degree in Computer Science Computer or Electrical Engineering Mathematics or a related field or 5 years of progressively responsible experience in the specialty as equivalent

Solid experience in at least one programming language We use Java and Python

Experience building production data pipelines in the cloud setting up datalakes and serverless solutions

Handson experience with schema design and data modeling

Experience designing systems E2E and knowledge of basic concepts lb db caching NoSQL etc

Knowledge of Flink CDC Kafka Airflow Spark Snowflake DBT or equivalent tools

Practical experience building data platform capabilities like testing ing monitoring debugging security

Experience Working With Big Data

Experience working with teams located in different timezones is a plus

Experience with experimentation statistics and AB testing is a plus