Senior Associate Data Engineer (Data Business CoE)

About us

Bain & Company is a global management consulting that helps the world's most ambitious change makers define the future. Across 65 offices in 40 countries, we work alongside our clients as one team with a shared ambition to achieve extraordinary results, outperform the competition and redefine industries. Since our founding in 1973, we have measured our success by the success of our clients, and we proudly maintain the highest level of client advocacy in the industry.

In 2004, the firm established its presence in the Indian market by opening the Bain Capability Center (BCC) in New Delhi. The BCC is now known as BCN (Bain Capability Network) with its nodes across various geographies. BCN is an integral and largest unit of (ECD) Expert Client Delivery. ECD plays a critical role as it adds value to Bain's case teams globally by supporting them with analytics and research solutioning across all industries, specific domains for corporate cases, client development, private equity diligence or Bain intellectual property. The BCN comprises of Consulting Services, Knowledge Services and Shared Services.

Who you will work with 

Pyxis combines alternative data, AI-driven analytics, and institutional investor-led insights to reveal where, how and why consumers buy, how they pay, how much they spend, how their needs and demands are changing, and much more. 

By revealing previously opaque fundamental business trends and their drivers, Pyxis enables investors and business decision makers to efficiently allocate capital and address critical problems.

Pyxis has assembled one of the most comprehensive collections of alternative data covering hundreds of millions of people and tens of billions of transactions across the U.S., Canada, Brazil, UK, France and Japan as well as targeted countries across the EU and APAC. This data provides a longitudinal view of consumer and business transactional behaviors—across nearly all verticals over the last six years—and plays an integral role in answering companies and investors questions about market share, category size, pricing and promotion effectiveness, assortment optimization, ad targeting, loyalty, switching behavior, disruption, and more.

These state-of-the art capabilities enable Bain to provide its clients with a valuable new dimension in investment analysis and strategy development, complementing Bain's proven outside-in approach with the ability to apply complex data sets to assess company fundamentals.

 BCN Pyxis modeler will work closely with the BCN team manager, Pyxis Product Manager, General Manager, Bain Partners, and the Proprietary Data group to build and deliver a commercially successful product that spans core sectors across all regions. 

The working style of the team would be to support Pyxis product development , hence the pipelines and algorithm built should be scalable and automated to support subscription clients

What you'll do 

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities
• Work across workstreams to deliver high-quality, zero-defect deliverables and leverage manager's support on complex pieces
• Gather requirements and business process knowledge in order to transform the data in a way that's geared towards the needs of end users
• Provides tool based technical expertise to the junior team members when required
• Builds reusable capabilities that can be used by team members or across service lines
• Write advanced SQL and Python code to build and maintain backend data APIs and services; work hands-on with Snowflake for data transformation, query optimization, and pipeline development
• Ensure that the data architecture is scalable and maintainable
• Design and develop RESTful backend APIs and microservices using Python (FastAPI/Flask) to expose data products and support downstream consumers
• Work with the business in designing and delivering correct, high quality data
• Investigate data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
• Prepare documentation for further reference 
• Respond to onshore team/client questions around the data and insights
• Provide ongoing support for subscription customers, such as additional data cuts and responding to questions about the data/methodology
• The working style of the team would be to support product development , hence the pipelines and algorithm built should be scalable and automated

About you

Work experience: 6-8 years of experience in areas related to Data Management, Business Intelligence or Business Analytics. Hands-on experience in data handling and ETL workstreams

Education Required: Incumbent should be a graduate/post graduate from top-tier institute or have pursued a statistical/analytical course from a tier 1 university

Preferred: Concentration in a quantitative discipline such as Statistics, Mathematics, Engineering, Computer Science, Econometrics, Business Analytics, or Market Research is strongly preferred.

 Knowledge, Skills and Abilities Required:

• Design, develop, and maintain scalable data pipelines using Python and SQL for batch and real-time data processing.
• Build and optimize ETL/ELT workflows to ingest, transform, and load data from multiple source systems.
• Develop and maintain RESTful APIs and data services using FastAPI for data integration and consumption.
• Design, implement, and support enterprise-grade Data Warehouse solutions following dimensional modeling best practices.
• Create and optimize complex SQL queries, stored procedures, and data transformations for analytics and reporting.
• Work extensively with Snowflake to build, optimize, and manage cloud-based data platforms (good to have)
• Utilize Starburst/Trino for distributed query processing, data federation, and high-performance analytics (good to have)
• Ensure data quality, consistency, and reliability through validation frameworks, monitoring, and automated testing.
• Optimize data pipeline performance, query execution, and storage utilization across large-scale datasets.
• Collaborate with business stakeholders, data analysts, and engineering teams to gather and translate data requirements.
• Implement data governance, security, access controls, and compliance standards across data platforms.
• Troubleshoot production data issues, perform root-cause analysis, and implement preventive solutions.
• Leverage cloud-native technologies and best practices for scalable, resilient, and cost-effective data architectures.
• Maintain technical documentation, data lineage, and operational runbooks while following Agile development methodologies.

What makes us a great place to work

We are proud to be consistently recognized as one of the world's best places to work, a champion of diversity and a model of social responsibility. We are currently ranked the #1 consulting firm on Glassdoor's Best Places to Work list, and we have maintained a spot in the top four on Glassdoor's list for the last 12 years. We believe that diversity, inclusion and collaboration is key to building extraordinary teams. We hire people with exceptional talents, abilities and potential, then create an environment where you can become the best version of yourself and thrive both professionally and personally. We are publicly recognized by external parties such as Fortune, Vault, Mogul, Working Mother, Glassdoor and the Human Rights Campaign for being a great place to work for diversity and inclusion, women, LGBTQ and parents.