Director of Data Engineering

About KPI Partners

KPI Partners is a global consulting and technology services firm specializing in Data, Analytics, Artificial Intelligence, and Cloud solutions. We help enterprises accelerate digital transformation by delivering modern data platforms, advanced analytics, and AI-driven business solutions. With deep expertise across industries, we partner with leading technology providers to enable organizations to unlock the full value of their data.

We are looking for a visionary Director – Data Engineering to lead enterprise-scale data initiatives, drive modern data platform adoption, and play a strategic role in client engagement and business growth.

Role Overview:

As the Director – Data Engineering, you will provide technical leadership across large-scale data transformation programs while partnering with sales and delivery teams to design innovative, scalable, and business-driven data solutions. This role requires a unique combination of deep technical expertise, solution architecture, people leadership, and pre-sales experience.

Key Responsibilities

• Define and execute the organization's Data Engineering strategy and architecture roadmap.
• Lead, mentor, and grow high-performing teams of Data Engineers, Technical Leads, and Solution Architects.
• Design, build, and optimize scalable data pipelines using Python and PySpark.
• Architect and implement modern data platforms leveraging Databricks and Snowflake.
• Collaborate closely with business stakeholders to translate business requirements into scalable technical solutions.
• Drive enterprise data architecture, governance, security, and data quality initiatives.
• Optimize platform performance, scalability, and cost efficiency across cloud environments.
• Stay current with emerging technologies, industry trends, and best practices in Data Engineering.

Pre-Sales & Solutioning Responsibilities

• Partner with Sales teams to support strategic client pursuits.
• Design end-to-end solution architectures for enterprise data platforms.
• Lead RFP/RFI responses and technical proposal development.
• Conduct client presentations, workshops, and solution demonstrations.
• Provide effort estimation, delivery planning, and solution sizing.
• Act as a trusted advisor during client engagements and contribute to winning new business opportunities.

Required Skills & Experience

Technical Expertise

• Strong hands-on experience with Python for Data Engineering.
• Advanced expertise in PySpark for large-scale distributed data processing.
• Deep knowledge of Databricks, including Lakehouse Architecture, Delta Lake, Workflows, Unity Catalog, and performance optimization.
• Strong experience with Snowflake, including data warehousing, performance tuning, data sharing, and Snowpark.
• Expertise in designing and implementing enterprise-scale ETL/ELT pipelines.
• Strong understanding of data architecture, data modeling, and modern data engineering best practices.
• Experience with at least one major cloud platform (AWS, Azure, or GCP).

Leadership & Business Skills

• Proven experience leading enterprise Data Engineering teams and large-scale transformation programs.
• Strong experience in pre-sales, solution architecture, and technical consulting.
• Excellent client-facing communication, presentation, and stakeholder management skills.
• Ability to collaborate effectively across Sales, Delivery, and Executive Leadership teams.
• Strong analytical, problem-solving, and strategic decision-making capabilities.

Why Join KPI Partners

• Work on enterprise-scale data modernization and AI transformation initiatives.
• Collaborate with global clients across diverse industries.
• Lead innovation using cutting-edge cloud and data technologies.
• Be part of a collaborative, high-growth organization that values technical excellence and leadership.
• Enjoy opportunities for continuous learning, career advancement, and professional development.

Location: Bengaluru / Hyderabad / Pune (Hybrid)

Experience: 15+ Years

If you're passionate about building next-generation data platforms, driving innovation, and leading high-performing engineering teams, we'd love to hear from you.