Experience: 8.00 + years
Salary: Confidential (based on experience)
Expected Notice Period: 15 Days
Shift: (GMT+05:30) Asia/Kolkata (IST)
Opportunity Type: Office (Pune)
Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Nexus Cognitive)
(*Note: This is a requirement for one of Uplers client - Nexus Cognitive)
What do you need for this opportunity
Must have skills required:
812 years of experience in data engineering or platform modernization, Demonstrated success leading migration or modernization programs at enterprise scale., Excellent communication and stakeholder-management skills; capable of bridging executive vision and technical execution., including 3+ years leading technical teams., Strong foundation in open-source and hybrid-cloud data ecosystems., Spark, Airflow, Kubernetes (EKS)
Nexus Cognitive is Looking for:
Role Summary / Purpose
The
Data Engineering Manager will lead distributed teams responsible for designing, modernizing, and operating large-scale data pipelines on the
NexusOne platform an open-source-based data and AI control plane for regulated enterprise environments.
This leader combines
hands-on technical depth with
strategic delivery management, ensuring that complex data workloads are refactored, migrated, and optimized using modern, composable frameworks.
The role requires strong architectural intuition, proven leadership, and fluency in modern data-engineering technologies.
Core Responsibilities
- Lead and mentor teams of Big Data Developers, Data Engineers, and Platform Specialists to deliver scalable data solutions.
- Define and enforce standards for data quality, governance, performance, and security.
- Oversee the design and migration of data pipelines, orchestration frameworks, and ingestion flows to the NexusOne platform.
- Collaborate with Platform and Solution Architects to ensure alignment with the North Star architecture.
- Implement CI/CD practices, code reviews, and deployment automation for all data workloads.
- Develop reusable frameworks, patterns, and best practices to accelerate platform adoption.
- Drive continuous improvement through performance optimization, automation, and observability.
- Engage with stakeholders across engineering, architecture, and operations to align priorities and ensure on-time delivery.
Must-Have Core Skills
- Distributed Data Systems: Deep expertise in Apache Spark (core, SQL, streaming) and Airflow orchestration.
- Open-Source Data Stack: Hands-on with Iceberg, Trino/Presto, Hive, NiFi, and Kafka.
- Data Modeling & Transformation: Strong command of SQL, DBT, and schema-on-read design principles.
- Programming & Scripting: Proficiency in Python, Scala, and Java for data pipeline development.
- Infrastructure & Automation: Practical experience with Kubernetes, Terraform, Helm, GitLab CI/Jenkins, and Linux-based environments.
- Governance & Security: Familiarity with Ranger, DataHub, RBAC, and enterprise IAM/SSO integration.
- Data Quality & Testing: Working knowledge of Great Expectations or similar validation frameworks.
- Delivery Leadership: Proven ability to manage distributed engineering teams in Agile/DevOps settings.
Ideal Background
- 812 years of experience in data engineering or platform modernization, including 3+ years leading technical teams.
- Strong foundation in open-source and hybrid-cloud data ecosystems.
- Demonstrated success leading migration or modernization programs at enterprise scale.
- Excellent communication and stakeholder-management skills; capable of bridging executive vision and technical execution.
Success Criteria
- Delivery of high-performing, production-ready data pipelines on the NexusOne platform.
- Consistent adherence to governance, quality, and performance SLAs.
- Adoption of standardized frameworks and automation across engineering teams.
- Measurable improvement in pipeline reliability, cost efficiency, and developer productivity.
- High engagement, retention, and growth within the data-engineering team.
How to apply for this opportunity
- Step 1: Click On Apply! And Register or Login on our portal.
- Step 2: Complete the Screening Form & Upload updated Resume
- Step 3: Increase your chances to get shortlisted & meet the client for the Interview!
About Uplers:
Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement.
(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).
So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!
