Experience: 8.00 + years
Salary: Confidential (based on experience)
Shift: (GMT+05:30) Asia/Kolkata (IST)
Opportunity Type: Office ()
Placement Type: Full time Permanent Position
(*Note: This is a requirement for one of Uplers client - PrivaSapien)
What do you need for this opportunity
Must have skills required:
ETL, Extract transform load, AWS, Google Cloud, Azure, Python, PySpark
PrivaSapien is Looking for:
Professional Summary:-
ETL Architect with 810+ years of experience designing and operating petabyte-scale data platforms across multi-cloud environments. Proven expertise in large-scale Spark architectures, cloud-neutral ETL pipelines, ML/GenAI integration, and privacy-by-design systems. Strong track record of building cost- efficient, fault-tolerant, and compliant data pipelines supporting consent management, data discovery, and AI-safe processing at population scale.
Key Responsibilities & Impact:-
- Architect cloud-neutral ETL pipelines supporting PB-scale batch and hybrid workloads across AWS, Azure, and GCP
- Design and operate large-scale Apache Spark clusters on Kubernetes and YARN with optimised compute and storage utilisation
- Built fault-tolerant, replayable, and event-driven pipelines supporting backfills, reprocessing, and late-arriving data
- Integrate ETL workflows with ML/GenAI inference services for inference for large volume of data in automation
- Design high-throughput batching, queuing, and backpressure mechanisms between ETL and inference systems
- Implement privacy-by-design controls including encryption, tokenization, and secure key management (KMS/HSM)
- Establish observability, lineage, and auditability across enterprise data flows to meet compliance and regulatory needs.
Core Experience & Skills:-
Enterprise ETL & Big Data
- Designed and delivered enterprise-scale ETL architectures handling PB-scale data volumes
- Deep expertise in Apache Spark (Core, SQL, Structured Streaming) with performance tuning and cost optimisation.
- Strong experience with batch-heavy pipelines, reprocessing strategies, and SLA-driven workloads.
Cloud & Platform Engineering
- Hands-on experience across AWS, Azure, and GCP with cloud-neutral design principles
- Built and operated Kubernetes-based data platforms (Spark on K8s, YARN, Helm, autoscaling)
- Integrated cloud-native and SaaS connectors for databases, APIs, files, and event streams
Messaging, Queuing & Throughput Control
- Designed high-throughput pipelines using Kafka, Pulsar, SQS, Pub/Sub
- Implemented batching, backpressure, idempotency, and replayability for large-scale data movement ML / GenAI Integration
- Integrated ETL pipelines with ML and GenAI inference systems using REST/gRPC
- Experience with batch and micro-batch inference patterns and compute-aware workload isolation
- Working knowledge of Apache Spark ML and efficient integration with GPUs Security, Privacy & Compliance
- Implemented encryption, tokenization, pseudonymization, and key management using KMS
- Strong understanding of privacy-by-design, consent-driven processing, and regulated data environments
Leadership & Ownership
- Mentored and guided senior engineers; led architectural reviews and design decisions
- Accountable for platform reliability, SLAs, cost efficiency, and business outcomes
- Strong collaboration with product, security, and compliance stakeholders
Why Join Us
- Work at the intersection of AI, privacy, and compliance, shaping global standards.
- Be part of an award-winning startup making an impact worldwide.
- Take ownership and drive innovation in Responsible AI & Privacy Tech.
How to apply for this opportunity
- Step 1: Click On Apply! And Register or Login on our portal.
- Step 2: Complete the Screening Form & Upload updated Resume
- Step 3: Increase your chances to get shortlisted & meet the client for the Interview!
About Uplers:
Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement.
(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).
So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!
