- Posted 4 hours ago
- Be among the first 10 applicants
Job Description
Lead Engineer – Data Platform & Acquisition (LLM Corpora)
Build the data engine behind a frontier model — petabyte pipelines, and the deals that fill them.
Location: Delhi NCR or Bengaluru | Experience: 4 – 12 years
About the opportunity
We are retained by a well-funded AI lab building foundation models from the ground up in India — real compute, real pretraining, not fine-tuning on top of someone else's model. The team is small and the work is unusually direct: what you build ships into the model.
The client's identity is confidential at this stage and will be shared on first call.
What you will do
• Architect high-throughput pipelines processing petabytes of text and multimodal data.
• Implement deduplication, quality filtering and benchmark decontamination protocols.
• Lead licensing negotiations for proprietary datasets.
• Manage external vendors for large-scale digitisation and crowdsourcing.
What we are looking for
• 4+ years in data engineering or data acquisition.
• Proven ownership of large-scale data infrastructure.
• Strong vendor management and commercial negotiation ability.
What is on offer
• Compensation is open and benchmarked to the top of the Indian market for this profile, with meaningful equity.
• Delhi NCR is the primary base, but the client is flexible on Bengaluru for the right person.
• Relocation support, including for candidates returning from outside India.
How to apply
Apply here, or write to [Confidential Information] with your CV and links to anything you have published, shipped or open-sourced. We reply to every serious application within 48 hours.
Spotlight
- Joining bonus, Performance bonus, Mobile bill reimbursements, Relocation benefits, Retirement benefits, Health insurance
Bachelor Of Technology (B.Tech/B.E), Masters in Technology (M.Tech/M.E), Master of Science (MS/M.Sc), Bachelor in Management Studies (B.M.S.), PhD
More Info
Key Skills
Data Pipelines
Petabyte Scale
Ray
Data Licensing
Distributed Data Processing
