Senior Data Platform Engineer

Role: Senior Data Platform Engineer - R&D

About Us

Netcore.ai is a leading AI-powered B2B SaaS Customer Experience and Marketing Technology platform, helping 6,500+ brands across 20+ countries deliver personalized customer experiences at scale. Our engineering teams build highly scalable, cloud-native products that process billions of customer interactions every day.

Role Summary

You will evaluate, benchmark and prototype next-generation data platform technologies (open table formats, streaming systems, NoSQL and OLAP databases) for Netcore's high-scale omnichannel marketing platform. You will run experiments, build proof-of-concept systems, and turn the results into clear recommendations that engineering and product teams use to decide what we adopt, build or buy.

This is a hands-on engineering role. You will write code every week, and your findings will shape our platform direction.

What You'll Do

• Design and run rigorous benchmarks and scalability studies across databases, storage engines, messaging and streaming systems
• Prototype and stress-test new architectures for high-throughput data ingestion, real-time analytics and large-scale personalization workloads
• Evaluate open table formats and lakehouse stacks (Iceberg, Hudi, Delta) and their catalogs, query engines and storage layers
• Compare technology options and give build-versus-buy recommendations backed by experimental data
• Write design documents, RFCs, benchmark reports and engineering articles that inform technology decisions
• Move successful prototypes into production-ready solutions together with platform and product engineering teams
• Track emerging data infrastructure technologies and share actionable insights with engineering leadership

Must-Have Skills

• Strong programming in Java and Python (Go or Rust is a plus) for rapid prototyping.
• Hands-on experience building data pipelines and data platforms at scale, using Kafka and Spark (or Flink).
• Working knowledge of at least one open table format (Iceberg, Hudi or Delta Lake) and how it differs from plain files on object storage.
• Experience with two or more NoSQL or analytical databases (e.g., Cassandra, MongoDB, ClickHouse, Druid, Aerospike, BigQuery, Snowflake), including the trade-offs between them.
• Strong data modeling skills: normalized vs. denormalized design, dimensional modeling, query-driven NoSQL design, partitioning and key design, and schema evolution.
• Strong SQL and query optimization: reading and tuning execution plans, indexing and partitioning strategies, join and aggregation optimization, and diagnosing slow queries on both relational and analytical engines.
• Solid understanding of columnar and row file formats (Parquet, Avro, ORC), including compression, predicate pushdown and schema evolution.
• Strong data structures, algorithms and distributed systems fundamentals.
• Experience benchmarking and profiling workloadsto classify them as CPU-bound, memory-bound or I/O-bound, using tools such as perf, top/htop, vmstat, iostat, strace or flame graphs, and designing controlled experiments to interpret results.
• Experience on AWS or GCP.

Nice to Have

• Benchmarking tools such as YCSB, Sysbench or HammerDB, and cloud-native observability stacks
• Trino, Flink, Databricks, Polaris/Nessie or Alluxio
• Vector databases (e.g., Milvus, Pinecone, pgvector) and graph databases (Neo4j, TigerGraph)
• Probabilistic data structures and compressed bitmaps (Apache DataSketches, Roaring Bitmaps)
• Open-source contributions, conference talks, published technical papers or engineering blog posts
• Experience taking experimental prototypes into production

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering or a related field
• 4–10 years of experience in backend, data platform with demonstrated experience developing, evaluating or benchmarking large-scale systems

Impact Metrics

• Number of successful experimental prototypes incubated and adopted by engineering teams.
• Published benchmarks, whitepapers, or technical reports that inform strategic technology decisions.
• Measurable improvements in platform scalability, reliability, or engagement attributed to research findings and new tech integrations.

Why Join Us

• Build products used by 6,500+ global brands.
• Solve engineering challenges at scale using modern technologies.
• Work with cloud-native architectures, distributed systems, AI-powered development tools, and a high-performing engineering team.
• Thrive in a culture of ownership, innovation, and continuous learning.

Global Recognitions

• Leader in Commerce Search and Product Discovery in The Forrester Wave 2023
• The only Forrester-rated global vendor in Product Discovery, Cross Channel Marketing Hubs and Email.
• Leader in Marketing Platforms in G2's Winter 2024 Grid
• Top 20 global Google Cloud Partner
• Appraised at Level 3 of ISACA's CMMI® by Equalitas Certifications Limited
• Great Place to Work® for six consecutive years in India

Know More About Us

• Agentic Marketing Platform: Co-Marketer
• Our Growth Story: *The Proficorn Playbook – How Netcore Built a $100M+ ARR Business Without VC Funding*
• Life at Netcore: Explore our culture, and employee experiences
• Blogs
• Customer Success Stories
• Product & Tech Documentation
• Be a Proficorn: Watch/listen to our podcast of Netcore's leaders in conversation with industry experts

Netcore is an equal opportunity employer.