Search by job, company or skills

6sense

Data Platform Engineer

This job is no longer accepting applications

new job description bg glownew job description bg glow
  • Posted 7 months ago

Job Description

Our Mission:

6sense is on a mission to revolutionize how B2B organizations create revenue by predicting customers most likely to buy and recommending the best course of action to engage anonymous buying teams. 6sense Revenue AI is the only sales and marketing platform to unlock the ability to create, manage and convert high-quality pipeline to revenue.

Our People:

People are the heart and soul of 6sense. We serve with passion and purpose. We live by our Being 6sense values of Accountability, Growth Mindset, Integrity, Fun and One Team. Every 6sensor plays a part in dening the future of our industry-leading technology. 6sense is a place where difference-makers roll up their sleeves, take risks, act with integrity, and measure success by the value we create for our customers.

We want 6sense to be the best chapter of your career.

We are looking for a hands-onData Platform Engineer to contribute to 6sense for our large-scale distributed ingestion and processing framework built on Apache Storm,Kafka,Spark.The engineer will work on improving reliability, scalability, and observability across real-time and batch data pipelines.
Key Responsibilities
  • Develop and maintainreal-time ingestion topologies(Apache Storm / Kafka) andbatch pipelines(Spark / Hive).
  • EnhanceS3-based ingestion, checkpointing, and recovery mechanismsfor distributed data systems.
  • Build and optimizeETL workflowsfor ingestion, crawling, and enrichment pipelines.
  • Implementmonitoring, alerting, and fault recoveryacross the ingestion platform.
  • Collaborate with internal teams to integrate crawled and processed data into downstream systems.
Required Skills
  • Strong understanding ofApache Storm,Kafka, andSparkfor distributed data processing.
  • Hands-on experience withHiveandpartitioned table managementon S3/HDFS.
  • Proficiency inJava and Pythonfor stream and batch pipeline development.
  • Familiarity withAWS services(S3, EC2, IAM) and CI/CD pipelines.
  • Strong debugging skills inmulti-threaded or distributed environments.
Preferred / Nice-to-Have
  • Prior experience tuningStorm topologies, Spark job parallelism, andS3A connector performance.
  • Exposure todata lake architecturesand schema evolution in Hive.
  • Experience withfault-tolerant design patterns(checkpointing, retries, recovery).
  • Familiarity withobservability tools(Grafana, Prometheus, ELK).
  • Good understanding ofdata lineage and metadata management.

Our Benefits:

Full-time employees can take advantage of health coverage, paid parental leave, generous paid time-off and holidays, quarterly self-care days off, and stock options. We'll make sure you have the equipment and support you need to work and connect with your teams, at home or in one of our oces.

We have a growth mindset culture that is represented in all that we do, from onboarding through to numerous learning and development initiatives including access to our LinkedIn Learning platform. Employee well-being is also top of mind for us. We host quarterly wellness education sessions to encourage self care and personal growth. From wellness days to ERG-hosted events, we celebrate and energize all 6sense employees and their backgrounds.

Equal Opportunity Employer:

6sense is an Equal Employment Opportunity and Affirmative Action Employers. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. If you require reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to

We are aware of recruiting impersonationattempts that are not affiliated with 6sense in any way. All email communications from 6sense will originate from the @6sense.com domain. We will not initially contact you via text message and will never request payments. If you are uncertain whether you have been contacted by an official 6sense employee, reach out to

More Info

Job Type:
Employment Type:

About Company

6sense uncovers anonymous buying behavior, prioritizes accounts for sales and marketing, and enables them to engage resistant buying teams with personalized, multi-channel, multi-touch campaigns. 6sense helps revenue teams know everything they need to know about their buyers so they can easily do anything needed to generate more opportunities, increase deal size, get into opportunities sooner, and compete and win more often.

Job ID: 130093155

Similar Jobs

Bengaluru, India

Skills:

snowflake JavaApache SparkKafkaJsonAvroSqlDatabricksSybase IqKubernetesPythonApache IcebergParquetCI CD toolingHadoop ecosystem technologies

Bengaluru, India

Skills:

Agile MethodologiesMicrosoft Azure Data ServicesMicrosoft Azure Data Engineer Associate certifiedAdvanced programming skillsMicrosoft Azure Fundamentals certifiedSQL T-SQL programming

Hyderabad, Bengaluru, Pune

Skills:

graph databases platforms and services.optimize database performance.Troubleshootcloud-based

Bengaluru

Skills:

Solution DevelopmentGen AIAgentic AIProcess AutomationPrompt Engineering