Staff Engineer, Data Engineering

• The Data Engineering team builds and optimizes systems spanning data ingestion, processing, storage optimization and more. We work closely with engineers and the product team to build highly scalable systems that tackle real-world data problems and provide our customers with accurate, real-time, fault tolerant solutions to their ever-growing data needs. We support various OLTP and analytics environments, including our Advanced Analytics and Digital Experience Management products.
• We are looking for skilled engineers experienced with building and optimizing cloud-scale distributed systems to develop our next-generation ingestion, processing and storage solutions. You will work closely with other engineers and the product team to build highly scalable systems that tackle real-world data problems. Our customers depend on us to provide accurate, real-time and fault tolerant solutions to their ever growing data needs. This is a hands-on, impactful role that will help lead development, validation, publishing and maintenance of logical and physical data models that support various OLTP and analytics environments.
• You will be part of a growing team of renowned industry experts in the exciting space of Data and Cloud Analytics
• Your contributions will have a major impact on our global customer-base and across the industry through our market-leading products
• You will solve complex, interesting challenges, and improve the depth and breadth of your technical and business skills.

What you will be doing

• Lead the design, development, and deployment of AI/ML models for threat detection, anomaly detection, and predictive analytics in cloud and network security.
• Architect and implement scalable data pipelines for processing large-scale datasets from logs, network traffic, and cloud environments.
• Apply MLOps best practices to deploy and monitor machine learning models in production.
• Collaborate with cloud architects and security analysts to develop cloud-native security solutions leveraging platforms like AWS, Azure, or GCP.
• Build and optimize Retrieval-Augmented Generation (RAG) systems by integrating large language models (LLMs) with vector databases for real-time, context-aware applications.
• Analyze network traffic, log data, and other telemetry to identify and mitigate cybersecurity threats.
• Ensure data quality, integrity, and compliance with GDPR, HIPAA, or SOC 2 standards.
• Drive innovation by integrating the latest AI/ML techniques into security products and services.
• Mentor junior engineers and provide technical leadership across projects.

Required skills and experience

AI/ML Expertise

• Proficiency in advanced machine learning techniques, including neural networks (eg, CNNs, Transformers) and anomaly detection.
• Experience with AI frameworks like TensorFlow, PyTorch, and Scikit-learn .
• Strong understanding of MLOps practices and tools (eg, MLflow, Kubeflow).
• Experience building and deploying Retrieval-Augmented Generation (RAG) systems, including integration with LLMs and vector databases.

Data Engineering

• Expertise designing and optimizing ETL/ELT pipelines for large-scale data processing.
• Hands-on experience with big data technologies (eg, Apache Spark, Kafka, Flink).
• Proficiency in working with relational and non-relational databases, including ClickHouse and BigQuery .
• Familiarity with vector databases such as Pinecone and PGVector and their application in RAG systems.
• Experience with cloud-native data tools like AWS Glue, BigQuery, or Snowflake.

Cloud and Security Knowledge

• Strong understanding of cloud platforms (AWS, Azure, GCP ) and their services.
• Experience with network security concepts, extended detection and response, and threat modeling.

Software Engineering

• Proficiency in Python, Java, or Scala for data and ML solution development.
• Expertise in scalable system design and performance optimization for high-throughput applications.

Leadership and Collaboration

• Proven ability to lead cross-functional teams and mentor engineers.
• Strong communication skills to present complex technical concepts to stakeholders.

Education

• BSCS or equivalent required, MSCS or equivalent strongly preferred