Data Engineer

Company Description

ThreatXIntel is a growing Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions.

We are hiring for our corporate client. ThreatXIntel is the official hiring partner for this requirement.

Job Overview

We are looking for a Data Engineer with strong hands-on experience in GCP and Databricks, along with exposure to Azure data services.

The ideal candidate should be capable of building scalable data pipelines, data platforms, and cloud-based data solutions, and should be ready to join immediately (within 2 days).

Immediate joiners are mandatory (0–2 days only)

Key Responsibilities

Data Engineering & Development

• Build and maintain ETL/ELT pipelines on GCP and Databricks
• Work with BigQuery, Dataproc / Spark, and cloud storage systems
• Develop scalable data processing solutions using PySpark / SQL

Databricks & Lakehouse

• Design and implement Databricks-based data pipelines
• Work with Delta Lake and Lakehouse architecture concepts

Azure Exposure

• Work with Azure Data Services (ADF, Synapse, Data Lake – good to have)

Pipeline & Integration

• Integrate data from multiple sources into enterprise platforms
• Ensure data quality, performance, and scalability

Collaboration

• Work with cross-functional teams (analytics, engineering, business)
• Support production systems and troubleshoot pipeline issues

Required Skills (Mandatory)

• Strong experience in GCP Data Services (BigQuery, Dataproc / Spark)
• Hands-on experience with Databricks
• Strong programming skills in Python / PySpark / SQL
• Experience in ETL/ELT pipeline development
• Knowledge of data modeling and data warehousing concepts

Nice to Have

• Experience with Azure Data Factory / Synapse / Data Lake
• Exposure to real-time data processing (Pub/Sub, Kafka, etc.)
• Experience with CI/CD pipelines