Role: Sr Data Engineer
Experience: 4+yrs
Location: Bengaluru
Notice Period: Immediate Joiner or max 15days preferred
Skills: Hive, Spark, Airflow, Oracle OCI Big Data, Data Lake, Sqoop, File Processing, Pipeline Support
Job Description
We are looking for a
Data Engineer with 4+ years of experience in building, maintaining, and supporting large-scale data pipelines. The role requires strong hands-on experience with
Hive, Spark, and
Airflow, along with exposure to
Oracle OCI Big Data Services and Data Lake environments.
Key Responsibilities
- Develop and optimize ETL/ELT pipelines using Spark, Hive, and Airflow
- Manage data ingestion workflows including Sqoop transfers (Oracle Hive) and file-based processing
- Monitor, debug, and support production data pipelines and batch workflows
- Work with OCI Big Data Service, Data Lake, and distributed storage systems
- Perform performance tuning and troubleshoot issues across Spark jobs, Hive queries, and Airflow DAGs
Required Skills
- 4+ years of Data Engineering experience
- Strong in Spark (PySpark/Scala), Hive, SQL, and Linux
- Hands-on experience with Airflow, Sqoop, and file ingestion
- Experience working on OCI Big Data / Data Lake platforms
- Strong debugging and pipeline support capabilities
Nice to Have
- Knowledge of Informatica, HDFS, or Cloud Data Integration tools
- Good understanding of CI/CD, Git, and scripting
