

Search by job, company or skills

Senior Big Data / ETL Engineer
Hadoop | PySpark | Python | HDFS | Kafka | Streaming | ETL | Informatica | DevOps | Copilot
Experience
5-8 Years
Location
Bangalore
Work Model
Hybrid: minimum 3 days per week from RMZ Ecoworld, Bangalore
Cloud Preference
Azure and/or AWS
Primary Skills
Hadoop, PySpark, Python, HDFS, Kafka, Streaming, ETL, Informatica, DevOps, Copilot, Markdown
Job Summary
We are looking for a skilled Senior Big Data / ETL Engineer with 5-8 years of hands-on experience in designing, developing and supporting enterprise-scale big data, ETL and streaming solutions. The role requires strong practical expertise in Hadoop ecosystem technologies, PySpark, Python, HDFS, Kafka, real-time streaming and ETL development, with working knowledge of Informatica.
The candidate should have DevOps awareness, cloud exposure on Azure and/or AWS, and the ability to use Microsoft Copilot or equivalent AI-assisted development tools to improve productivity across coding, debugging, unit test generation, documentation and operational support. Strong ownership of Markdown-based technical documentation aligned with company standards is essential.
Job ID: 152813823
Skills:
Unix, Hadoop, Scala, Spark, Sql, Big Data Developer, BDF with Hadoop
Skills:
Java, Pycharm, Scala, Apache Spark, Kafka, Eclipse, Sql, Intellij, Git, Hive, Gcp, MySQL, Vim, Databricks, Azure, Hadoop Hdfs, Python, AWS, VS Code, Kafka Connect
Skills:
Apache Spark, Hive, Sparksql, Sql Performance Tuning, Impala, Python, Hadoop, Scala, Presto
Skills:
Hive, Pyspark, Spark, Python