Data Engineer
Data Engineer
IDEAON INCThis job is no longer accepting applications
Job Description
Hiring: Senior Data Engineer (Databricks + Airflow)
We're looking for a hands-on Senior Data Engineer to join a fast-growing team working on modern data platforms and scalable data pipelines.
Location: Bengaluru (Hybrid – Panathur)
Role Type: Full-time
Client Domain: Global Technology & Digital Engineering Services
What you'll be working on:
- Building scalable data pipelines using Databricks (Delta Lake) and PySpark
- Designing and orchestrating workflows using Airflow
- Developing end-to-end ETL pipelines (ingestion transformation storage)
- Working on modern lakehouse architecture and large-scale data systems
Must-Have Skills:
- Strong hands-on experience with Databricks
- Expertise in PySpark / Apache Spark
- Experience with Airflow
- Strong Python + SQL
- 6–8 years of relevant Data Engineering experience
Good to Have:
- Experience with Kafka / streaming pipelines
- Knowledge of data modeling / warehousing
- Exposure to AWS or Azure cloud
Note:
Please apply only if you have hands-on experience with Databricks and Airflow.
More Info
Job Type:
Industry:
Employment Type:
Key Skills
About Company
Skills:
Pyspark, AWS Glue, Data Modeling, Emr, Avro, Autosys, Sql, Cloudwatch, Terraform, Etl Tools, Databricks, Python, AWS, Airflow, Parquet, AWS Lake Formation, Iceberg
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
Skills:
Kms, Pyspark, Iam, Sql, Python, AWS Lake Formation
Skills:
Scala, Python, Spark
Skills:
data engineering , Sql, Python