Data Engineer

Databricks Developer 4+ Years - Gurgaon/Noida

We are hiring an experienced Databricks Developer to join a high-performing data engineering team. The role involves designing and optimizing Spark-based data pipelines on Databricks, working closely with stakeholders to deliver scalable, high-quality analytics solutions on Azure.

Location Gurgaon / Noida

Your Future Employer You will be working with a prestigious organization known for its commitment to diversity, equality and inclusion. They offer a dynamic work environment, opportunities for career growth, and a supportive team culture

Responsibilities

1. Design, develop, and optimize scalable data pipelines using Apache Spark on Databricks.
2. Build and manage ETL/ELT workflows to ingest, transform, and load data from multiple sources.
3. Collaborate with data scientists, analysts, and business stakeholders to deliver robust data solutions.
4. Ensure data quality, integrity, governance, and performance across all pipelines.
5. Monitor, troubleshoot, and optimize Databricks notebooks, jobs, and clusters.

Requirements

1. 4+ years of experience in data engineering or big data development.
2. Strong hands-on expertise in Apache Spark, PySpark, and SQL.
3. Proven experience working on the Databricks platform (notebooks, jobs, clusters).
4. Experience with Azure cloud services, preferably Azure Data Lake.
5. Working knowledge of CI/CD practices and version control tools such as Git.

What is in it for you Opportunity to work with a globally recognized insurance consulting organization, exposure to large-scale cloud data platforms, continuous learning and certification support, and a collaborative, growth-oriented work culture.

Reach us If you think this role is aligned with your career, kindly write to me with your updated CV at [Confidential Information] for a confidential discussion on the role.

Disclaimer Crescendo Global specializes in Senior to C-level niche recruitment. We are committed to providing an inclusive hiring experience and do not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Note Due to a high volume of applications, only shortlisted candidates will be contacted. If you do not hear from us within one week, please consider that your profile has not been shortlisted at this stage.

Scammers can misuse Crescendo Globals name for fake job offers. We never ask for money, purchases, or system upgrades. Verify all opportunities at www.crescendo-global.com and report fraud immediately. Stay alert!

Profile Keywords Crescendo Global, Databricks Developer Jobs, Senior Analyst Programmer, Azure Data Engineering Jobs, Spark PySpark Jobs, Big Data Jobs in Gurgaon, Big Data Jobs in Noida, Insurance Analytics Jobs, Cloud Data Engineer Jobs, ETL ELT Databricks