Search by job, company or skills

IRIS software

Databricks - Senior Engineer

Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted 6 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Why Join Iris
Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture thattruly values your talent and ambitions
Join Iris Software - one of thefastest-growing IT services companies- whereyou own and shape your success story.
About Us
At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential.
With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.
Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us
At Iris, every role is more than a job - it's a launchpad for growth.
Our Employee Value Proposition, Build Your Future. Own Your Journey.reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.
We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best - both personally and professionally.
Curious what it's like to work at Iris Head to this video for an inside look at the people, the passion, and the possibilities. Watch it .

Job Description

Core Technologies

  • Apache Spark (Core, SQL, Structured Streaming)
  • PySpark
  • Databricks (AWS/Azure)
  • Advanced SQL

DevOps & CI/CD

  • Jenkins
  • Git/GitHub/Bitbucket

Programming

  • Python
  • SQL
  • Java/Scala (Nice to have)

Cloud & Infrastructure

  • AWS (S3, EMR, EC2, IAM, CloudWatch)/Azure- Preferred
  • Databricks Runtime & Cluster Management- Preferred

Streaming & Integration

  • Apache Kafka
  • Snowflake integration (preferred)(Nice to have)
  • Airflow (preferred)(Nice to have)

Preferred Qualification

  • Experience in financial services, regulatory reporting, or enterprise data platforms.
  • Hands-on experience in Delta Lake optimization and incremental processing strategies.
  • Experience with Snowflake data warehousing.
  • Databricks Certification (Professional level preferred).
  • Strong understanding of distributed computing principles.

Key Responsibilities

  • Design and develop scalable batch and near-real-time ETL/ELT pipelines using Databricks (AWS) and Apache Spark (PySpark, Spark SQL, Structured Streaming).
  • Modernize legacy SQL/Hive/stored procedure workflows into distributed Spark-native architectures.
  • Perform Spark performance tuning, including:
  • Build structured streaming pipelines using Kafka and Spark Structured Streaming.
  • Design dimensional data models (Fact/Dimension, SCD Type 2).
  • Orchestrate pipelines using Databricks Workflows / Apache Airflow.
  • Integrate CI/CD pipelines using Jenkins, Git, Bitbucket/GitHub for automated deployment across DEV/UAT/PROD.

Mandatory Competencies

Data Science and Machine Learning - Data Science and Machine Learning - Databricks
Programming Language - Python - Apache Airflow
DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - GitLab,Github, Bitbucket
Development Tools and Management - Development Tools and Management - CI/CD
DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Jenkins
Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark
Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift
Cloud - AWS - AWS S3, S3 glacier, AWS EBS
Cloud - AWS - Amazon IAM, AWS Secrets Manager, AWS KMS, AWS Cognito
Database - Database Programming - SQL
Middleware - Message Oriented Middleware - Messaging (JMS, ActiveMQ, RabitMQ, Kafka, SQS, ASB etc)
Beh - Communication and collaboration

Perks and Benefits for Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click to view the benefits.

More Info

Job Type:
Function:
Employment Type:

About Company

A strategic partner that transformational leaders can trust to realize the full potential of technology-enabled transformation.As a trusted technology partner, we focus our highly-experienced talent and rightsized teams to develop complex, mission-critical applications and solutions for leading enterprise across financial services, life sciences, including pharmaceutical, CROs and medical devices, manufacturing & logistics and educational services.

Job ID: 146278643