Lead Data Engineer
- Posted 2 days ago
- Be among the first 20 applicants
Job Description
Why Join Iris
Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions
Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story.
About Us
At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential.
With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.
Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.
Working with Us
At Iris, every role is more than a job — it's a launchpad for growth.
Our Employee Value Proposition, Build Your Future. Own Your Journey. reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.
We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.
Curious what it's like to work at Iris Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.
Job Description
Mandatory Skills:
Python, Apache Spark, Data Quality & Validation, PySpark, SQL, Amazon Kinesis, Apache Kafka, Databricks Workflows, Delta Lake on Databricks
Additional Skills
AWS S3 + Amazon Aurora + DynamoDB, AWS Glue, AWS Redshift, Data Governance Frameworks, GitHub
Key Responsibilities
Perks And Benefits For Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.
Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions
Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story.
About Us
At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential.
With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.
Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.
Working with Us
At Iris, every role is more than a job — it's a launchpad for growth.
Our Employee Value Proposition, Build Your Future. Own Your Journey. reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.
We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.
Curious what it's like to work at Iris Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.
Job Description
Mandatory Skills:
Python, Apache Spark, Data Quality & Validation, PySpark, SQL, Amazon Kinesis, Apache Kafka, Databricks Workflows, Delta Lake on Databricks
Additional Skills
AWS S3 + Amazon Aurora + DynamoDB, AWS Glue, AWS Redshift, Data Governance Frameworks, GitHub
Key Responsibilities
- Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
- Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
- Demonstrates strong ownership while driving data engineering excellence.
- Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
Perks And Benefits For Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.
More Info
Key Skills
Amazon Aurora
Delta Lake on Databricks
Data Governance Frameworks
Data Quality Validation
Databricks Workflows
About Company
Skills:
data engineering , Medallion Architecture- Bronze Silver Curated Data Layers, Pyspark, Azure Databricks, Sql, Azure Data Factory, Parquet, Batch and Incremental Processing, Git and Version Control, ETL ELT, Data Pipeline Development, Spark Performance Tuning, Delta Lake, Delta Lake Performance Optimization
Skills:
Sql, Aws Redshift, Aws S3, Dynamodb, AWS Glue, Github, Apache Spark, Pyspark, Python, Amazon Kinesis, Apache Kafka, Databricks Workflows, Data Quality Validation, Data Governance Frameworks, Amazon Aurora, Delta Lake on Databricks
Skills:
Sql, Api Integration, Adf, Sql Queries, Adb, Delta Tables, Delta Share SQL Endpoints, Databricks Notebooks, ETL processes
Skills:
snowflake , Azure, Devops, Google Cloud Platform, Pyspark, Databricks, Python, Sql, AWS, Airflow, dbt