AWS Bigdata - Lead

Why Join Iris

Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions

Join Iris Software one of the fastest-growing IT services companies where you own and shape your success story.

About Us

At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us

At Iris, every role is more than a job it's a launchpad for growth.

Our Employee Value Proposition, Build Your Future. Own Your Journey. reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best both personally and professionally.

Curious what it's like to work at Iris Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description

Key Responsibilities

• Design, develop, and maintain scalable Big Data solutions on AWS
• Build and optimize data ingestion, transformation, and processing pipelines
• Work with large-scale structured and unstructured datasets
• Implement ETL/ELT workflows using cloud-native and Big Data tools
• Optimize performance, cost, and reliability of AWS data services
• Ensure data quality, security, and governance best practices
• Mentor junior engineers and contribute to technical best practices
  
  

Technical Skills (Must Have)

AWS Cloud

• Strong hands-on experience with AWS services such as:
• S3, EC2, EMR, Glue, Athena, Redshift, Lambda, Airflow
• IAM, CloudWatch, CloudFormation / Terraform
• Exposure to Data Lake / Lakehouse architectures
• Experience in cost optimization and performance tuning
  

Big Data & Data Engineering

• Strong experience with Apache Spark (PySpark/Scala)
• Hands-on with Hadoop ecosystem (HDFS, Hive, Sqoop, HBase as applicable)
• Experience with streaming frameworks (Kafka / Kinesis preferred)
• Solid understanding of data modeling and warehousing concepts
  
  

Programming & Tools

• Proficiency in Python / Scala / Java
• Strong SQL skills
• Experience with Linux/Unix environments
• Version control using Git
  
  

Good to Have

• Knowledge of DevOps & CI/CD pipelines
• AWS certifications (Associate or Professional)
• Experience working in Agile/Scrum teams
  
  

Soft Skills

• Strong analytical and problem-solving abilities
• Excellent communication and stakeholder management skills
• Ability to work independently and in cross-functional teams
• Ownership mindset with attention to detail
  
  

Mandatory Competencies

Big Data - Big Data - HDFS

Big Data - Big Data - HIVE

Big Data - Big Data - Hadoop

Big Data - Big Data - Pyspark

DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Git

Database - Database Programming - SQL

Operating System - Operating System - Linux

Programming Language - Scala - Scala

Cloud - AWS - Amazon EC2 / Autoscalaing / Load Balancing, AWS App Runner

Cloud - AWS - AWS S3, S3 glacier, AWS EBS

Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift

Cloud - AWS - Amazon IAM, AWS Secrets Manager, AWS KMS, AWS Cognito

Cloud - AWS - AWS Lambda,AWS EventBridge, AWS Fargate

DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Terraform

Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight

ETL - ETL - AWS Glue

Beh - Communication and collaboration

Perks And Benefits For Irisians

Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.