Lead Software Engineer

Design and develop large-scale data processing pipelines using Java and Spark with AWS mandate. Build and maintain distributed applications utilizing Spark SQL, Spark Streaming, and DataFrames/Datasets. Optimize Spark jobs for performance, scalability, and resource utilization. Troubleshoot and resolve complex performance bottlenecks and production issues in a timely manner.

Qualifications: Bachelors degree in Computer Science Information Technology, or a related field 7 to10 years of experience in ava / Spark / AWS and Proven track record of delivering high-quality software solutions. Design and develop large-scale data processing pipelines and scalable microservices.

• Implement data integration solutions and ETL workflows.
• Write and maintain robust unit tests using JUnit 5, Mockito, and Cucumber.
• Collaborate with cross-functional teams to define and ship new features in a Scrum environment.). Proficiency in Java and strong experience with the Apache Spark ecosystem.
• Hands-on experience with Hadoop, Hive, and messaging systems like Apache Kafka.
• Deep understanding of distributed computing principles and AWS architecture (S3, EC2, Lambda, RDS). Experience with Splunk, Dynatrace, or Grafana for monitoring and observability.
• Excellent problem-solving skills and experience leading offshore teams in a technical capacity. Experience in Agile Methodology
  
  

Preferred To Have Citi Process Knowledge

Good Communication Skills