Big Data Applications Engineer_AWS

We are looking for an experienced Big Data Applications Engineer with strong software development skills and hands-on experience in AWS, distributed data processing, and API development.

Key Responsibilities

• Design, develop, test, and deploy scalable Big Data applications using Java, Scala, Python, and Spark.
• Build and maintain distributed batch-processing applications using Hadoop, HDFS, Spark, and MapReduce.
• Integrate new data sources and tools into existing Big Data ecosystems.
• Develop and support REST APIs, SOAP web services, microservices, and API integrations.
• Design and implement scalable data-processing solutions using AWS services.
• Optimize batch application performance across Spark, Hadoop, EMR, Java, and Python workloads.
• Work with cross-functional teams to design, develop, and deploy reliable data solutions.
• Collaborate with onsite and offshore teams, providing technical guidance on architecture and development.
• Follow secure development practices, automated testing, and CI/CD processes.
  
  

Mandatory Technical Skills

• Programming: Java, Scala, Python
• Big Data: Apache Spark, Hadoop, HDFS, MapReduce, Cassandra
• AWS: EMR, EC2, ECS, S3, Airflow, Step Functions, API Gateway
• API Development: REST APIs, SOAP Web Services, Microservices
• Scripting: Linux, Shell Scripting, Python
• Performance Tuning: Spark, Hadoop, EMR, Java, and Python batch applications
  
  

Preferred Skills

• Git, GitHub, Bitbucket, GitLab
• Maven, Gradle, Jenkins, Artifactory
• AWS CodeCommit and CloudFormation
• IntelliJ IDEA / PyCharm
• CI/CD and automated deployment practices
  
  

Skills: java,microservices,linux,ci/cd,aws,rest apis,python