Skill: Aws Data Engineer
Experience: 6 to 9 years
Location: AIA Chennai
Job Summary
We are looking for a Data engineer with focus on Data Virtualization. The associate is expected to have strong proficiency in Starburst Trino or Apache Trino including installation configuration and performance tuning as primary skill. Additionally the associate is expected to have the following skills.
- Cloud platform knowledge (AWS)
- Monitoring and troubleshooting distributed queries
- Understanding of security (LDAP Ranger)
- Programming experience (Python SQL Bash Node.js scripting).
Responsibilities
We are looking for a Data engineer with focus on Data Virtualization. The associate is expected to have strong proficiency in Starburst Trino or Apache Trino including installation configuration and performance tuning as primary skill. Additionally the associate is expected to have the following skills.
- Cloud platform knowledge (AWS)
- Monitoring and troubleshooting distributed queries
- Understanding of security (LDAP Ranger)
- Programming experience (Python SQL Bash Node.js Linux and Unix Shell etc.)
- Experienced in data engineering practices (including versioning release management deployment agile & related software tools like GitHub Actions Terraform Kubernetes etc).
- Strong analytical and problem-solving abilities attention to detail and customer focus.
- Develop and implement scalable applications using Node JS and Python to enhance business processes.
- Collaborate with cross-functional teams to ensure seamless integration of applications with existing systems.
- Utilize Agile Methodologies to manage and deliver projects efficiently and effectively.
- Oversee the deployment and management of applications on the AWS Platform ensuring optimal performance.
- Implement and maintain Kubernetes clusters to support containerized applications.
- Use Terraform for infrastructure as code to automate and streamline deployment processes.
- Manage and optimize database systems using SQL to ensure data integrity and availability.
- Develop and maintain shell scripts and Bash scripts for automation and task scheduling.
- Utilize GitHub Actions for continuous integration and delivery to improve software release cycles.
- Ensure robust release management processes are in place to minimize downtime and disruptions.
- Implement security protocols using Apache Ranger and LDAP to protect sensitive data.
- Leverage Starburst and data virtualization techniques to provide seamless data access.
- Provide technical guidance and support to junior developers to foster a collaborative team environment.
Qualifications
- Demonstrated expertise in Agile Methodologies and experience in leading agile teams.
- Proficiency in Kubernetes and Terraform for managing cloud infrastructure.
- Strong skills in Node JS and Python for application development.
- Experience with AWS Platform for deploying and managing applications.
- Knowledge of database management and SQL for data handling.
- Familiarity with Apache Ranger and LDAP for security management.
- Ability to work in a hybrid model with a focus on day shifts.
Certifications Required
Good to have - AWS Certified Solutions Architect Certified Kubernetes Administrator
