Databricks + Pyspark

Cognizant

Chennai, India

6-12 Years

Save

Posted 6 days ago
Be among the first 10 applicants

Early Applicant

Job Description

AIA - Chennai Weekend Drive - 07th Feb 2026

Skill - AWS Glue

Experience- 6 To 12 Years

Location - Chennai - Face to Face

Responsibilities

Design and implement scalable data architectures using AWS Glue Databrew and Spark Optimization to enhance data processing efficiency.
Oversee the deployment of AWS Cloud Formation templates to automate infrastructure provisioning ensuring consistency and reliability.
Provide expertise in AWS CloudWatch for monitoring and logging ensuring system performance and availability.
Optimize data storage solutions using Amazon Redshift and Amazon S3 ensuring cost-effectiveness and scalability.
Lead the development of ETL processes using AWS Glue Studio and AWS Glue ETL to streamline data integration and transformation.
Collaborate with cross-functional teams to ensure seamless integration of data solutions within the AWS cloud environment.
Conduct performance tuning and optimization of Apache Spark applications to improve processing speed and resource utilization.
Develop and maintain documentation for data architectures and processes ensuring clarity and accessibility for team members.
Evaluate and recommend new technologies and tools to enhance data processing capabilities and support business objectives.
Ensure data security and compliance with industry standards and regulations safeguarding sensitive information.
Provide technical guidance and support to team members fostering a collaborative and innovative work environment.
Analyze and resolve complex technical issues ensuring minimal disruption to data processing operations.
Contribute to the continuous improvement of data solutions aligning with the companys strategic goals and societal impact.

Qualifications

Possess strong expertise in AWS Glue Databrew Spark Optimization and related AWS services.
Demonstrate proficiency in AWS Cloud Formation AWS CloudWatch and Amazon Redshift.
Exhibit experience in AWS Glue Studio AWS Glue ETL and Amazon S3 for data integration and storage.
Have a solid understanding of Apache Spark and its optimization techniques.
Experience in the Provider domain is a plus.
Ability to work effectively in a hybrid work model with a focus on day shifts.
Strong problem-solving skills and a proactive approach to technical challenges.