AWS Databricks Engineer

TCS Hiring for AWS Databricks Engineer

Experience Range: - 06 To 10 Years (Mandatory)

(Note: Candidates below 6 years of IT experience shall not be considered)

JOB LOCATION: Bengaluru, Chennai, Pune

JOB DESCRIPTION

Key Skills: AWS, Databricks Notes, Databricks Workflows, Cloud formation, GLUE, IAM, EC2, S3

Key Responsibilities:

• Design, build, and optimize robust and scalable data pipelines using Python and PySpark on AWS services like S3, EC2, EMR, Glue, and Databricks.
• Implement processes for ingesting, transforming, and aggregating large datasets to support analytics, reporting, and machine learning initiatives.
• Utilize various AWS services (e.g., S3, EC2, EMR, Glue, Lambda, CloudFormation, Databricks) to build, deploy, and manage data solutions.
• Tune and optimize PySpark jobs and AWS resources for efficiency, cost-effectiveness, and performance.
• Write clean, efficient, and well-documented Python code for data processing, automation, and orchestration.
• Ensure data integrity, quality, and security through best practices, including error handling, auditing, and compliance with data governance standards.
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Monitor, troubleshoot, and resolve issues related to data pipelines and AWS infrastructure.
• Keep abreast of the latest industry trends and technologies in big data, cloud computing, and data engineering.

Required Skills

• Looking for resources must having AWS Databricks, Pyspark, Python and PL/SQl
• Strong experience in developing and optimizing PySpark applications for big data processing.
• Hands-on experience with relevant AWS services (e.g., S3, EC2, EMR, Glue, Lambda, CloudFormation).
• Solid understanding of big data technologies, distributed computing, and parallel processing.
• Strong SQL skills and experience with database systems.
• Understanding of data warehousing concepts, ETL processes, and data modeling.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration abilities.

Minimum Qualification

15 years of Full Time Education

Interested candidates kindly share your updated resume to [Confidential Information] immediately with the details below (Mandatory)

Name:

Contact No.

Email id:

Skillset:

Total exp:

Relevant Exp:

Fulltime highest qualification (Year of completion with percentage scored):

Current organization details (Payroll company):

Current CTC:

Expected CTC:

Notice period:

Current location:

Preferred Location:

Any gaps between your education or career (If yes pls specify the duration):

Will you be able to join within 30/45 days (Yes/NO)