AWS Databricks Developer
Tata Consultancy Services- Posted 2 hours ago
- Be among the first 10 applicants
Job Description
Hiring: AWS Databricks Developer | ADF | PySpark | Python | Terraform
Location: Indore / Pune / Hyderabad
Experience: 6-9 Years
Notice Period: Up to 90 Days
We are looking for a highly skilled AWS Databricks Developer with strong expertise in Azure Data Factory (ADF), PySpark, Python, and Terraform to join our growing data engineering team. The ideal candidate will have hands-on experience building scalable data pipelines, cloud-native data platforms, and infrastructure automation solutions.
Key Responsibilities:
Design, develop, and optimize data pipelines using Databricks, PySpark, and Python
Build and maintain data ingestion and transformation workflows using ADF
Work with large-scale datasets in cloud-based data lake and warehouse environments
Develop Infrastructure as Code (IaC) solutions using Terraform
Implement data quality, governance, security, and performance optimization practices
Collaborate with business stakeholders, architects, and cross-functional teams
Troubleshoot production issues and ensure high availability of data platforms
Required Skills:
AWS Cloud Services
Databricks
Azure Data Factory (ADF)
PySpark
Python
Terraform
SQL & Data Modeling
Data Lake / Data Warehouse Concepts
CI/CD and DevOps Practices
Version Control (Git)
Preferred Skills:
Delta Lake
Apache Spark Optimization
Airflow or Similar Workflow Orchestration Tools
Snowflake or Redshift Exposure
Agile/Scrum Methodologies
Qualification:
Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
What We're Looking For:
Strong problem-solving and analytical skills
Excellent communication and stakeholder management abilities
Experience in enterprise-scale cloud data engineering projects
More Info
Key Skills
AWS Cloud Services
SQL Data Modeling
CI CD and DevOps Practices
Version Control Git
Azure Data Factory ADF
Data Lake Data Warehouse Concepts
