Azure Databricks, ADF, Pyspark, Python, Terraform

TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform

Experience Range: - 06 To 10 Years (Mandatory)

(Note: Candidates below 06 years of IT experience shall not be considered)

JOB LOCATION: Chennai

JOB DESCRIPTION

Key Responsibilities:

• Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.
• Build and optimize large-scale ETL/ELT processes using PySpark and Python.
• Ingest data from various structured and unstructured sources into Azure Data Lake.
• Develop batch and real-time data processing solutions.
• Create reusable data transformation frameworks and data quality checks.
• Implement Infrastructure as Code (IaC) using Terraform.
• Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Develop CI/CD pipelines for deployment automation.
• Collaborate with business stakeholders, architects, and development teams to define data requirements and solutions.
• Support production deployments and troubleshoot data pipeline issues.
• Follow data governance, security, and compliance standards.

Required Technical Skills:

1) Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure DevOps

2) Data Engineering: Strong expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing

3) Programming: Python, PySpark, SQL

4) Infrastructure as Code: Terraform, Azure Resource Management Concepts

5) Databases: Azure SQL Database, SQL Server, PostgreSQL, Cosmos DB (Preferred)

6)DevOps: Azure DevOps, Git, CI/CD Pipeline Implementation

Mandatory Skills:

• Azure Databricks
• Azure Data Factory (ADF)
• PySpark
• Python
• Terraform
• SQL
• Azure Data Lake Storage (ADLS)
• Azure DevOps

Preferred Skills:

• Delta Lake
• Unity Catalog
• Spark Optimization
• Data Governance
• Real-time Streaming (Kafka/Event Hub)
• Synapse Analytics
• Machine Learning Integration

Minimum Qualification:

15 years of Full Time Education

Interested candidates kindly share your updated resume to [Confidential Information] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:

Section 1: Basic Details:

• Candidate Name:
• Email ID:
• Phone Number:
• Current Location (City):
• Preferred Location (City):

Section 2: Educational Details:

• Highest Regular Full‑Time Qualification
• (Diploma / Graduation / Post Graduation / Others)
• 10th Completion Year
• 12th / Intermediate Completion Year
• Graduation Completion Year
• Post‑Graduation Completion Year (if applicable)

Section 3: Work Experience:

• Current Company Name
• Total Experience (in years)
• Number of Companies Worked
• Employment Timeline
• (Example: Company A – 2021 to Present, Company B – 2019 to 2021)

Section 4: Compensation Details:

• Current CTC (in LPA)
• Expected CTC (in LPA)
• Notice Period
• (Immediate / 15 Days / 30 Days / 60+ Days)

Section 5: Documentation & Compliance (Yes / No):

• Valid ID Proof Available (Aadhar & Pan Card): (Yes/No)
• Educational Documents Available: (Yes/No)
• Employment Documents Available: (Yes/No)
• UAN Number Available: (Yes/No)