Data Engineer

Tata Consultancy Services

6-8 Years

Chennai, India

Early Applicant

Posted 5 days ago
Be among the first 20 applicants

Job Description

Must-Have

Min 6+ years experience in implementing projects in Azure stacks
Experience with Azure Databricks, Data Factory
Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
Experience in Python PySpark
Experience in data ingestion, curation and transformation using spark

Good-to-Have

Excellent verbal and written communication and interpersonal skills
Ability to work independently and within a team environment.

Responsibility of / Expectations from the Role

1 Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation

2 Design, code, unit test, and code review iterative improvements to platform

3 Ensure adherence to sound architecture

4 Build and maintain the Infrastructure for data products, including data pipelines, storage systems, and processing engines.

5 Ensures the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime.

6 Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.