Hiring Senior Data Engineer with 5+ years strong hands on experience in SQL, TSQL, ADF(Data Factory), ETL tools for Bangalore location.
Job Description:
Key Responsibilities
- Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory (ADF).
- Integrate data from multiple sources (structured, semi-structured, and unstructured) into Azure Data Lake or Data Warehouse environments.
- Develop and optimize complex SQL queries, stored procedures, and data models for efficient data processing.
- Implement data validation, quality checks, and error handling in ETL workflows.
- Collaborate with data architects, analysts, and business teams to understand data requirements and translate them into scalable data solutions.
- Ensure data governance, lineage, and security across all data pipelines.
- Monitor and troubleshoot performance issues in data flows and pipelines.
- (Preferred) Work with Databricks notebooks, Python scripts, or Spark-based transformations for advanced data processing.
- Contribute to continuous improvement by evaluating and recommending modern data tools and best practices.
Must-Have Skills
- 56 years of experience as a ADF Developer/Data Engineer or ETL Developer.
- Strong hands-on experience with Azure Data Factory (ADF) pipeline orchestration, linked services, triggers, and activities.
- Excellent command of SQL (T-SQL or similar) writing, optimizing, and troubleshooting complex queries.
- Solid understanding of Data Warehousing concepts, dimensional modeling, and ETL best practices.
- Experience with Azure ecosystem (Azure SQL Database, Data Lake Storage, Synapse Analytics, etc.).
