Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data pipeline solutions.
Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data warehousing and analytics initiatives.
Key Responsibilities:
Lead thedesign and developmentof ETL processes and data integration solutions.
Develop and maintain ETL workflows using tools such asSSIS, Azure Databricks, SparkSQLor similar.
Collaborate with data engineers, analysts, and business stakeholders to gather requirements and translate them into technical solutions.
Optimize ETL processes forperformance, scalability, and reliability.
Conduct code reviews, provide technical guidance, and mentor junior developers.
Troubleshoot and resolve issues related to ETL processes and data integration.
Ensure compliance with data governance, security policies, and best practices.
Document ETL processes and maintain comprehensive technical documentation.
Stay updated with the latest trends and technologies in data integration and ETL.
Qualifications:
Bachelors degree in computer science, Information Technology, or a related field.
10-12 yearsof experience in ETL development and data integration.
Expertise in ETL tools such asSSIS, T-SQL, Azure Databricksor similar.
Knowledge of variousSQL/NoSQL data storagemechanisms and Big Data technologies
and experience inData Modeling.
Knowledge ofAzure data factory, Azure Data bricks, Azure Data Lake.
