Senior Software Engineer

About the Role:

• Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data pipeline solutions.
• Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data warehousing and analytics initiatives.

Key Responsibilities:

• Lead the design and development of ETL processes and data integration solutions.
• Develop and maintain ETL workflows using tools such as SSIS, Azure Databricks, SparkSQL or similar.
• Collaborate with data engineers, analysts, and business stakeholders to gather requirements and translate them into technical solutions.
• Optimize ETL processes for performance, scalability, and reliability.
• Conduct code reviews, provide technical guidance, and mentor junior developers.
• Troubleshoot and resolve issues related to ETL processes and data integration.
• Ensure compliance with data governance, security policies, and best practices.
• Document ETL processes and maintain comprehensive technical documentation.
• Stay updated with the latest trends and technologies in data integration and ETL.

Qualifications:

• Bachelors degree in computer science, Information Technology, or a related field.
• 10-12 years of experience in ETL development and data integration.
• Expertise in ETL tools such as SSIS, T-SQL, Azure Databricks or similar.
• Knowledge of various SQL/NoSQL data storage mechanisms and Big Data technologies
• and experience in Data Modeling.
• Knowledge of Azure data factory, Azure Data bricks, Azure Data Lake.
• Experience in Scala, SparkSQL, Airflow is preferred.
• Proven experience in data engineering and designing scalable ETL solutions.
• Excellent problem-solving and analytical skills.
• Strong communication and leadership skills.
• Ability to work effectively in a team-oriented environment.
• Experience working with agile methodology.
• Healthcare industry experience preferred.