Data Engineer with Snowflake

Key Responsibilities:

• Develop and manage data pipelines using Azure Data Factory and Databricks, transforming and enriching data sets.
• Build and optimize Star and Snowflake schemas for business requirements in Snowflake DB.
• Create and maintain CTEs, Stored Procedures, and tasks using Snowflake for data automation.
• Implement API Integrations, handle data loading/unloading, and automate live data ingestion.
• Write and optimize complex SQL queries for performance.
• Develop Python, Scala, and PySpark scripts to manage data transformations.
• Manage data storage in various formats, including JSON and Parquet, on cloud platforms.
• Deploy data solutions using Azure DevOps CI/CD pipelines, and ensure integration with source repositories.
• Apply best practices for data warehousing, modeling, and optimization.
• Perform monitoring and ensure the efficient operation of data solutions.

Required Skills:

• Strong expertise in SQL programming, ETL processes, and Snowflake.
• Knowledge of the Webfocus platform, with an understanding of report procedures (FEX) and dependencies.
• Familiarity with Agile methodologies.
• Excellent problem-solving, communication, and team management skills.