Data Engineering Analyst

Roles & Responsibilities

• Design, develop, and manage end-to-end data pipelines usingAzure Data Factory (ADF)for efficient ETL/ELT processes.
• Develop, deploy, and monitor scalable data solutions usingAzure Synapse Analyticsor orDatabricksorMicrosoftFabricto support large-scale data processing and analytics.
• Write optimizedSQL Serverscripts, stored procedures, and views to support data transformation and integration requirements.
• Build and maintain insightful dashboards and reports usingPower BI, with a focus on usability, performance, and clear data communication.
• Develop automation scripts usingPowerShellfor operational and monitoring tasks across Azure services.
• Create automated workflows usingPower Automateto streamline manual tasks and notifications.
• LeveragePython or PySparkfor data manipulation, transformation, and orchestration within Synapse or Databricks environments.
• Collaborate with business stakeholders, data analysts, and application developers to gather requirements and deliver high-quality solutions.
• Perform root cause analysis, data validation, and ensure data integrity across systems and processes.
• Participate in code reviews, design discussions, and documentation efforts to ensure best practices and knowledge sharing.
• Ensure security, compliance, and governance in all data engineering activities.