Senior Data Engineer
- Posted a day ago
- Be among the first 10 applicants
Job Description
Major Responsibilities
Delivery Management & Prioritization
Education
Education
Delivery Management & Prioritization
- Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, Delta Lake, and related Azure services.
- Architect data models and storage patterns optimized for analytics, reporting, and machine learning workloads.
- Establish and enforce engineering standards for code quality, version control, CI/CD, testing, and documentation.
- Optimize data pipelines for performance, reliability, and cost efficiency across cloud environments.
- Collaborate with cloud platform, security, and infrastructure teams to ensure data solutions meet enterprise standards for security, compliance, and reliability.
- Implement monitoring, alerting, and automated recovery processes for critical data pipelines and datasets
- Partner with analytics and business teams to understand requirements and translate them into scalable technical solutions.
- Provide technical leadership, code reviews, and mentorship to data engineers and contractors.
Education
- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field (or equivalent practical experience).
- Azure Data Engineer or equivalent cloud certification preferred.
- 7+ years of experience in data engineering, cloud data platforms, or large‑scale data architecture.
- Hands‑on experience designing and delivering data pipelines using Azure and Databricks.
- Strong experience with SQL, Python, Spark, Delta Lake, and distributed data processing.
- Experience supporting production data systems, including monitoring, troubleshooting, and performance tuning.
- Deep understanding of data modeling, ETL/ELT patterns, orchestration, and data quality frameworks.
- Strong knowledge of Azure services (ADF, ADLS, Databricks, Azure SQL, Synapse, Key Vault, DevOps).
- Ability to translate business requirements into scalable technical designs
- Excellent written and verbal communication skills, including the ability to communicate complex topics to non-technical audiences.
Education
- Master's degree in Data Engineering, Computer Science, Analytics, or a related field.
- Preferred certifications: Microsoft Certified Azure Data Engineer, Databricks Data Engineer Professional, Agile project management.
- Experience leading technical design for large‑scale data engineering initiatives.
- Experience implementing Lakehouse architectures and supporting advanced analytics or ML workloads.
- Experience with CI/CD pipelines, infrastructure‑as‑code, and DevOps practices.
- Vendor and contractor oversight experience.
- Strong understanding of data governance, metadata management, and enterprise data cataloging.
- Ability to drive adoption of engineering best practices and standardized ways of working across teams.
More Info
Key Skills
Lakehouse architectures
Automated recovery processes
CI/CD pipelines
Azure services
Delta Lake
Data quality frameworks
About Company