Senior Data Engineer

Key Responsibilities

• Design, develop, and maintain efficient, scalable data pipelines for batch and streaming workloads.
• Build and optimize ETL/ELT workflows using Python, Spark, and related tools.
• Implement and manage real-time data streaming solutions using Kafka or similar platforms.
• Develop dimensional data models and support analytics and reporting use cases.
• Collaborate with DevOps teams to implement CI/CD pipelines for data engineering workflows.
• Ensure code quality and version control using Git and best practices in software development.
• Work with Databricks or other cloud-native platforms to design and implement high-performance solutions.
• Integrate data pipelines with cloud services such as AWS, Azure, or GCP for storage, processing, and analytics.
• Troubleshoot and resolve issues related to performance, scalability, and data pipeline failures.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Ensure adherence to data governance frameworks, security protocols, and enterprise standards.
• Mentor junior engineers and participate in design and architecture discussions.