Data Engineer -SME

Key Responsibilities

• Cloud & Data Engineering Leadership: Lead the design, development, and implementation of scalable cloud-based data solutions, ensuring alignment with business objectives and technical requirements.
• Data Pipeline Architecture: Architect and optimize ETL/ELT pipelines using tools like Apache Spark, Databricks, and Airflow to process large datasets efficiently.
• Cloud Platform Expertise: Leverage AWS services such as S3, Redshift, Lambda, and Glue to build robust data architectures and ensure seamless integration with existing systems.
• Team Mentorship: Provide technical leadership and mentorship to junior engineers, fostering a culture of continuous learning and improvement.
• Stakeholder Collaboration: Work closely with cross-functional teams, including data analysts, product owners, and IT, to gather requirements and deliver data solutions that meet business needs.
• Performance Optimization: Conduct performance tuning of data pipelines and queries to ensure optimal performance and scalability.
• Data Governance & Compliance: Implement data governance practices to ensure data quality, security, and compliance with industry standards.