SW Engineer -II Data Engineer

Key Deliverables:

• Design, develop, and maintain scalable data pipelines and systems.
• Implement data integration, transformation, and validation processes.
• Optimize data storage and retrieval for performance and cost-efficiency.
• Monitor and troubleshoot data pipeline issues.

Role Responsibilities:

• Collaborate with cross-functional teams to understand data requirements and ensure data quality and integrity.
• Work with data pipeline orchestration tools such as Dagster, Apache Airflow.
• Develop and maintain APIs, supporting microservices and containerization efforts.
• Implement security and compliance measures for data handling.