Data Engineer

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines for large-scale data integration.
• Work with StreamSets Data Collectors and Control Hub for data ingestion and transformation.
• Write efficient SQL queries and manage relational database operations.
• Implement real-time and stream processing solutions for dynamic datasets.
• Collaborate with cross-functional teams to manage data in cloud environments (Data Lake/Warehouse).
• Use source control tools (e.g., Git) and participate in CI/CD pipelines for automated deployments.
• Ensure data quality, governance, and compliance with relevant regulations.