Cloud Data Engineer

Key Responsibilities

• Design, implement, and maintain data infrastructure on cloud platforms including AWS and Azure
• Build and manage scalable data lakes for structured and unstructured data
• Develop and maintain data pipelines for efficient data ingestion, transformation, and processing
• Integrate multiple data sources into a unified and cohesive data platform
• Work with Azure Kubernetes Service (AKS) for containerized data workloads
• Utilize Python and SQL for data processing, transformation, and automation
• Implement ETL processes using tools such as Apache NiFi, Talend, and AWS Glue
• Work with AWS services including EC2, S3, Redshift, Glue, Athena, Lambda, Kinesis, and EMR
• Manage and optimize SQL and NoSQL databases such as MySQL, PostgreSQL, MongoDB, and Cassandra
• Ensure data quality, performance, and scalability across systems
• Collaborate with cross-functional teams including analytics, DevOps, and application teams
• Maintain documentation for data architecture, pipelines, and workflows