Associate Data And Cloud Engineer

Company Description

WhyMinds Global is a cutting-edge Deep Tech startup that specializes in creating AI-driven technology products and consulting solutions. The company focuses on industries such as Banking and Financial Services, E-commerce, Digital Media, Regulatory Compliance, and Cybersecurity. With a strong emphasis on innovation, WhyMinds Global delivers scalable, intelligence-powered solutions tailored to industry needs. The organization is dedicated to harnessing advanced technology to solve complex challenges and drive business transformation.

Location: Mumbai

Experience: 2-3Years Max

Role Description

This is a full-time, on-site role based in Mumbai for an Associate Data Engineer. The role involves designing and implementing cloud solutions, managing databases, analyzing large datasets, and developing algorithms. The Engineer will collaborate with team members to deploy efficient, scalable systems and will ensure robust data processing and storage solutions. In addition, the role includes continuous monitoring, troubleshooting, and optimization of cloud and data infrastructure to meet performance and security requirements.

Data Engineering (Primary Focus)

• Develop and optimize real-time and batch data pipelines using Python and Big Data technologies.
• Work with modern databases like PostgreSQL, Redis, Aerospike etc. to ensure high-performance data processing.
• Implement streaming data solutions using Apache Kafka and message queues (MQ).
• Ensure data quality, validation, and transformation within structured and semi-structured datasets.
• Build and maintain ETL/ELT processes to support data ingestion, data migrations etc.
• Demonstrate progressive understanding of data analytics and visualization tools.
• Build Test Automation Suites to validate batch, ETL, data solutions.

Cloud Engineering (Microsoft Azure)

• Deploy, configure, and optimize Azure-based SaaS applications for performance and scalability.
• Manage Azure cloud services including Azure SQL, Azure Functions, Blob Storage, and Event Hubs.
• Implement enterprise security best practices for cloud applications, data encryption, and access control.
• Monitor and troubleshoot cloud-based deployments to ensure high availability and resilience.

Familiarity with Microsoft Azure services for cloud-hosted applications and security best practices.