Job Description
Role Overview:
We are looking for a hands-on Data Engineer with strong Cloud Operations expertise to manage large-scale data migrations and maintain advanced sandbox environments for high-impact projects. The ideal candidate will bridge the gap between data engineering and cloud infrastructure, ensuring seamless data flow and resource availability for developers and startups.
Key Responsibilities:
- Data Migration: Lead and execute complex data migrations from on-premises systems to the cloud, or between different Cloud Service Providers (CSP to CSP).
- Sandbox Management: Maintain and manage a sandbox environment, including loading large datasets (e.g., triple 6 data) and provisioning compute resources for various stakeholders and startups.
- Cloud Operations: Handle daily cloud environment operations, ensuring stability for developers and hackathon participants.
- Resource Management: Act as a resource manager for compute and storage, providing technical support for platform users regarding LLM gateways and API connections.
- Agentic Frameworks: Work with agentic platforms (like Tasum or similar no-code frameworks) to manage LLM gateways, knowledge bases, and agentic tools.
- AI Integration: Support the integration of AI-driven tools, such as intelligent form services and OCR-based analysis engines.
Required Skills & Qualifications:
- Experience: Proven track record in handling data migrations and managing cloud environments.
- Technical Proficiency: Strong understanding of cloud infrastructure (AWS/Azure/GCP) and minimum cloud - operations.
- Experience with data engineering pipelines and agentic side architectures.
- Familiarity with knowledge base management and LLM integrations.
- Problem Solving: Ability to troubleshoot platform issues for external developers, including connectivity to LLMs and API key management.
- Preferred: Prior experience in government or large-scale public sector digital transformation projects is a plus.
