Data Engineer - Associate II

As a Software Engineer (Associate II), you will take a leading role in designing, developing, and maintaining APIs that integrate advanced AI and ML capabilities. You will collaborate with cross-functional teams to implement Generative AI solutions, ensure secure and efficient deployment, and uphold best practices in system design and security. Your expertise in Python, FastAPI (or similar frameworks), cloud services, and security protocols will be pivotal in delivering high-quality, scalable, and secure applications.

Job Description:

• API Development:Lead the design, development, and maintenance of APIs using Python and frameworks such as FastAPI, Flask, or Django.
• Testing Strategy:Develop and implement comprehensive unit tests, integration tests, and performance tests to ensure API reliability and efficiency.
• GenAI Integration:Architect and implement Generative AI solutions, utilizing tools like Langchain, LlamaIndex, or the OpenAI Python SDK.
• Deployment Management:Oversee the deployment of Docker-based applications using Kubernetes, Helm, and Docker Compose, ensuring scalability and reliability.
• Cloud Services Expertise:Leverage and optimize Azure AI services (e.g., Azure Document Intelligence, Azure AI Search) to enhance application capabilities.
• API Observability:Implement and maintain observability solutions using tools like Grafana, Prometheus, OpenTelemetry, Tempo, and Loki to monitor API performance and health.
• System Architecture:Design and architect concurrent and scalable systems with a focus on asynchronous programming to handle high traffic and large data volumes.
• DevOps Leadership:Manage and optimize CI/CD pipelines using Azure DevOps, ensuring seamless integration and deployment processes.
• Scripting and Automation:Develop and maintain advanced batch, shell, or PowerShell scripts to automate tasks and enhance workflow efficiency.
• Security Best Practices:
• Implement security best practices for product development and compute resources.
• Ensure secure configurations and deployments within AKS, including Role-Based Access Control (RBAC).
• Manage authentication and authorization mechanisms using OAuth, Okta, or Auth0.
• Mentorship and Collaboration:Mentor junior engineers, foster a collaborative team environment, and lead by example in adhering to best practices and standards.

Qualification

• Education:
• Bachelor's or Master's degree in Computer science , or a related field.
• Experience 3-6 years