Role Summary
We are seeking an experienced Azure AI Engineer. The Azure AI Engineer designs, builds, deploys, and supports secure generative AI solutions on Microsoft Azure. This intermediate-level role translates business requirements into reliable AI services using Azure OpenAI, retrieval-augmented generation, agentic workflows, and production-grade APIs. The engineer works with product, data, security, and platform teams to deliver observable, cost-conscious, and enterprise-ready solutions.
Key Responsibilities
- Build and integrate Azure OpenAI solutions using model APIs, prompt templates, streaming responses, structured outputs, and robust error handling.
- Design RAG pipelines covering document ingestion, chunking, embeddings, Azure AI Search, hybrid retrieval, reranking, citations, and evaluation.
- Develop agentic workflows with function calling, tool use, routing, state, memory, and human-in-the-loop controls.
- Expose AI capabilities through secure asynchronous APIs and microservices using FastAPI or equivalent enterprise backend frameworks.
- Deploy AI applications to Azure App Service, Azure Functions, or AKS and support environment configuration, secrets, scaling, and release automation.
- Apply responsible AI controls including prompt-injection defenses, PII handling, content filtering, output validation, and auditability.
- Implement monitoring for latency, token usage, cost, failures, quality, and drift using Azure Monitor and Application Insights.
- Collaborate with networking and security teams on managed identities, RBAC, Key Vault, VNets, private endpoints, and enterprise data isolation.
Required Skills & Qualifications
- 3+ years of software engineering experience, including 1+ year in cloud AI/ML or generative AI.
- Hands-on experience with Azure OpenAI, Azure AI Search, and Azure AI services.
- Strong Python skills with REST APIs, async services, prompt engineering, and SDKs.
- Experience with embeddings, chunking, vector/hybrid search, reranking, citations, and evaluation.
- Experience with function calling, tools, routing, state, memory, and agent frameworks.
- Experience building secure APIs and microservices using FastAPI or similar frameworks.
- Knowledge of prompt-injection protection, PII handling, content safety, and output validation.
- Familiarity with RBAC, Managed Identity, Key Vault, VNets, Private Link, and enterprise security.
- Experience with CI/CD, Azure Monitor, Application Insights, performance, and cost monitoring.
- Working knowledge of Model Context Protocol and secure tool integration.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.
- Azure AI/Solutions Architect certification and experience with React/Next.js, Streamlit, Gradio, SaaS, or infrastructure as code