Senior Data Engineer

Company: Dimensionless Technologies is a global IT consultancy and AI services company founded in 2016 in Mumbai, India. We specialize in AI-based solutions that improve operational efficiency and enable business growth across industries. With offices in Mumbai and New Jersey, our team of data scientists, machine learning engineers, and software developers builds customized AI solutions such as security automation, fraud detection, and natural language processing. Driven by innovation, we help organizations achieve their goals through cutting-edge technology.

Job Location: India

About the Role

Build and productionize Azure data pipelines, AI agents, and backend services. This hands-on role requires strong Python and Azure skills and the ability to work across Data, AI, and Backend engineering, from design through deployment.

Key Responsibilities

Data Engineering and Azure Pipelines

• Build ingestion and ETL/ELT pipelines using Python, PySpark, and Azure Data Factory, Azure Databricks, or Azure Synapse Analytics.
• Orchestrate workflows with Azure Data Factory pipelines, Azure Logic Apps, or Durable Functions.
• Manage Azure Data Lake Storage Gen2 (ADLS), Synapse serverless SQL / Databricks SQL, and Unity Catalog or Microsoft Purview data layers, following the medallion (bronze/silver/gold) architecture.

Backend and API Development

• Build Python REST APIs and microservices (FastAPI/Flask) for AI agents, front ends, and enterprise systems.
• Handle authentication (Microsoft Entra ID/OAuth2), validation, logging, monitoring (Azure Monitor, Application Insights), integrations, containerization, and deployment on Azure Functions, Azure Container Apps, or AKS.

AI Agent Development

• Build agents using Azure OpenAI Service, Azure AI Foundry (Agent Service), Semantic Kernel, and/or AutoGen.
• Implement tool/function calling, workflows, state/context management, RAG (Azure AI Search), evaluation, security, observability, and reusable components.

Engineering and DevOps

• Write clean, reusable, testable code using Git, CI/CD (Azure DevOps or GitHub Actions), and configuration-driven development.
• Follow IaC, cloud security, secrets management (Azure Key Vault), logging, and monitoring standards. Terraform is preferred (Bicep/ARM also welcome).

Required Skills

Must Have

• Strong Python and Azure development experience.
• Data pipeline/ETL experience with PySpark, and preferably Azure Databricks, Synapse, or Azure Data Factory.
• Experience with Azure Data Lake Storage Gen2, Synapse/Databricks SQL, and Azure Data Factory orchestration.
• REST API and backend development experience.
• Hands-on LLM/GenAI or AI-agent development, including Azure OpenAI Service.
• Exposure to Azure AI Foundry Agent Service and/or Semantic Kernel is highly desirable.
• Strong Git, software engineering, and CI/CD practices.

Good to Have

• Terraform or Bicep for infrastructure as code.
• Microsoft Fabric, Azure Event Hubs, or Delta Lake experience.
• Azure certifications (DP-203/DP-700, AI-102, AZ-204).