Data/AI Engineer
- Posted a day ago
- Be among the first 10 applicants
Job Description
Role Overview
Experience - 3-8 Years
Location - Hyderabad/Indore/Ahmedabad
Onsite
As a Senior Data/AI Engineer, you will design and build connectors that discover and ingest metadata from data and AI platforms into an enterprise-grade SaaS platform in the data privacy, data governance and AI governance space. You will define how data from external systems maps to the platform's data models, set ingestion patterns, and guide a team of Data/AI Engineers.
Key Responsibilities:
- Design connectors for data and AI platforms (e.g., Snowflake, Databricks, BigQuery, AWS SageMaker, AWS Bedrock, Azure ML, Azure OpenAI) to discover data and AI assets.
- Define how source metadata (datasets, schemas, models, pipelines, agents and lineage) maps to the platform's data models.
- Establish reusable ingestion patterns: full and incremental sync, pagination, rate limiting, retries, error handling and scheduling.
- Build and review connector code in Python and/or Java.
- Provide technical guidance and code reviews for Data/AI Engineers.
- Ensure data quality, security and least-privilege access in connector design.
- Work with the AI Architect and Tech Leads on connector architecture and design reviews.
- Write technical documentation and connector specifications.
What You'll Bring:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 3–8 years of experience in data engineering or integration engineering, including at least 2 years building connectors or ingestion pipelines.
- Strong programming skills in Python and/or Java.
- Hands-on experience with cloud data and AI platforms.
Mandatory Skills:
- Strong proficiency in Python (and/or Java) for building data integration services.
- Experience with REST and GraphQL APIs, SDKs, and OAuth2 or service-principal authentication.
- Hands-on experience with at least two of: Snowflake, Databricks, BigQuery, Redshift or Azure Synapse.
- Exposure to AI/ML platforms such as AWS SageMaker, AWS Bedrock, Azure ML, Azure OpenAI or Vertex AI.
- Strong skills in data modeling, metadata management, schema mapping and transformation.
- Strong SQL skills.
- Experience with AWS and Azure services (IAM, S3/ADLS, Lambda/Azure Functions).
- Familiarity with automated testing, Git and CI/CD pipelines.
More Info
Key Skills
AWS Bedrock
Azure OpenAI
schema mapping
GraphQL APIs
ADLS
AWS SageMaker
Azure services
CI CD pipelines
About Company
Skills:
snowflake , Github, Jfrog Artifactory, Argo, Pyspark, PostgreSQL, Grafana, Sql, Cloudwatch, Terraform, Sonarqube, Python, Kubernetes, FastAPI Framework, K6, Red Hat OpenShift, Snowpark, GitHub actions
Skills:
Pyspark, AWS Glue, Databricks, Python, Sql, LangChain, LangGraph, CrewAI, AutoGen, Delta Lake, Unity Catalog
Skills:
Pyspark, Sql, Spark, Databricks, MLflow, Unity Catalog, Delta Lake, structured streaming
Skills:
Data Analytics, Scala, virtualization, Storage Systems, DataFlow, ELT, Tensorflow, Data Warehousing Concepts, Python, Etl, Cloud Computing, core data science techniques, reporting analytic tools, deep learning frameworks, multi-tenant cloud infrastructures, content delivery networks, R, Gemini models, ADK Gemini Enterprise, Vertex AI, data visualization techniques
Skills:
Python, RAG function tool calling, GRC tooling, prompt engineering, agentic workflows, LLM-powered applications, enterprise platforms and APIs, CI CD-integrated deployment gates, MCP, AI LLM risk landscape, cloud ML platforms, AI development tooling