Company Description
Yoda Tech Pte. Ltd., headquartered in Singapore, specializes in breaking down digital transformation into manageable micro-initiatives using ready-to-deploy Micro-bots. By focusing on Automate + Robotize, Power Application Development, and streamlined Infrastructure, Maintenance, and Support services, Yoda Tech helps businesses lower their IT operations expenses. With a commitment to innovation, the company delivers efficient and sustainable technological solutions tailored to meet modern business needs.
Job Summary
We are seeking a skilled Databricks Consultant with 4+ years of experience to design, develop, and deploy scalable AI and data solutions on the Databricks platform. The ideal candidate will have hands-on experience in AI agent development using Agent Bricks, machine learning workflows, and advanced analytics leveraging the Databricks ecosystem. This role involves building intelligent data pipelines, developing AI-powered agents, and optimizing data platforms for enterprise use cases.
Key Responsibilities
- Design and implement AI-driven solutions on the Databricks platform.
- Develop and deploy AI agents using Agent Bricks and Databricks AI capabilities.
- Build and maintain data pipelines using Databricks, Spark, and Delta Lake.
- Develop and operationalize machine learning models using Databricks ML and MLflow.
- Integrate LLM-based AI agents with enterprise data sources and applications.
- Optimize data workflows and performance within Databricks environments.
- Collaborate with data engineers, data scientists, and business stakeholders to translate requirements into scalable AI solutions.
- Implement best practices for data governance, security, and model lifecycle management.
- Monitor and maintain AI models and agent-based workflows in production environments.
- Provide technical guidance and support for Databricks-based AI implementations.
Required Skills & Qualifications
- 4+ years of experience in Data Engineering, Data Science, or AI development.
- Strong hands-on experience with Databricks platform.
- Proficiency in Python, PySpark, and SQL.
- Experience building AI agents using Agent Bricks or similar agent frameworks.
- Experience with Apache Spark and distributed data processing.
- Hands-on experience with Delta Lake, Databricks Workflows, and Unity Catalog.
- Experience with ML lifecycle management using MLflow.
- Familiarity with LLMs, Generative AI, and AI orchestration frameworks.
- Strong understanding of data architecture and cloud data platforms.
Preferred Qualifications
- Experience with Databricks Mosaic AI / AI Functions / Vector Search.
- Experience with LLM integration, RAG architectures, or conversational AI.
- Hands-on experience with Azure Databricks, AWS Databricks, or GCP Databricks.
- Knowledge of LangChain, LlamaIndex, or agent-based AI architectures.
- Databricks certifications such as Databricks Data Engineer Associate/Professional.
Nice to Have
- Experience building enterprise AI copilots or automation agents.
- Exposure to MLOps, CI/CD pipelines, and model monitoring.
- Knowledge of data governance and compliance frameworks.
