Search by job, company or skills

PyjamaHR

Product Manager (Generative AI & LLM Experimentation)

new job description bg glownew job description bg glownew job description bg svg
  • Posted 8 months ago
  • Be among the first 20 applicants
Early Applicant

Job Description

About

We are a well-funded Generative AI startup committed to crafting exceptional, human-centered conversational experiences for consumers worldwide. Our mission is to make AI interactions more accessible, impactful, and engaging by combining advanced Generative AI with intuitive, human-centered design. Our team is led by industry veterans with deep expertise in AI, personalization, and NLP, with experience at top global tech firms.

Key Responsibilities

  • Research & Insights: Review research papers, case studies, and industry benchmarks to extract actionable insights for improving AI performance and stay updated with latest advancements.
  • Experimentation & Strategy: Define, execute, and iterate on experiments across various AI models to improve accuracy, engagement, and response quality.
  • Model Performance Analysis: Conduct A/B tests, compare model performance, and analyze key metrics to refine the AI pipeline.
  • User Feedback & Insights: Develop and analyze feedback loops to measure user satisfaction and model effectiveness.
  • Cross-functional Collaboration: Work closely with engineers, data scientists, and product teams to drive AI advancements and feature improvements.
  • Data-Driven Decision Making: Leverage analytics to identify trends, assess model success, and drive strategic improvements.
  • Rapid Prototyping & Iteration: Test new AI capabilities and ideas swiftly to optimize performance and scalability.

Ideal Profile

  • 1-3 years of experience in AI-focused product roles, preferably from Tier 1 colleges such as IIT, NIT, BITS, etc.
  • Strong understanding of LLMs, fine-tuning, prompt engineering, and AI evaluation techniques.
  • Experience in designing experiments for model performance testing and iteration.
  • Ability to interpret AI/ML metrics and translate them into actionable insights.
  • Excellent problem-solving and analytical skills.
  • Hands-on experience with LLM APIs (OpenAI, Hugging Face, etc.), A/B testing, and user analytics tools.
  • Ability to work in a fast-paced, ambiguous environment while driving clarity and execution.

Nice to Have

  • Experience working on AI-powered conversations.
  • Background in astrology or related field.

Skills: LLMs,fine-tuning,prompt engineering,AI evaluation techniques,A/B testing,user analytics tools,AI/ML metrics interpretation

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Job ID: 116701995