Job Title: Product & Competitive Intelligence Engineer (AI/LLM)
Location:Pune, Maharashtra
Experience: 36 Years
MUST Have Skills - Python, Product Analysis, Technical Research, RAG (Retrieval-Augmented Generation) architecture, LLMs, Agentic workflows / multi-agent systems
Role Overview
Our client is looking for a highly analytical and hands-on Product & Competitive Intelligence Engineer to evaluate and benchmark AI/LLM-based products in our domain.
This role involves deep technical analysis of competitor platforms, including installing, configuring, and experimenting with their systems to understand architecture, capabilities, and limitations. You will play a key role in shaping product strategy by translating competitive insights into actionable product improvements and roadmap inputs.
This is a hybrid role combining product thinking, engineering depth, and market awareness, ideal for someone who enjoys exploring systems end-to-end.
Key Responsibilities
Competitive Product Analysis
- Identify, evaluate, and analyze competitor products in the AI/LLM space
- Install, configure, and actively use competitor platforms to understand:
- Core capabilities
- Architecture and workflows
- Strengths and limitations
- Perform hands-on testing of features such as:
- BOT interaction
- Error detection
- Observability and evaluation tools
Technical Evaluation & Benchmarking
- Analyze system design patterns used by competitors (RAG, multi-agent, tool use, etc.)
- Benchmark performance, usability, and scalability
- Reverse-engineer workflows and identify differentiators
Feature Mapping & Gap Analysis
- Map competitor features against internal product capabilities
- Identify feature gaps, overlaps, and opportunities
- Prepare structured comparison reports and dashboards
- Provide clear recommendations to product and engineering teams
Required Skills
- 36 years of experience in software engineering, product analysis, or technical research roles
- Strong hands-on experience with Python
- Solid understanding of:
- AI/ML fundamentals
- Large Language Models (LLMs)
- RAG (Retrieval-Augmented Generation) architecture
- Agentic workflows / multi-agent systems
- Ability to install, configure, and troubleshoot modern software systems
- Strong analytical and problem-solving skills
- Ability to break down complex systems into understandable components
Preferred Skills (Nice to Have)
- Experience with:
- OpenAI / Anthropic / open-source LLMs
- Vector databases (Pinecone, Weaviate, FAISS, etc.)
- Prompt engineering and evaluation frameworks
- Exposure to:
- AI observability / governance platforms
- SaaS product ecosystems
- Experience creating product comparison reports or competitive intelligence decks
Who Should Apply
- Engineers curious about how AI products are built internally
- Individuals who enjoy breaking down systems and understanding how things work
- Candidates who want to move toward product strategy and technical leadership
