Scale existing RAG solution in Azure cloud to much more users and data, improve performance
Responsibilities
- Refactor current solution to make it scalable and stable
- Prompt Engineering Libraries/Plugins: Develop libraries or plugins to improve response consistency and quality through pre-built prompts, templates, and best practices for effective prompt crafting.
- Performance tuning to handle large payloads, such as performance testing scripts, to deliver complete responses.
- Develop strategies to manage token limitations, enabling the tool to facilitate complex and informative interactions without restrictions.
- Extend support for a wide range of file formats, including XML, HTML, and HAR, in addition to standard Microsoft product documents (Word, PowerPoint, Excel, PDF).
- Leverage multi-vector retrieval techniques to enhance the tool's functionality and effectively handle large data sets.
Requirements
- Strong expertise in Python and PySpark with over 5 years of hands-on experience in developing scalable data processing and analytics solutions.
- Azure cloud experience.
- Experience of developing and refactoring scalable and robust solutions.
- Experience with GenAI/LLM frameworks and technics, like guardrails, Langchain, etc.
Nice to have
- Strong experience with GenAI components, like vector databases (e.g. Cosmos DB, FAISS etc)
- Practical experience of developing and deploying GenAI/LLMs/SLMs-based solutions.
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About Us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
