Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions.

Requirements

Bachelor's or Master's degree in Computer Science or a related field
Strong Python coding skills - 7+ years
2+ years of hands-on experience with machine learning and production LLM systems
Experience building backend APIs with FastAPI, async patterns, rate limiting, and SQLAlchemy - 3+ years
Experience designing maintainable and extensible systems using dependency injection, interfaces, and abstract base classes
Experience with vector databases such as Pinecone, Weaviate, or Chroma, as well as hybrid search
Strong understanding of RAG architectures, including retrieval, reranking, context assembly, and response generation
Hands-on experience with LangChain and LangGraph for building and orchestrating LLM workflows
Advanced Python skills, including async/await, type hints, Pydantic, and SOLID principles
MLOps experience with MLflow, model versioning, and A/B testing; experience with Langfuse is a plus
Experience in NLP and computer vision, including document understanding, OCR, and GPT-4 Vision
Experience building feature pipelines, real-time and batch inference systems, and model serving
Hands-on experience with Hugging Face is required; experience with LlamaIndex is a plus

Nice to have skills:

Understanding of DevOps, CI / CD including: Docker containerization, Azure DevOps pipelines or GitHub Actions, Kubernetes (nice to have);
Data security including: Multi-tenant data isolation, Secure key management (Azure Key Vault), Audit trail implementation;
Experience in designing on cloud platform including: Azure (strongly preferred): Azure OpenAI, Blob Storage, Key Vault, Container Registry, AWS or GCP;
Experience in data engineering in Big Data systems including: Large-scale data processing, ETL/ELT pipelines

Responsibilities:

Design and build scalable backend systems, APIs, and microservices with FastAPI;
Write high-quality backend code using Python, SQL, async/await, and solid OOP principles;
Apply software best practices to ensure reliability, scalability, and on-time delivery;
Implement dependency injection, layered architectures, and SOLID design patterns;
Integrate Azure OpenAI (GPT-4, GPT-4 Vision) with robust retry and error handling;
Build LLM observability with Langfuse (prompts, tokens, cost, latency);
Develop prompt management with versioning, fallbacks, and cost optimization strategies;
Orchestrate async workflows using Celery for complex pipelines;
Design multi-tenant architectures with strict data isolation;
Integrate third-party APIs (Veeva Vault, Adobe PDF Services, OCR);
Troubleshoot systems using structured logging and distributed tracing;
Document APIs and changes using OpenAPI/Swagger

Benefits

Employment-based cooperation
Awesome projects with an impact
Comprehensive insurance for you and your family (health, life, and accident)
Paid PTO policy (vacation, sick leaves, and public holidays)
Tech equipment provided
Udemy courses, workshops, trainings & expert knowledge-sharing
Clear career path
Flexible hours & work setup

Senior Python Backend Developer / ML Engineer