AI/ML Engineer

Why Mizuho

At Mizuho, we provide the stability of an international industry leader with the career trajectory of a growing business. Our steady, strategic growth gives our people at all levels rewarding degrees of responsibility and richer work experience than a boutique firm or an established giant could offer alone.

It's the local expertise of our employees that makes our global network so powerful. By collaborating with colleagues and clients who share the same ambition and drive, you can amplify your sphere of influence and base of knowledge as part of one of the largest banks in the world.

We're looking for a AI/ML Engineer for Mizuho Banking Domain to help architect, build, and scale production-grade AI systems that power high-impact banking use cases. You'll own the end-to-end lifecycle, from problem framing and data strategy to model deployment, monitoring, and continuous improvement, while leading a small team of engineers and collaborating with product, data, and platform stakeholders.

What You'll Do

* Work with the Enterprise AI/ML team to align with their strategy and roadmap.

* Evaluate build vs. buy vs. partner for AI components

* Establish engineering standards for model quality, reliability, privacy, and security.

* Architect and implement end-to-end ML systems

* Productionize LLM- and/or classical ML-powered features (e.g., RAGS, LLMs, anomaly detection, forecasting).

* Optimize cost/performance across compute, storage, and inference, including quantization and distillation for LLMs where applicable.

* Partner with data engineering on data contracts, observability, lineage, and governance.

* Implement robust MLOps using automated training, evaluation, drift detection, feedback loops, and experiment tracking.

* Stand up model monitoring for performance, safety, and bias; define guardrails and fallback strategies.

Qualifications (Must-Have):

* 5–10+ years of software/ML engineering experience.

* Proven track record shipping production ML systems at scale (not just prototypes/POCs).

* Strong Python engineering (packaging, testing, profiling); experience with typed code and CI/CD.

* Experience with at least one of PyTorch, TensorFlow, scikit-learn or Hugging Face

* Deep hands-on with at least one: LLMs (RAG, prompt engineering, evaluation, fine-tuning) or predictive/graphical ML

* Ability to mentor, coach, and grow talent, creating an inclusive, supportive environment where individuals thrive

* Familiarity with fairness, safety, and privacy considerations in AI.

Nice-to-Have:

* Vector databases (Pinecone, Weaviate, pgvector), embeddings, and retrieval strategies.

* LLM evaluation frameworks and guardrails (e.g., LlamaIndex, LangChain, Guidance, Guardrails.ai).

* Streaming / real-time ML (Kafka, Flink, Kinesis).

* Data specific tools Spark, Databricks, Snowflake, Delta/Iceberg; Kafka/Kinesis.

* MLOps tools like MLflow, SageMaker, Vertex, Azure ML; Airflow/Prefect or similar

Company Overview:

Mizuho Pune is an integral part of Mizuho Financial Group, one of the world's leading financial institutions with a strong global presence across the Americas, EMEA, and Asia. Based in India, Mizuho Pune supports Mizuho's international businesses by delivering high-quality, scalable, and resilient services across multiple functions.

Mizuho Pune plays a critical role in driving operational excellence, standardization, and innovation for Mizuho Americas. By combining deep domain expertise with strong process, technology, and analytical capabilities, it partners closely with regional and global teams to support corporate and investment banking, capital markets, and corporate services functions, while adhering to the highest standards of risk management, regulatory compliance, and control.

Mizuho Pune offers competitive compensation and benefits package aligned with industry standards and local market practices.

Mizuho Pune is an equal opportunity employer and is committed to fostering an inclusive and diverse workplace.

Employment is subject to applicable background verification checks in accordance with Indian laws and company policies.

https://www.mizuhogroup.com/asia-pacific/mizuho-global-services/careers