Software Engineer LLM Coding Agent Dataset Creation

About the Role

Software Engineer – LLM Coding Agent Dataset Creation

Are you an experienced Software Engineer passionate about coding, AI, and solving complex engineering challenges Here's an exciting opportunity to work on cutting-edge LLM-based coding agents and AI evaluation datasets!

We're looking for talented engineers with strong software development fundamentals and hands-on experience working with large codebases.

Job Details:

Location: Noida (Work from Office)

Experience: 6+ Years

Notice Period: Immediate Joiners Only

Key Responsibilities

Develop, review, test, and validate coding tasks across multiple programming languages.

Create high-quality datasets for training and evaluating LLM-powered coding agents.

Build and maintain test suites to ensure code correctness, reliability, and quality.

Work with large open-source repositories and understand complex codebases.

Review code, technical designs, and implementation approaches.

Break down requirements into well-defined engineering tasks and resolve technical challenges.

Required Technical Skills

Strong expertise in one or more of the following programming languages:

Python

Rust

TypeScript

Java

C++

Go

Additional expertise in Git, Docker, debugging, automated testing, code reviews, and clean code practices is essential.

Preferred Qualifications

• Experience with LLMs and AI-assisted coding tools.
• Knowledge of code generation and AI model evaluation.
• Experience creating coding benchmarks, evaluation datasets, or software engineering datasets.