About The Company
Turing is one of the world's fastest-growing AI companies dedicated to accelerating the development and deployment of advanced artificial intelligence systems. Renowned for its innovative approach, Turing leverages cutting-edge technology and a global talent network to push the boundaries of AI research and practical applications. The company focuses on creating impactful solutions that transform industries and improve everyday life, positioning itself at the forefront of AI-driven innovation. With a commitment to excellence, collaboration, and continuous learning, Turing fosters a dynamic environment where talented professionals can thrive and contribute to groundbreaking projects that shape the future of technology.
About The Role
We are seeking experienced software engineers at a tech lead level to join our pioneering project focused on building large language model (LLM) evaluation and training datasets tailored for realistic software engineering problems. This role offers a unique opportunity to work at the intersection of software engineering and AI research, directly contributing to the development of datasets that will enhance the capabilities of LLMs in understanding and solving complex software tasks. The ideal candidate will have a strong background in working with high-quality public GitHub repositories, automation, and code evaluation, and will play a crucial role in shaping the project's success through hands-on technical contributions and leadership. Responsibilities include automating development environments, triaging issues, assessing test coverage, and collaborating with researchers to improve dataset quality and coverage across various programming languages and difficulty levels.
Qualifications
The ideal candidate will possess a minimum of three years of professional experience in software engineering, with proficiency in at least one of the following programming languages: Rust. Strong familiarity with version control tools such as Git, containerization technologies like Docker, and experience setting up and maintaining software pipelines are essential. The candidate should demonstrate the ability to understand and navigate complex codebases, modify and run projects locally, and evaluate code quality effectively. Experience contributing to open-source projects or working with public repositories is highly valued. Additional experience in AI research, particularly related to LLM evaluation, developer tools, or automation agents, will be considered a plus.
Responsibilities
- Analyze and triage issues across trending open-source repositories on GitHub to identify challenging tasks for LLMs.
- Set up and configure software repositories, including Dockerization and environment setup, to facilitate testing and evaluation.
- Evaluate unit test coverage and quality, providing insights to improve dataset robustness.
- Modify and run codebases locally to assess LLM performance in bug-fixing and code understanding scenarios.
- Collaborate with research teams to design and select repositories and issues that present meaningful challenges for LLMs.
- Lead and mentor junior engineers, fostering a collaborative environment to accelerate project milestones.
- Contribute to the development of automation tools and pipelines that streamline dataset creation and evaluation processes.
Benefits
Joining Turing offers the opportunity to work remotely in a fully flexible environment, empowering you to manage your work-life balance effectively. You will engage with cutting-edge AI projects, collaborating with leading LLM companies and researchers worldwide. This role provides exposure to innovative AI research, a chance to develop your skills in a rapidly evolving field, and the satisfaction of contributing to projects that have a significant impact on the future of software engineering and AI. Additionally, Turing promotes a culture of continuous learning, professional growth, and recognition for your expertise and contributions.
Equal Opportunity
Turing is committed to creating an inclusive environment for all employees and applicants. We are proud to be an equal opportunity employer, valuing diversity and fostering a culture of respect and collaboration. We do not discriminate based on race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity, or any other protected characteristic. We encourage individuals from all backgrounds to apply and join our innovative team dedicated to advancing AI technology for the betterment of society.