Python Engineer - Remote

Role Overview

We are looking for an experienced Python Engineer to join our client, a pioneering company specializing in foundational large language models (LLMs). The successful candidate will play a crucial role in improving proprietary data used for fine-tuning and benchmarking AI model performance.

Key Responsibilities

• Develop, write, and maintain robust, high-performance Python code aimed at training and optimizing AI models.
• Perform thorough evaluations to benchmark AI model performance and analyze outcomes to facilitate ongoing enhancements.
• Assess and rank AI-generated responses to user queries across multiple domains, ensuring they meet established standards.
• Lead supervised fine-tuning initiatives by creating and managing high-quality datasets tailored to specific tasks.
• Collaborate closely with researchers and annotators to implement reinforcement learning approaches using human feedback and to improve reward modeling.

Required Skills and Qualifications

• Strong proficiency in Python and associated AI/ML libraries and frameworks.
• Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
• Deep understanding of AI model evaluation techniques and benchmarking procedures.
• Ability to design and deploy Python-based data generation and model optimization processes.
• Knowledge of methods for evaluating and ranking AI model responses.

About the Opportunity

This position provides a rare chance to contribute to a leading international artificial intelligence company, working alongside top-tier researchers and engineers in the development of advanced large language models.

Equal Opportunity Statement

We value skills and expertise above all else and welcome all qualified applicants irrespective of background or previous employment. Applications are assessed solely on merit and technical capabilities.