- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 1 گھنٹے قبل
- Work mode
- Work from home
- Eligibility
- Open to all qualified candidates regardless of prior experience or background; selection is based exclusively on demonstrated technical skills and expertise.
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Summary
We are seeking a Software Quality Engineer to join our client's team on a full-time remote basis. This position involves engaging with complex coding tasks within an agentic coding environment, assessing model outputs, and delivering precise and consistent annotations based on detailed code review and debugging. The work supports cutting-edge AI model development in a leading technology firm.
Primary Responsibilities
- Perform realistic coding assignments using an agentic coding harness, ensuring model blindness and session independence.
- Adhere rigorously to task instructions, milestones, planned interactions, and evaluation protocols throughout all workflows.
- Authenticate model-generated outcomes by analyzing code, executing relevant commands, reviewing logs, and examining artifacts.
- Create comprehensive multi-step coding tasks with user intent and milestone frameworks for offline assessments.
- Develop clear, fact-based rationales to justify trajectory rankings and evaluations.
Required Qualifications and Skills
- Strong command of Python, JavaScript, Java, C++, or SQL enabling effective code analysis and debugging.
- Proven experience handling substantive software tasks beyond basic exercises or superficial code evaluations.
- Capability to design detailed rubrics and binary evaluation standards for judging model outputs.
- Exceptional attention to detail to maintain annotation quality and grading uniformity.
- Comfortable engaging in debugging, testing, and manual verification of software behaviors.
Additional Information
This role provides an exclusive chance to contribute to a global leader in technology, information, and internet sectors, playing a vital part in advancing agentic AI coding models with key mission-critical applications.
Equal Opportunity Employer Statement
Employment decisions are based solely on candidates' skills and expertise, welcoming applications from all qualified individuals irrespective of background or prior work history. Selection focuses on verified technical capability and qualifications.