- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 1 hour ago
- Work mode
- Work from home
- Eligibility
- Candidates with demonstrated technical expertise in programming and software debugging are invited to apply. All qualified individuals are encouraged regardless of their employment history or background.
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Summary
This full-time remote position involves contributing as a Software Quality Engineer focusing on agentic coding annotation tasks. The role entails working within a coding environment to handle realistic software challenges, verifying model outputs, debugging code, and ensuring high-quality, evidence-based annotations to advance agentic coding models used in critical AI applications.
Key Responsibilities
- Perform practical coding tasks using an agentic coding platform, ensuring session independence and model blindness.
- Adhere strictly to task guidelines, milestones, interaction protocols, and evaluation criteria consistently across multiple model runs.
- Validate outputs by analyzing code, executing commands, examining logs, and reviewing generated artifacts.
- Create multi-step coding scenarios that reflect user intent and define milestone structures for offline model assessments.
- Compose clear, precise justifications based on evidence for trajectory evaluations and rankings.
Required Qualifications and Skills
- Proficient in one or more programming languages: Python, JavaScript, Java, C++, or SQL, especially for code reading and debugging purposes.
- Prior experience with complex software tasks beyond basic code reviews or simple problems.
- Capability to develop detailed, task-specific evaluation rubrics and binary criteria for assessing model outputs.
- Exceptional attention to detail to maintain consistent and high-quality annotation standards.
- Comfortable with debugging processes, testing validation, and manual verification of software behavior.
Additional Information
The opportunity is provided by a client recognized as a global leader in the Technology, Information, and Internet sectors. The work supports the enhancement and deployment of advanced AI systems in mission-critical applications.
Equal Opportunity Statement
Employment decisions are based solely on skills and qualifications, welcoming all qualified applicants regardless of background or previous experience. Assessments focus exclusively on demonstrated technical competence.