Mid-Senior Remote Data Annotator

About the Position

Rex.zone is seeking experienced Mid-Senior level Remote Data Annotators to develop and validate precise training datasets essential for AI and machine learning system development. This role involves engaging with a variety of data types including text, images, and multi-modal content, applying uniform rubric-driven decisions and comprehensive documentation to enhance model accuracy.

Key Responsibilities

• Annotate and verify datasets for natural language processing and computer vision tasks, including named entity recognition, classification, and segmentation or bounding boxes.
• Conduct Reinforcement Learning from Human Feedback (RLHF) evaluations and prompt evaluations by assessing and ranking model outputs based on set guidelines.
• Execute quality assurance evaluations such as audit sampling, calibration, and resolving discrepancies to ensure compliance with annotation standards.
• Assist in content safety labeling through policy-based categorization and adherence to safety rubrics.
• Work collaboratively with project leads asynchronously to achieve throughput, precision, and audit standards required in large language model training workflows.

Essential Qualifications

• Experience at a mid to senior level within data annotation, quality assurance evaluation, or evaluation of large language models.
• Exceptional attention to detail with a capacity to address ambiguous scenarios using consistent logic.
• Strong written communication skills for documenting edge cases and justification.
• Proficiency with annotation platforms and spreadsheet-like data review tools.