Remote Data Labeling Specialist

Position Overview

Rex.zone is recruiting Remote Data Labeling Specialists to operate primarily from Manchester. In this capacity, you will be responsible for generating and evaluating annotated datasets that aid the training and assessment of artificial intelligence systems. These datasets encompass tasks in natural language processing, computer vision, content safety annotation, as well as evaluation workflows for large language models (including Reinforcement Learning with Human Feedback and prompt assessment).

Key Responsibilities

• Annotate and review both textual and multimodal data for NLP and image-based tasks.
• Conduct preference ranking and quality assurance assessments to support large language model validation.
• Evaluate prompts regarding instruction adherence, accuracy, and user helpfulness.
• Implement content safety labeling guidelines consistently, providing documented rationales.
• Monitor data quality using metrics such as gold standard sets, consensus reviews, adjudication results, and agreement levels; report inconsistencies or gaps in guidelines.
• Keep detailed audit records including decision explanations, disagreement justification, and descriptions of ambiguous cases.
• Operate within secure environments ensuring compliance with confidentiality and data handling protocols.

Qualifications

• Mid to senior level experience in data labeling, annotation, quality evaluation, or related data operational roles.
• Exceptional attention to detail with competency in adhering to complex annotation rules and regulatory compliance.
• Experience with tasks such as named entity recognition, taxonomy classifications, or structured annotation schemas.
• Capability to manage ambiguous expressions and exceptional instances in training large language models.
• Clear and consistent communication skills to explain annotation decisions facilitating team alignment.
• Reliable internet access and capacity to perform efficiently in a fully remote environment.

Compensation and Work Details

• Hourly pay ranging between $30 and $50 USD.
• Full-time remote employment targeting candidates based in Manchester.