- Experience
- Any
- Salary
- USD 60 – USD 80 / hour
- Openings
- 1
- Posted
- 4 days ago
Job description
About the role
This contract role is focused on improving how language models interpret and carry out sophisticated business tasks. The work centers on creating evaluation tasks based on real professional documents and using strong business judgment to define clear outcomes and reliable scoring methods.
The engagement is remote and designed for an independent contractor who can work asynchronously while maintaining consistent quality across a substantial weekly workload. Compensation is listed at $60 to $80 per hour, with an expected commitment of 15 to 20 hours each week.
Key responsibilities
- Develop multi-step benchmark tasks using real business materials such as plans, reports, and presentations, each paired with a clear target answer and an objective scoring framework.
- Create instruction-following scenarios that assess careful professional reasoning in settings involving document review, web search, and code execution.
- Strengthen task quality by keeping prompts well-defined, instructions clear, and evaluation rules reproducible.
- Use domain expertise in management consulting, business strategy, operations, or closely related fields to produce work that mirrors real workplace complexity.
- Preserve consistency and structural discipline across a high weekly output while working in a self-managed, asynchronous environment.
Core requirements
- Proven background in one or more of the following: management consulting, business strategy, marketing and sales, HR and organizational development, or business operations.
- Capability to build layered, multi-step professional scenarios with reasoning that can be traced and outputs that can be verified.
- Excellent business writing skills, with the ability to produce formal, precise, and clearly structured documents and instructions.
- Comfort working with document-intensive materials such as business plans, executive reports, and strategic presentations, along with the analytical judgment these tasks demand.
- Ability to work independently as a 1099 contractor with weekly deliverables and continued work tied to performance.
Additional strengths
- Experience with model evaluation, data annotation, or technical writing used in automation or language model training workflows is a plus.
- Background in advisory or analytical client-facing work where clarity of instruction and accuracy of output were essential.
Employment details
This is a contract position based in Canada and performed remotely. The role calls for 15 to 20 hours per week. Compensation is $60 to $80 per hour.
Application note
Applications are handled through a social professional networking platform's Easy Apply feature.