Context Manager - Business Analyst

Role Overview

This position focuses on bridging high-level industry challenges and domain-specific business needs with data science, prompt engineering, and large language model (LLM) applications. The role involves converting abstract business problems into actionable AI-centric requirements to drive successful outcomes.

Key Responsibilities

• Translate complex industry issues and business demands into specific requirements for data science, prompt engineering, and LLM systems.
• Prioritize AI product backlogs considering algorithm complexity, data availability, and expected business impact to maximize AI feature ROI.
• Identify and manage machine learning and cognitive computing requirements, including creating synthetic user stories, acceptance criteria, and edge cases for probabilistic outcomes.
• Redesign existing process workflows to integrate agentic workflows and automated decision-making, incorporating human-in-the-loop feedback loops for ongoing model improvement.
• Define product success criteria and performance metrics for AI systems with non-deterministic outputs, encompassing accuracy, latency, hallucination rates, and compliance with ESG and responsible AI guidelines.

Primary Skills and Expertise

• Comprehensive knowledge of generative AI, large language models, including their capabilities, limitations, architectures, tokenomics, and cost optimization methods.
• Expertise in autonomous agent system architectures, with strategic insight into deploying single solutions versus multi-agent automated systems.
• Proficient in prompt engineering and model adjustment to align system outputs with product branding and to design sophisticated semantic data synthesis structures.