Manual QA Engineer

About Alivo

Alivo is building AI-powered tools that help companies communicate with customers in faster, smarter, and more personalized ways. The company’s focus is on creating conversations that improve growth, strengthen loyalty, and make each customer interaction feel meaningful.

Role Overview

Alivo is hiring a detail-focused QA Engineer to take ownership of manual testing, release verification, and the quality of AI-driven conversations across the platform. Automated checks cover repetitive testing tasks, while this position concentrates on areas that require human judgment, such as product behavior, usability, edge cases, and release readiness.

A major part of the job is reviewing AI phone and chat interactions to determine whether the system responds naturally, accurately, and effectively. You will help spot weaknesses in conversation flow, identify missteps, and shape standards that improve customer interactions and product quality.

This is a key quality role that acts as the final checkpoint before releases go live and helps define what strong AI-powered customer communication should look like.

What You Will Do

• Test new features, workflows, and user experiences manually before launch.
• Use exploratory testing to uncover defects, usability concerns, and unusual edge cases.
• Check functionality in staging and production-like environments.
• Follow structured test plans and release checklists to keep quality consistent.
• Re-test bug fixes and perform regression checks across releases.
• Review feature builds and release candidates before deployment.
• Work with engineering to spot risks and improve confidence in releases.
• Write precise, repeatable bug reports with clear documentation.
• Help shape and improve manual QA processes as the company expands.
• Act as a dependable quality gate for production launches.
• Assess AI phone and chat conversations for usefulness and overall effectiveness.
• Judge whether conversations sound natural, accurate, helpful, and aligned with customer goals.
• Review objection handling, flow quality, and customer experience outcomes.
• Identify failures, edge cases, hallucinations, and off-script behavior.
• Define quality standards and acceptance criteria for AI-driven interactions.
• Build and maintain conversation evaluation datasets and test scenarios.
• Create scoring rubrics and frameworks for measuring AI performance.
• Monitor AI quality over time and detect regressions or behavioral changes.
• Share practical recommendations to improve prompts, workflows, and model behavior.
• Partner with Engineering, Product, Customer Success, and Leadership.
• Provide feedback that improves both the product and the customer experience.
• Help prioritize quality improvements based on business goals and customer impact.
• Support a company culture that values quality.

Requirements

• 2 to 5+ years of experience in QA, software testing, product operations, or a similar function.
• Strong attention to detail and a careful, systematic testing style.
• Excellent written and spoken communication skills.
• Ability to spot edge cases, failure patterns, and customer experience problems.
• Strong analytical thinking and problem-solving ability.
• Experience preparing clear bug reports and testing documentation.
• Comfort working in a fast-moving startup environment that changes quickly.
• Highly detail-oriented and naturally inquisitive.
• A strong critical thinker who likes finding issues before customers encounter them.
• Comfortable making judgment calls about quality and user experience.
• Well-organized, dependable, and accountable.
• Able to communicate findings clearly and objectively.
• Genuinely interested in creating exceptional customer experiences.
• Bonus exposure includes AI, LLM, or conversational AI evaluation; test management or bug tracking tools such as Linear, Jira, or TestRail; API testing with Postman; basic SQL, scripting, or technical troubleshooting; customer-facing, sales, or support experience; AI-powered products or machine learning systems; and SaaS or high-growth startup environments.

Additional Information

This is an on-site role based in the Portland, Maine Metropolitan Area.

No specific salary, stipend, start date, duration, or vacancy count was provided.

To apply, send your resume to the email address provided by the employer.

Company contact: contact@alivo.ai