Strong Junior QA Manual Engineer
NineTwoThree AI Studio · Ukraine
Software Development · 51-200 employees
About the role
You will define and execute test plans for non-deterministic AI products to ensure functional correctness and alignment with business goals. This involves collaborating with developers to report bugs and presenting findings to both technical and non-technical stakeholders.
What they look for
Requirements
Candidates must have at least 1.5 years of experience in QA or software engineering with a strong understanding of testing methodologies. Proficiency in manual testing for web and mobile applications, along with experience using REST APIs and DevTools, is required.
Benefits
Full description
Why Join Us?
If you're looking to work on cutting-edge AI products, solve challenging problems, and be part of a fast-moving, high-talent team, you'll love it here.
Join NineTwoThree AI Studio, a remote-first product design, engineering, and marketing studio, founded in 2012 and based in Boston. We build AI-powered web and mobile apps for big brands and fast-moving startups — from Fortune 500 companies to MIT research labs.
You'll work with really smart people — the kind of teammates who challenge you, push you forward, and make you better. We move fast and focus on getting things done.
We've been growing 20% every year for the last 5 years, which means there's plenty of room for career growth and promotions. We run on clear processes and strong leadership — we move quickly, but we don't do chaos. We do high-quality work, and we do it right.
We focus on products with a positive impact: sports, health, logistics, nuclear, and AI. If you're into gambling, adult entertainment, or crypto — we're not your place.
About This Role
This is not a traditional QA role. Most of our products are powered by AI — meaning the system's output is intentionally non-deterministic. There's no single "right answer" to compare against. Your job is to figure out what "correct" looks like for a given business goal, build your own definition of it, and systematically verify whether the system gets there.
You'll be testing things like: does the AI response correctly synthesize data from multiple sources? Does it apply the right organisational rules? Does it stay within its intended boundaries or leak information it shouldn't?
We'll teach you the tools and techniques. What we can't teach is how you think — and that's what we're hiring for.
What This Role Is Not
- It's not pixel-perfect UI checking (though functional correctness is still your baseline)
- It's not pass/fail against a rigid spec
- It's not for someone who is "comfortable with ambiguity" in the sense of being okay with vague conclusions — you'll be expected to resolve ambiguity, not tolerate it
Mindset we're hiring for (this matters more than your CV):
- When requirements are vague, you don't get stuck — you form a hypothesis, define your own acceptance criteria, and test against it
- You understand that AI systems fail in specific, diagnosable ways: hallucination, retrieval gaps, prompt sensitivity, role/permission leakage
- You think in terms of outcomes and business goals, not just functional steps
- You're honest when something is untestable without more information — and you push to get that information
- Review requirements and independently define what "correct output" looks like when none is explicitly stated
- Design test plans, scenarios, and checklists for AI-powered features where expected results are probabilistic
- Perform manual functional, regression, and exploratory testing across web and mobile
- Test AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, and failure to apply business rules
- Inspect API requests and responses via DevTools or Postman to verify what data the system actually used — not just what it showed
- Document and report bugs with enough context that developers can reproduce and diagnose them
- Collaborate closely with developers, product managers, and AI engineers
- Present findings clearly to both technical and non-technical stakeholders
Must-have:
- 1.5+ years in QA or software engineering
- Strong understanding of QA process, methodology, and terminology (test plan, test cases, SDLC, regression)
- Experience with manual testing of web and mobile applications
- Comfort working with REST API and browser DevTools to inspect what's actually happening under the hood
- Upper-Intermediate English (you'll communicate with international clients daily)
- You ask "why is this the right answer?" before accepting what the screen shows you
Nice to have:
- Basic SQL or ability to query data directly to verify what the system pulled
- Familiarity with how LLMs, RAG pipelines, or AI chatbots work under the hood
- Experience testing products with role-based access control (RBAC)
What We Offer:
- Annual paid vacation: 20 days-off per year during the first 3 years, further increasing to 25 days in later years.
- Paid sick leave, 10 national holidays and 2 company days-off.
- Well-being budget.
- Health Insurance allowance.
- Maternity/paternity leave.
- Accounting assistance.
- Reimbursement of expenses for professional development courses/certifications (up to 100% in agreement with the Manager).
- Hardware upon business needs.
- Strong positive engineering culture, a tightly-knit team of professionals with a good sense of humor.
What's The Process:
We value your time and ours and make the process fast and easy. Our interview process takes the following steps: interview with the HR, technical interview with the QA Team Lead and QA Manual Engineer, Offer.
What Growth Looks Like Here
We're building out an AI QA function from the ground up. If you grow into this role, you'll be one of the people who defines how AI systems get tested at this company — building ground-truth datasets, designing evaluation rubrics, and eventually leading QA on full AI product lines.