Senior Test Automation Engineer (Python)

This is us

At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.

This is the job

In Ukraine, we are looking for a Senior Automation Testing Engineer to join our AI Factory team and act as the quality gate between Development and Release & Transition.

In this role, you will design and execute test strategies for automation, low-code applications, and AI agent solutions. You will focus not only on traditional functional and regression testing, but also on the specific quality challenges of AI systems, including output consistency, accuracy, exception handling, and edge-case behaviour.

This is a 5-month engagement with a strong possibility of extension, supporting a long-term enterprise transformation program.

This is you

• Proven QA or test engineering experience within an automation, low code or AI delivery environment.
• Hands-on experience with Python and Playwright.
• Practical knowledge of testing AI or agentic systems, including awareness of non-deterministic output and the need for statistically robust validation approaches.
• Familiarity with test management and defect tracking, ideally integrated with Jira.
• Understanding of responsible AI and governance requirements as they apply to pre-release testing, for example bias, safety and escalation behaviour.
• Comfortable operating across multiple concurrent use cases within a factory-style delivery cadence.
• Clear, structured written communication for defect reporting and sign-off documentation

Success Measures.

• Upper-Intermediate English level.

Nice-to-have skills:

• Knowledge of KQL for analyzing outputs and logs in Azure Log Analytics.
• Familiarity with testing solutions built with Microsoft Power Platform and Power Automate.
• Knowledge of Microsoft Copilot Studio and AI agents within the Microsoft ecosystem.

This is your role

• Define test strategy and test cases for each use case, covering functional, regression, integration and exception scenarios.
• Execute structured testing of automation workflows, low code applications and AI agent outputs against acceptance criteria.
• Design and run agent-specific validation, including accuracy, consistency and safe failure behaviour under edge case inputs.
• Log, triage and track defects with AI Engineers and the Solution Architect through to resolution.
• Own formal QA sign-off prior to release, acting as the final quality gate before Release and Transition.
• Support post go-live monitoring in partnership with the Command Centre managed service, where in scope.
• Contribute quality and defect data into the COE methodology's E2E Summary Dashboard for cross-client reporting.

At Avenga, everyone matters. We provide equal opportunities in recruitment, career development, and leadership, regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to fostering a work environment where our diverse community of employees, candidates, and business partners actively shapes our growth. By bringing together people from different backgrounds and experiences, we build a workplace where everyone feels free to be themselves while honoring the boundaries of others.