Sr Automation Test engineer - AI product - Osborne
Job Summary
  • Dublin
  • Permanent
  • 10th March 2026
  • -
  • Ref ID: #48698

Job Description

  • Location: Dublin 2, Dublin
  • Type: Permanent
  • Job #48698

Senior Automation Test Engineer – AI Products

Location: Ireland (Hybrid)
Experience: 5–8 Years

Introduction

An innovative technology company operating in the financial services technology space is seeking an experienced Senior QA Engineer to support the development of AI-enabled enterprise platforms.

This role sits within a modern engineering environment focused on scalable systems, automation, and intelligent product capabilities. As AI-driven features become increasingly integrated into the platform, the organisation is looking for a senior quality professional who can ensure these systems remain reliable, transparent, and safe within regulated environments.

The successful candidate will play a key role in defining testing strategies for both traditional distributed systems and emerging AI-powered functionality.

Company Culture & Values:

This organisation values engineering excellence, collaboration, and continuous improvement. Teams work in a highly collaborative environment where quality, innovation, and accountability are central to product development.

Engineers are encouraged to take ownership of technical decisions, contribute to architectural discussions, and continuously improve testing practices across teams. The culture promotes knowledge sharing, mentoring, and experimentation with new technologies, particularly in the rapidly evolving area of AI-driven software systems.

Salary & Benefits:

  • Competitive salary package
  • Flexible hybrid working model
  • Opportunity to work on cutting-edge AI-enabled products
  • Influence testing strategy and engineering standards at scale
  • Exposure to modern CI/CD environments and distributed architectures
  • Collaborative environment with strong technical leadership
  • Opportunities for mentoring, technical leadership, and career progression

Duties / Responsibilities:

Automation & Platform Quality

  • Design and maintain scalable test automation frameworks used across multiple engineering teams
  • Define automation strategies and ensure alignment across delivery squads
  • Address complex testing challenges involving distributed systems, asynchronous processes, and dynamic environments
  • Design and monitor quality gates within CI/CD pipelines to support reliable releases
  • Develop internal tools and integrations that enhance test execution, observability, and feedback cycles
  • Define testing standards and ensure best practices across automation codebases
  • Collaborate with architects and senior engineers to align testing strategies with evolving platform architecture
  • Support knowledge sharing through technical mentoring, documentation, and internal workshops

AI & Machine Learning Quality

  • Define quality strategies for AI and machine learning–powered features
  • Design test approaches for systems with non-deterministic or probabilistic outputs
  • Validate AI functionality against behavioural expectations, confidence thresholds, and risk parameters
  • Assess models for bias, fairness, explainability, and compliance considerations
  • Test AI-driven functionality across model updates, data changes, and prompt or feature evolution
  • Collaborate with data scientists and ML engineers to embed quality validation throughout the model lifecycle
  • Monitor production signals to identify model drift, performance degradation, or unexpected behaviours

Key Requirements:

  • 5–8 years’ experience in Quality Engineering, Test Automation, or SDET roles
  • Strong experience building or scaling automation frameworks across engineering teams
  • Solid programming skills with an understanding of software architecture principles
  • Experience working within CI/CD environments and automated testing pipelines
  • Ability to develop internal testing tools or integrations that improve engineering efficiency
  • Comfortable operating in complex, evolving technical environments
  • Strong communication skills with the ability to influence teams and mentor engineers

AI Systems Testing Experience (Highly Beneficial):

  • Experience testing AI or machine learning-based applications
  • Understanding of the AI/ML lifecycle, including training, validation, deployment, and retraining
  • Experience validating systems where outputs are probabilistic or non-deterministic
  • Familiarity with concepts such as model drift, confidence scoring, bias detection, and false positives/negatives
  • Ability to design testing approaches where validation is behavioural or risk-based rather than purely binary

Desired Skills:

  • Strong systems thinking and analytical mindset
  • Ability to test complex systems where outcomes are context-driven
  • Experience working in highly regulated or compliance-focused environments
  • Interest in the intersection of data, AI models, and real-world product behaviour
  • Passion for mentoring and developing engineering capability within teams
  • Data-driven mindset with a focus on measurable quality outcomes
  • Awareness of the ethical considerations involved in AI-driven systems

To be considered for this position apply today or call Vishnu Singh on 01 5252457. If you are interested in finding out more about the above role and would like to be considered for this or other suitable roles that we may have available for your skill set – please attach your CV via the link provided. Please submit your updated CV in Word Format.
If you are living in Ireland and hold a VALID WORK PERMIT, we would love to hear from you, if however, you do not hold a valid work permit unfortunately we will not be in a position to assist you with your job search. 
Osborne are proud to be an Equal Opportunity Employer
#INDOSB1 
#INDSINGH

Apply for a Job

    First Name

    Last Name

    Phone Number

    Email Address

    Job Title

    Where Did You Hear About Us?

    Upload Files (Word .doc & .docx Files Only)

    Job Summary
    • Dublin
    • Permanent
    • 10th March 2026
    • -
    • Ref ID: #48698