Programme Launch + Save 25%

AutomationSTAR

Test Automation Conference Europe

Track Talk T11

Old Problems of New Agents: Oracles and Communication

Henri Terho

Szilárd Széll

13:45 - 14:30, Tuesday 11th November CET

Agent-based software development is taking over everywhere with its promise of boosted efficiency and autonomy. But for test automation professionals—especially those who champion quality and manage risk—fully trusting agents isn’t so straightforward. In this session, we’ll confront the two core challenges that stand between us and truly autonomous software creation: the communication problem and the oracle problem.

if you care about the future of test automation, understanding how AI agents collaborate, communicate, and validate outcomes is critical. We’ll explore problems and solutions, including Large Language Model (LLM) “judges,” Retrieval-Augmented Generation (RAG) workflows, and the power of Human-in-the-Loop strategies.

You’ll discover how these techniques can enhance communication clarity among both human stakeholders and AI-driven agents, preventing costly misunderstandings. We’ll then tackle the oracle problem—determining “correct” AI outputs—by showcasing supercharged feedback loops that leverage heuristics, known datasets, and real-time human insights.

Join us to learn how to design a resilient, value-focused AI-based development and testing pipeline. Attendees will leave with practical insights on integrating advanced LLM capabilities into their quality assurance strategies. From bridging communication gaps to validating AI-generated outputs, this talk offers a forward-looking view of how test automation teams can harness autonomous agents—safely and effectively. If you’re ready to future-proof your test strategies in an era of agentic development, this session is for you.

BACK TO PROGRAMME

What you will Learn

  1. Human-in-the-loop: Using human evaluators to guide your software process.
  2. Knowledge sources: Relying on trusted knowledge management practices are key to improving reliability of the output.
  3. Supercharged Feedback loops: Key to identify mistakes with the speed they emerge.

Session Details

  • Advanced
  • 30mins
  • 15mins Q&A
Buy Conference Ticket

Session Speaker

Henri Terho

Eficode, Finland

Henri Terho is a Senior AI Consultant at Eficode with broad experience spanning regulated industries—automotive, banking, aerospace, and beyond—alongside a deep commitment to open-source collaboration. He has played a key role in fostering community-driven innovation, having served as chairman of Tampere ES and co-founding Tampere Tribe to support local startup culture. Henri’s passion for AI, quality assurance, and rapid software development is evident in both his industry work and ongoing PhD research on agile product innovation. He frequently shares his expertise on stage and in publications, championing lean practices and the latest AI advances to empower organizations worldwide.

Co Speaker

Szilard Szell

Eficode, Finland

Szilárd Széll is a DevOps adaptation lead passionate about Quality with over 20 years of experience. He has played a key role in building testing communities and has been involved in the program committee of major events. Recently, he co-founded the Finnish Testing Meetup, which has grown into an active community of over 500 members. Szilard also contributes to the advancement of testing by sharing his expertise on stage and creating content as an active member of ISTQB.