Testlio Founder Inspires Audience with Keynote on the Use of AI in Software Testing

, VP, Marketing

Kristel Kruustuk shares insights on using AI to improve software testing processes and highlights the challenges and opportunities that come with the technology.

November 22, 2023, Austin, TX – Testlio’s Founder, Kristel Kruustuk, recently delivered a captivating keynote presentation on the topic of ’10x Software Testing’ at the Agile Testing Days in Potsdam, Germany. She addressed an audience of approximately 500 people who were eager to hear her insights on software testing and artificial intelligence (AI).

Throughout her talk, Kristel discussed the challenges faced by software testers and emphasized the importance of taking ongoing incremental steps to improve processes over time. She shed light on the potential of AI to make software testing more efficient and effective, while acknowledging the challenges and opportunities that come with the technology.

Kristel shared her own experience with generative AI (GenAI) at Testlio. She explained how they have been using GenAI-based tools to improve test creation, test refactoring, and issue accuracy. Testlio’s team conducted experiments that demonstrated a 40%+ reduction in errors and a 15%-30% increase in test refactoring speed. Testlio has also successfully implemented over 20 iterations of GenAI improvements since the original experiments. Kristel also shared several innovations the company is working on, such as a Microsoft Azure OpenAI-powered assistant (a RAGbot) that is configured per Testlio Workspace to help testers make testing sessions more efficient.

Kristel emphasized that AI has potential but also comes with challenges. She highlighted the importance of working in a secure technical environment to maintain data integrity and discussed the challenges of dealing with unpredictable outcomes, response times, formatting puzzles, and prompt engineering. 

The keynote was a timely reminder that AI is not a magic solution that can solve all problems overnight. It requires time, effort, and constant improvement to make it work effectively. AI-powered tools often come with challenges that need human intervention and control. Kristel encouraged software testers to embrace AI to augment their work, helping them improve their workflows and processes. She shared that she believes that AI will not replace testers, but rather, testers who work with AI will replace those who don’t. Testlio’s solutions are designed with human-in-the-loop (HITL) as a key concept, empowering people to achieve more, faster.

The presentation provided valuable lessons for software testers and professionals. Kristel’s insights on AI and experience with GenAI at Testlio showed how combining human intelligence with machine intelligence can lead to better results. She urged her audience to keep learning, experimenting, and improving their skills to stay ahead in the rapidly evolving world of software testing. 

About Testlio
Testlio is a software testing company. We are the originator of fused software testing, a unique approach to testing that combines humans and machines to help digital innovators deliver quality products at scale. In any location. On any device. In any language. Via any payment system. The company is distributed by design, with full-time people worldwide and part-time QA and QE freelancers in over 150 countries. Clients include Amazon, athenahealth, Microsoft, the NBA, Netflix, PayPal, Uber, Wayfair, and many more. Collectively, they have awarded us an industry-leading 4.7 G2 rating. To learn more, visit www.testlio.net.

For Media inquiries, please contact Yasmin Mounajed, VP of Marketing.