RoboCon 2023 - Edge detection: a new way to perform image based UI testing

  Рет қаралды 515

Robot Framework

10 ай бұрын

My personal "rabbit hole" with image-based UI testing - and how I got back.
"Image-based UI testing libraries (e.g. ImageHorizon or Sikuli) use small reference images to localize elements on the screen (e.g. buttons).
This method works extremely well ... - well, almost.
""Image 'button1.png' was not found on screen"". Do you know this message? If you still get it after 30 test runs, you want to scream at the library: ""Are you blind? There's the button! Click on it now, for God's sake!""
In a customer project I had such errors all the time - and got to the bottom of them. And to be honest, I was a bit shocked how lucky I always was when I finally got a hit and the test worked - just because I had fiddled long enough with the recognition accuracy (""similarity""/""confidence"" etc.) in an almost criminal way.
With this in mind, we added a new detection strategy to the ImageHorizonLibrary which pre-processes the images to be searched using the ""canny edge detection"" algorithm.
In the presentation, I introduce the ""edge"" strategy and use examples from real customer projects to show where it has been a real problem solver."
Welcome to Robocon - The Ultimate Robot Framework Gathering! 🤖🚀
Robocon is an annual, electrifying event held in the vibrant city of Helsinki, Finland, where Robot Framework enthusiasts from around the world come together to celebrate their passion for test automation. It's a unique opportunity to connect with fellow testers, developers, and automation aficionados.
At Robocon, we dive into the latest trends and innovations in the world of Robot Framework. Robocon is about engaging workshops, inspiring talks, and hands-on sessions led by industry experts. Whether you're a novice looking to get started or a seasoned pro seeking advanced insights, Robocon has something for everyone.
Forge lasting connections, exchange ideas, and be part of a thriving community that shares your enthusiasm for Robot Framework. Join us at Robocon and be a part of this annual gathering that fuels your test automation journey.
Don't miss out on the chance to be part of this exciting event. Subscribe now for updates and be ready to experience the future of test automation at Robocon! 🌐🤖🌟

Пікірлер: 5
@asriniv6
@asriniv6 7 ай бұрын
Awesome
@asriniv6
@asriniv6 7 ай бұрын
I am trying to use the library and when I checked using the set strategy - it says keyword set strategy not found!! any help on this?could you point to some documentation?
OMG😳 #tiktok #shorts #potapova_blog
00:58
Potapova_blog
Рет қаралды 4,3 МЛН
Пробую самое сладкое вещество во Вселенной
00:41
Heartwarming: Stranger Saves Puppy from Hot Car #shorts
00:22
Fabiosa Best Lifehacks
Рет қаралды 18 МЛН
OMG😳 #tiktok #shorts #potapova_blog
00:58
Potapova_blog
Рет қаралды 4,3 МЛН