Are #FlakyTests causing trouble for your team's productivity & morale?😫
Trisha Gee, Java Champion and Developer Productivity Advocate, dives deep into the challenges of Flaky Tests, their costly impact on developers, and shares best practices for testing and boosting team efficiency.
📺 Watch the #InfoQ #videopodcast on YouTube: https://youtu.be/xh_ur8VkO1g
#DeveloperProductivity #Testing #SoftwareDevelopment #Agile #Culture
Thanks for having me at CloudLand 2025 yesterday - it's been a pleasure to be there, even with the advanced temperatures 🥵 . However for those occasions I can highly recommend the water roller coaster 💦
Florian Heubeck et al. thanks again for raising the opportunity to me!
🔫 🐞 Just in case you missed my talk about zapping the flakes at DevConf.cz 🔫 🐞 - here's the recording: https://www.youtube.com/watch?v=2xLEaZs2hcU&list=PLU1vS0speL2bCGfDl6lCckdCzXb_gopJV&index=40
#devconfcz #devconf2025 #talk #flakytests #flakes #recording
After a long train trip I've finally arrived in Brno yesterday. Now I'm well rested and ready to attend this year's devconf.cz instance 🥳
I'll be attending devconf.cz till Saturday - ping me if you want to meet up!
And I'll talk about zapping flakes once again - pew pew 🔫 - session is Saturday 12:30
Flakes aka tests that don’t behave deterministically, i.e. they fail sometimes and pass sometimes, are an ever recurring problem in software development. This is especially the sad reality when running end-to-end tests where a lot of components are involved. There are various reasons why a test can be flaky, however the impact can be as fatal as CI being loaded beyond capacity causing overly long feedback cycles or even users losing trust in CI itself. Ideally CI maintainers want potential flakes to be flagged at the earliest stage of the development lifecycle, so that they do not even enter the end-to-end test suite. They want a gate that acts as a safeguard for developers, pointing out to them what kind of stability issues a test has. This reduces CI user frustration and improves trust in CI. At the same time it cuts down on unnecessary waste of CI system resources. This talk will explore the [CANNIER](https://www.gregorykapfhammer.com/research/papers/parry2023/) approach, which aims to reduce the time cost of rerunning tests. The speaker and the audience will take a closer look at the feature set used to create training data from existing test code of the [KubeVirt](https://kubevirt.io/) project, enabling CI systems to predict probable flakiness of a certain test with an AI model. The speaker will cover how a subset of the CANNIER feature set is implemented, how it is used to generate training data for an AI model, and how the model is used to analyze flakiness probability, generating actionable feedback for test authors. Attendees will gain insight on how the CANNIER approach can help them improve test reliability, ultimately enhancing overall software quality and team productivity.
for everyone who missed the link to the slides of the presentation yesterday, there you go: https://github.com/dhiller/presentations/blob/master/2025-devtalks.ro/slides.pdf
excited to talk about the topic that is dearest to my heart again: how to zap flaky tests in our code base. this is so important for the @kubevirt project
https://www.devtalks.ro/agenda/11-day-1#devlead-stage
#devtalks.ro #romania #bucharest #ci #flakytests #softwareengineering #zap
The awesome team at @gradle.com have taken my blog posts and Opinions about Flaky Tests and put them all together in a very wonderful white paper!
Whether you care about flaky tests or think you don't have to worry about them, there's something in here for you.
https://gradle.com/resources/ebooks-and-whitepapers/flaky-tests/
Ready to harness the power of GenAI without disrupting your software delivery? Learn how to ensure reliable testing, maintain human oversight of AI code, optimize your continuous delivery pipelines, and implement robust security practices.
you ready for zapping the flakes? pew-pew 🔫
I'll be talking about #flakytests at #stackconf2025 tomorrow afternoon!
https://stackconf.eu/talks/zap-the-flakes-leveraging-ai-to-combat-flaky-tests-with-cannier/
Flakes aka tests that don’t behave deterministically, i.e. they fail sometimes and pass sometimes, are an ever recurring problem in software development. This is especially the sad reality when running end-to-end tests where a lot of components are involved. There are various reasons why a test can be flaky, however the impact can be as […]
Are #FlakyTests disrupting your CI/CD pipeline & draining Developer Productivity?
Trisha Gee dives deep into the hidden impact of these non-deterministic tests.
Learn why ignoring them is a costly mistake for code quality, build times & your team's sanity.
▶️ Watch the full #InfoQ #podcast video: https://bit.ly/3Gf20lX
#timestamps included in the description
#CI #CD #DeveloperProductivity #DevOps #SoftwareTesting #CodeQuality
InfoQ
Daniel Hiller
Trisha Gee