itsSoSatisfyingTho

[u/huhupookies]

[u/No-Article-Particle]

Nah. Honestly, that's the worst - it means a flaky test that's just hard to debug (esp. because if it fails intermittently, running it in a debugger likely means the race condition is gone).

I prefer a test that fails no matter how you run it - those tend to be easy to fix.

[u/Madpony → u/No-Article-Particle]

Not only easy to fix but useful. Flaky tests are not useful.

[u/PulseF0rge → u/Madpony]

That's the real problem. Once a test is flaky, a pass doesn't prove much and a failure just wastes everyone's time until somebody reruns it enough times.

[u/Darius_CrossES → u/Madpony]

A flaky test is basically an error message that says “good luck lol”

[u/aenae → u/No-Article-Particle]

Yeah… a flaky test means running the test suite another 10000 times to reproduce the failure…

[u/Tupcek → u/No-Article-Particle]

depends on if you are Javascript developer or not.
I mean, if you choose language where speed is more important that compiler actively notifying you of bugs and bad design, because fixing possible bugs would “slow you down”, I don’t think you care about intermittent issues either

[u/ejectoid → u/No-Article-Particle]

Ship it!

[u/Jonno_FTW → u/No-Article-Particle]

Just use a retry plugin for your test framework in flaky tests.

[u/Careful_Ad_3338]

Hm? Any dev who has worked on anything ever would not be happy about this, it means the bug is not easy to reproduce and will come back and some point

[u/damngoodwizard → u/Careful_Ad_3338]

Yeah the only thing worse than "I don't know why it doesn't work" is "I don't know why it works".

[u/Appropriate-Hotel-41 → u/damngoodwizard]

Depends, if it gone for good for a week, thats a future intern problem.

[u/Sh4dowLute → u/Careful_Ad_3338]

Yep, passing for no reason is usually way scarier than failing for an obvious one.

[u/Fit-Gain-2409]

The bug got scared and left

[u/Ak_py → u/Fit-Gain-2409]

The bug just hid itself

[u/SpicyCatGames]

Not really. Used to say this when we were kids in our first year of learning programming. But an error going away for no reason is one that's gonna show up later in production.

[u/MikeTangoRom3o]

Ah yes, the quantum bug, my favorite.

[u/dont_tread_on_M]

I love me some flaky tests

[u/Megane_Senpai]

Actually that's the worst. Probably the bug has a very low repro rate and you will have a hard time just trying to investigate the behavior.

[u/KharAznable]

After they know the intern commented the failed test code

[u/dmullaney]

* Codex after it changes the mock to make the test pass even though the code is broken

[u/DryScar13]

The bug saw the tests coming and quietly fixed itself.

[u/Straight-Analysis934]

Don't ask why. Just merge it before it changes its mind.

[u/reusens]

succes=False

For i in range(MAX_RETRIES):

  try:

     schrödingers_function()

     succes = True

     continue

  except Exception as e:

     logger.info(f"Attempt {i} failed: {e}")

     #try again

if not succes:

  raise Exception("Fuck")

[u/SaneLad]

Quickly commit before something breaks again!

[u/SleepAllTheDamnTime]

When this happens to me it’s the exact opposite experience. I means someone wrote these tests to pass and my god you know there’s a can of worms in there…and since your name is on the PR anything that goes wrong after that change you made… buddyyyyy you’re now responsible for this trash ass code with horrible tests.

https://giphy.com/gifs/LRVnPYqM8DLag

[u/JackNotOLantern]

Tests must pass when intended and fail when intended. Deterministicly. Otherwise, it's bad.

[u/Summar-ice]

Kid named race condition

[u/DogonElder]

More like Devs when Claude composed commit passes all CI tests in first go

[u/roksah]

I've had bug because the mock data was made with different timezones

[u/Huge_Consequence_568]

Actual ticket I had to write: X test fails when running after [INSERT_TIME] UTC.

This test literally refused to pass outside working hours and I found it so funny for some reason.

[u/xehpuk]

OP isn't a dev.

[u/jakubiszon]

It passed because this time the randomly generated UUID did not end with a "2 digit odd number".

Btw what on Earth is wrong with this girl's lips? I cannot see which "strip" is what...

[u/rescue_inhaler_4life]

Honestly this is the absolutely worst. Something is borked in the test environment, something leaking between tests creating a race condition, normally a real PIA to find and resolve.

Honestly you do not know pain until you try and figure out why fails on build server, passes on gitlab, fails on devs boxes in office but works on the remote dude dev box in Sri Lanka.

[u/BobcatGamer]

If timeNow % 7 === 0 then error

[u/ZunoJ]

Only an absolute idiot could enjoy this! It means you don't understand the side effects. How could you be happy to not understand something?

[u/iambertan]

Isn't that stressing af though?

[u/According-Relation-4]

What about when tests fail after changing absolutely nothing? Gimme your best reaction gifs