[Swan-dev] testing/pluto/ikev2-03-basic-rawrsa-ckaid

Andrew Cagney andrew.cagney at gmail.com
Sun Feb 3 02:32:32 UTC 2019

Already fixed.
testing: update ikev2-03-basic-rawrsa-ckaid to expect new output
(but I suspect the sanitizer tweak broke something)

On Sat, 2 Feb 2019 at 17:51, D. Hugh Redelmeier <hugh at mimosa.com> wrote:
> | From: Paul Wouters <paul at nohats.ca>
> |
> | Because of the raw pub key not being in secrets and then we cannot find it.
> |
> | It’s a bug but an old one. It might be triggered now with some secrets file install change
> So: is this test known to fail?
> If it is, it is a waste of time and a cognative burden for each person
> testing.
> - we need an announced category of "expected failures"
> - we need reference logs reflecting such bugs so that when something
>   changes in the output we get a signal.
> - if the expected failure creates non-deterministic results, we need
>   to declare that too
> I'm reporting a bunch of failures because I don't want to waste a lot
> of time ignoring them.  That sounds like a contradiction but I have to
> analyze them enough each time to decide to ignore them.
> The alternative is to ignore any test that failed "before".  That's
> negligent, but it's what most of us do._______________________________________________
> Swan-dev mailing list
> Swan-dev at lists.libreswan.org
> https://lists.libreswan.org/mailman/listinfo/swan-dev

More information about the Swan-dev mailing list