[Swan-dev] two test runs, on different machines, matched

Paul Wouters paul at nohats.ca
Sun Sep 5 15:17:26 UTC 2021


On Sun, 5 Sep 2021, Andrew Cagney wrote:

> On Sun, 5 Sept 2021 at 09:44, D. Hugh Redelmeier <hugh at mimosa.com> wrote:
>       I ran the tests suite last night on two machines. It used to be that one
>       would expect different results from two runs "due to non-determanism",
>       even on the same machine.
>
>       I got the same results on two machines.  That's either good news or luck. 
>       This is probably the result of hard work: thanks!
> 
> 
> It's a bit of both, for instance, these two runs had 36 failures:
>   https://testing.libreswan.org/?run=v4.5-36-gcb013f4154-main&run=v4.5-35-g6a4754e1fd-main
> But yes, things are definitely better.

I think Andrew contributed most of this part in the last two months actually. But good to
see indeed! Next up, fixing liveness/dpd and WIP tests :)

Paul


More information about the Swan-dev mailing list