[Swan-dev] two test runs, on different machines, matched
Paul Wouters
paul at nohats.ca
Sun Sep 5 15:17:26 UTC 2021
On Sun, 5 Sep 2021, Andrew Cagney wrote:
> On Sun, 5 Sept 2021 at 09:44, D. Hugh Redelmeier <hugh at mimosa.com> wrote:
> I ran the tests suite last night on two machines. It used to be that one
> would expect different results from two runs "due to non-determanism",
> even on the same machine.
>
> I got the same results on two machines. That's either good news or luck.
> This is probably the result of hard work: thanks!
>
>
> It's a bit of both, for instance, these two runs had 36 failures:
> https://testing.libreswan.org/?run=v4.5-36-gcb013f4154-main&run=v4.5-35-g6a4754e1fd-main
> But yes, things are definitely better.
I think Andrew contributed most of this part in the last two months actually. But good to
see indeed! Next up, fixing liveness/dpd and WIP tests :)
Paul
More information about the Swan-dev
mailing list