[Swan-dev] two test runs, on different machines, matched

Andrew Cagney andrew.cagney at gmail.com
Fri Sep 10 00:41:01 UTC 2021


On Sun, 5 Sept 2021 at 11:17, Paul Wouters <paul at nohats.ca> wrote:

> On Sun, 5 Sep 2021, Andrew Cagney wrote:
>
> > On Sun, 5 Sept 2021 at 09:44, D. Hugh Redelmeier <hugh at mimosa.com>
> wrote:
> >       I ran the tests suite last night on two machines. It used to be
> that one
> >       would expect different results from two runs "due to
> non-determanism",
> >       even on the same machine.
> >
> >       I got the same results on two machines.  That's either good news
> or luck.
> >       This is probably the result of hard work: thanks!
> >
> >
> > It's a bit of both, for instance, these two runs had 36 failures:
> >
> https://testing.libreswan.org/?run=v4.5-36-gcb013f4154-main&run=v4.5-35-g6a4754e1fd-main
> > But yes, things are definitely better.
>
> I think Andrew contributed most of this part in the last two months
> actually. But good to
> see indeed! Next up, fixing liveness/dpd and WIP tests :)
>

 Time to move the tests that won't pass to wip?


> Paul
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.libreswan.org/pipermail/swan-dev/attachments/20210909/b4bdbd1b/attachment.html>


More information about the Swan-dev mailing list