[Swan-dev] tests: improvement!

[Paul Wouters]

> On Feb 3, 2019, at 11:12, D. Hugh Redelmeier <hugh at mimosa.com> wrote:
> 
> 
> < testing/pluto/newoe-25-cat-3-4-way failed east:output-different road:output-different
>> testing/pluto/newoe-25-cat-3-4-way failed east:output-different west:output-different
> 
> testing/pluto/newoe-25-cat-3-4-way/OUTPUT/east.console.diff:
>  ipsec whack --trafficstatus
> -006 #3: "private-or-clear#192.1.2.0/24"[1] ...192.1.2.45, type=ESP, add_time=1234567890, inBytes=252, outBytes=252, id='ID_NULL'
> -006 #5: "private-or-clear#192.1.2.0/24"[2] ...192.1.2.254===10.0.10.1/32, type=ESP, add_time=1234567890, inBytes=252, outBytes=252, id='ID_NULL', lease=10.0.10.1/32
> +006 #4: "private-or-clear#192.1.2.0/24"[2] ...192.1.2.45, type=ESP, add_time=1234567890, inBytes=252, outBytes=252, id='ID_NULL'
> +006 #6: "private-or-clear#192.1.2.0/24"[3] ...192.1.2.254===10.0.10.1/32, type=ESP, add_time=1234567890, inBytes=252, outBytes=252, id='ID_NULL', lease=10.0.10.1/32

The state number increased, pointing to a needless instantiation of a conn. I haven’t fixed up the tests because I’d like to see it fixed.



> 
> testing/pluto/newoe-25-cat-3-4-way/OUTPUT/west.console.diff:
> more XFRMs than last time.
> 
> I have no idea why this happens or if it points out a bug.

The multi cat tests are like that . 

> Didn't we sort the list of interfaces?  If so, what's up here?

No we didn’t do that yet.

Paul