[Swan-dev] good tests that just don't pass

Andrew Cagney andrew.cagney at gmail.com
Tue Jul 31 19:39:00 UTC 2018


This is from running my hack script testing/web/never-passed.sh over
testing.libreswan.org/ the output is:

  <expectation> <nr-passes> <nr-fails> <runs-since-pass>
<runs-since-fail> <total-runs> <test>

I think the following are strong candidates for 'wip' - they have been
around for a long time without passing:

  good 0 342 342 0 342 dpd-01
  good 0 342 342 0 342 newoe-21-liveness-clear
  good 0 339 339 0 339 nss-cert-10-notyetvalid-responder-ikev2
  good 0 328 328 0 328 interop-ikev2-strongswan-35-rekey-reauth
  good 0 205 205 0 205 interop-ikev2-strongswan-38-mobike-initiator

the next test is more recent, perhaps wait and see?

  good 0 52 52 0 52 ikev2-hostpair-01

and finally this test is new - I stumbled across this bug:
  https://lists.libreswan.org/pipermail/swan-dev/2018-July/002628.html
I'd like someone to confirm that its a (long standing bug) before I
apply what will likely be a brutal fix (read delete more dead code):

  good 0 6 6 0 6 interop-ikev2-strongswan-01-ah-algo-responder

finally, the following tests have passed, but not for a very very long time:

  good 2 337 313 0 339 nss-cert-09-notyetvalid-initiator
  good 15 324 309 0 339 klips-algo-serpent-01
  good 19 320 309 0 339 klips-algo-twofish-01
  good 24 319 307 0 343 ikev1-algo-esp-sha2-01-netkey-klips

--

The entire file is in testing.libreswan.org/results/never-passed.txt


More information about the Swan-dev mailing list