[Swan-dev] some test failures
D. Hugh Redelmeier
hugh at mimosa.com
Thu Jun 23 23:35:17 UTC 2016
kvmresults 0.060: ****** invalid test klips-ikev2-algo-sha2-0: directory not found: testing/pluto/klips-ikev2-algo-sha2-0
testing/pluto/basic-pluto-00 failed west:output-different
apparently this is expected.
Can we mark this is such?
testing/pluto/ikev1-01-fuzzer failed east:ASSERTION,CORE,output-different
I think that I have a fix for this. But I cannot test it without
losing the work of the previous test run.
testing/pluto/ikev2-02-responder-send-notify failed east:output-different west:output-different
testing/pluto/ikev2-delete-02 failed east:output-different west:output-different
Looks like someone changed something with out updating the logs.
I'm not sure.
testing/pluto/ikev2-09-rw-rsa failed road:output-different
I'm not sure.
testing/pluto/ikev2-12-x509-ikev1-rw failed west:output-different
More lead-detective output.
Why?
testing/pluto/ikev2-12-transport-psk failed east:output-different west:output-different
west: local policy requires Transport Mode but peer requires required Tunnel Mode
I'm not sure why.
testing/pluto/ikev2-18-x509-alias incomplete east:EXPECTATION,output-unchecked road:EXPECTATION,output-unchecked
testing/pluto/ikev2-31-nat-rw-no-rekey passed east:EXPECTATION road:output-whitespace
testing/pluto/ikev2-32-nat-rw-rekey passed east:EXPECTATION road:output-whitespace
testing/pluto/ikev2-45-impair-gx-02 failed west:EXPECTATION,output-different
testing/pluto/ikev2-allow-narrow-01 failed east:output-different west:EXPECTATION,output-different
testing/pluto/ikev2-allow-narrow-02 failed west:EXPECTATION,output-different
testing/pluto/ikev2-allow-narrow-03 failed west:EXPECTATION,output-different
testing/pluto/newoe-21-liveness-clear failed east:EXPECTATION,output-different road:output-different
testing/pluto/newoe-23-reverse-nat passed east:EXPECTATION road:EXPECTATION
testing/pluto/ikev2-liveness-06 failed east:EXPECTATION,output-different road:output-different
testing/pluto/ikev2-liveness-07 failed east:EXPECTATION,output-different road:output-different
testing/pluto/ikev2-21-mode-mismatch-01 failed east:output-different west:EXPECTATION,output-different
testing/pluto/nss-cert-05 failed east:EXPECTATION west:output-different
pexpect problems never get fixed. passert ones do.
testing/pluto/ikev2-31-nat-rw-no-rekey passed east:EXPECTATION road:output-whitespace
testing/pluto/ikev2-32-nat-rw-rekey passed east:EXPECTATION road:output-whitespace
testing/pluto/newoe-25-cat-5 passed east:output-whitespace road:output-whitespace
testing/pluto/algo-pluto-10 failed east:output-whitespace west:output-different
testing/pluto/ah-pluto-07-klips-netkey failed east:output-whitespace west:output-different
whitespace problems ought to be really easy fixes.
testing/pluto/ikev2-41-rw-replace failed road:output-different
testing/pluto/ikev2-42-rw-replace-responder failed road:output-different
stupid refhim= problem.
It is not clear what to do about this endemic problem.
testing/pluto/ikev2-45-impair-gx-02 failed west:EXPECTATION,output-different
+003 "westnet-eastnet-ipv4-psk-ikev2" #1: EXPECTATION FAILED at
/source/programs/pluto/ikev2.c:1807: st != NULL && st->st_event !=
NULL && st->st_event->ev_type == EVENT_v2_RETRANSMIT
Perhaps this is related to the new leaks?
testing/pluto/ikev2-47-priority failed east:output-different west:output-different
-000 "westnet-eastnet-ikev2": conn_prio: 24,24; interface: eth1; metric: 0; mtu: unset; sa_prio:1001;
+000 "westnet-eastnet-ikev2": conn_prio: 24,24; interface: eth1; metric: 0; mtu: unset; sa_prio:1001; sa_tfc:none;
Looks to me as if someone didn't update the reference logs
testing/pluto/ikev2-49-hub-spoke failed north:output-unchecked west:output-different
-006 #2: "westnet-northnet-ipv4-psk", type=ESP, add_time=1234567890, inBytes=0, outBytes=336, id='@east'
+006 #2: "westnet-northnet-ipv4-psk", type=ESP, add_time=1234567890, inBytes=336, outBytes=336, id='@east'
No idea if this is serious.
testing/pluto/ikev2-51-rw-nat-ikeport failed east:output-different road:output-different
test seems to have quit early: truncated logs
testing/pluto/ikev2-29-no-rekey failed east:output-different west:output-different
looks like a bunch of changes without the reference logs being updated
testing/pluto/ikev2-ddns-02 failed east:output-different west:output-different
+[1466661451] unbound-control[2318:0] error: connect: Connection refused for 127.0.0.1
testing/pluto/ikev2-algo-05-aes-default failed east:output-different
changes in output of
grep -A 1 'af+type: IKEv2_KEY_LENGTH' /tmp/pluto.log
testing/pluto/ikev2-algo-sha2-06 failed west:output-different
hard to say. Some XFRM stuff missing from log.
testing/pluto/ikev2-algo-esn-01 failed west:output-different
testing/pluto/ikev2-algo-esn-03 failed west:output-different
testing/pluto/ikev2-algo-esn-04 failed west:output-different
testing/pluto/ikev2-algo-esn-05 failed west:output-different
100% packet loss
testing/pluto/ikev2-major-version-initiator failed east:ASSERTION,CORE,output-different west:output-different
testing/pluto/ikev2-major-version-responder failed west:ASSERTION,CORE,output-different
Real bug.
I think that I have fix.
testing/pluto/ikev2-allow-narrow-01 failed east:output-different west:EXPECTATION,output-different
I suspect that this is a longstanding problem.
testing/pluto/ikev2-allow-narrow-02 failed west:EXPECTATION,output-different
testing/pluto/ikev2-allow-narrow-03 failed west:EXPECTATION,output-different
Just the EXPECTATION
testing/pluto/nflog-01-global failed west:output-different
Looks like just a few packets changed. Timing?
testing/pluto/nflog-03-conns failed east:output-different west:output-different
-004 "westnet-eastnet-nflog" #1: STATE_MAIN_I4: ISAKMP SA established {auth=RSA_SIG cipher=aes_256 integ=OAKLEY_SHA2_512 group=MODP2048}
+004 "westnet-eastnet-nflog" #1: STATE_MAIN_I4: ISAKMP SA established {auth=RSA_SIG cipher=aes_256 integ=sha group=MODP2048}
testing/pluto/netkey-vti-01 failed west:output-different
Some differences I don't understand. Perhaps just timing.
- ip tunnel add west-east mode vti remote 192.1.2.23 local 192.1.2.45 ikey 20 okey 21
+ ip tunnel add west-east mode vti remote 192.1.2.23 local 192.1.2.45 key 20
Reference log update required?
testing/pluto/netkey-tfc-01 failed west:output-different
-000 "tfc": sha2-truncbug:no; initial-contact:no; cisco-unity:no; fake-strongswan:no; send-vendorid:no; send-no-esp-tfc:yes; send-no-esp-tfc:no;
+000 "tfc": sha2-truncbug:no; initial-contact:no; cisco-unity:no; fake-strongswan:no; send-vendorid:no; send-no-esp-tfc:yes;
Reference log update required?
testing/pluto/ikev2-frag-02-ipv6 failed east:output-different west:output-different
Subtle but serious failure (I think).
testing/pluto/dynamic-iface-01 failed west:output-different
Retransmission was tweaked but reference logs were not updated.
testing/pluto/newoe-01-whack failed east:output-different west:output-different
testing/pluto/newoe-03-oeself failed east:output-different road:output-different
testing/pluto/newoe-04-pass-pass failed east:output-different road:output-different
I don't know but looks like a bug.
================ I stopped here ================
testing/pluto/newoe-05-hold-pass failed east:output-different road:ASSERTION,output-different
testing/pluto/newoe-07-ike-replace-initiator failed east:output-different road:output-different
testing/pluto/newoe-07-ike-replace-initiator-esp failed east:output-different road:output-different
testing/pluto/newoe-08-ike-replace-responder failed east:output-different road:output-different
testing/pluto/newoe-08-restart failed east:output-different road:output-different
testing/pluto/newoe-09-mutual failed east:output-different road:output-different
testing/pluto/newoe-10-expire-inactive failed east:output-different road:output-different
testing/pluto/newoe-10-expire-inactive-ike failed east:output-different road:output-different
testing/pluto/newoe-11-failike failed road:ASSERTION,output-different
testing/pluto/newoe-12-clear failed road:output-different
testing/pluto/newoe-13-block failed east:output-different road:output-different
testing/pluto/newoe-14-clear-in-block-clear failed east:output-different road:output-different
testing/pluto/newoe-15-portpass failed east:output-different road:output-different
testing/pluto/newoe-16-pass-hold failed road:output-different
testing/pluto/newoe-18-poc-poc failed east:output-different road:output-different
testing/pluto/newoe-18-poc-cop failed east:output-different road:output-different
testing/pluto/newoe-18-poc-private failed east:output-different road:output-different
testing/pluto/newoe-18-poc-clear failed east:output-different road:output-different
testing/pluto/newoe-18-poc-block failed east:output-different road:output-different
testing/pluto/newoe-18-cop-poc failed east:output-different road:output-different
testing/pluto/newoe-18-cop-cop failed east:output-different road:output-different
testing/pluto/newoe-18-cop-private failed east:output-different road:output-different
testing/pluto/newoe-18-cop-clear failed east:output-different road:output-different
testing/pluto/newoe-18-cop-block failed east:output-different road:output-different
testing/pluto/newoe-18-private-poc failed east:output-different road:output-different
testing/pluto/newoe-18-private-cop failed east:output-different road:output-different
testing/pluto/newoe-18-private-private failed east:output-different road:output-different
testing/pluto/newoe-18-private-clear failed east:output-different road:output-different
testing/pluto/newoe-18-private-block failed east:output-different road:output-different
testing/pluto/newoe-18-clear-poc failed east:ASSERTION,output-different road:output-different
testing/pluto/newoe-18-clear-cop failed east:output-different road:output-different
testing/pluto/newoe-18-clear-private failed east:ASSERTION,output-different road:output-different
testing/pluto/newoe-18-clear-clear failed east:output-different road:output-different
testing/pluto/newoe-18-clear-block failed east:output-different road:output-different
testing/pluto/newoe-18-block-poc failed east:ASSERTION,output-different road:output-different
testing/pluto/newoe-18-block-cop failed east:output-different road:output-different
testing/pluto/newoe-18-block-private failed east:ASSERTION,output-different road:output-different
testing/pluto/newoe-18-block-clear failed east:output-different road:output-different
testing/pluto/newoe-18-block-block failed east:output-different road:output-different
testing/pluto/newoe-18-poc-blockall failed east:output-different road:output-different
testing/pluto/newoe-18-private-clearall failed east:output-different road:output-different
testing/pluto/newoe-18-private-copall failed east:output-different road:output-different
testing/pluto/newoe-18-private-pocall failed east:output-different road:output-different
testing/pluto/newoe-19-poc-poc-clear failed east:output-different road:output-different
testing/pluto/newoe-20-ipv6 failed east:output-different road:ASSERTION,output-different
testing/pluto/newoe-21-liveness-clear failed east:EXPECTATION,output-different road:output-different
testing/pluto/newoe-22-nat-poc-cop failed east:output-different road:output-different
testing/pluto/newoe-25-cat-1 failed east:output-different road:output-different
testing/pluto/newoe-25-cat-2 failed east:output-different road:output-different west:output-different
testing/pluto/newoe-25-cat-3-4-way failed east:ASSERTION,output-different north:output-different road:output-different west:output-different
testing/pluto/newoe-25-cat-4 failed east:output-different road:output-different west:output-different
testing/pluto/dpd-01 failed west:output-different
testing/pluto/dpd-03 failed west:output-different
testing/pluto/dpd-04 failed east:output-different west:output-different
testing/pluto/dpd-05 failed west:output-different
testing/pluto/dpd-06 failed west:output-different
testing/pluto/ikev2-liveness-05 failed east:output-different west:output-different
testing/pluto/ikev2-liveness-06 failed east:EXPECTATION,output-different road:output-different
testing/pluto/ikev2-liveness-07 failed east:EXPECTATION,output-different road:output-different
testing/pluto/ikev2-liveness-08-drop failed east:output-different west:output-different
testing/pluto/delete-sa-03 failed east:output-different west:output-different
testing/pluto/x509-pluto-02 failed north:output-different
testing/pluto/x509-pluto-04 incomplete east:output-unchecked west:output-unchecked
testing/pluto/x509-pluto-frag-01 failed road:output-different
testing/pluto/nat-pluto-02 failed road:output-different
testing/pluto/nat-pluto-04 failed east:output-different road:output-different
testing/pluto/ikev1-algo-ike-aes-02 failed east:output-different west:output-different
testing/pluto/psk-pluto-02 incomplete east:output-different road:output-different
testing/pluto/xauth-pluto-07 failed road:output-different
testing/pluto/xauth-pluto-08 failed road:output-different
testing/pluto/xauth-pluto-11 incomplete east:output-unchecked road:output-unchecked
testing/pluto/xauth-pluto-12 failed east:output-different road:output-different
testing/pluto/xauth-pluto-14 failed road:output-different
testing/pluto/xauth-pluto-15 failed east:output-different road:output-different
testing/pluto/xauth-pluto-17 failed east:output-different
testing/pluto/xauth-pluto-18 failed east:output-different road:output-different
testing/pluto/xauth-pluto-20-pam failed road:output-different
testing/pluto/basic-pluto-12 failed east:output-different west:output-different
testing/pluto/algo-pluto-10 failed east:output-whitespace west:output-different
testing/pluto/nat-transport-02 failed north:output-different
testing/pluto/ikev2-21-mode-mismatch-01 failed east:output-different west:EXPECTATION,output-different
testing/pluto/ikev2-21-mode-mismatch-02 failed east:output-different west:output-different
testing/pluto/ah-pluto-07-klips-netkey failed east:output-whitespace west:output-different
testing/pluto/interop-ikev2-strongswan-22-cp-responder-psk failed road:output-different
testing/pluto/interop-ikev2-strongswan-26-ke-mismatch-responder failed west:output-different
testing/pluto/interop-ikev1-strongswan-15-twofish failed east:output-different west:output-different
testing/pluto/interop-ikev1-strongswan-16-serpent failed east:output-different west:output-different
testing/pluto/netkey-klips-pluto-03 failed west:output-different
testing/pluto/klips-netkey-pluto-06 failed west:output-different
testing/pluto/ipv6-tunnel-mode-02-netkey-netkey failed east:output-different west:output-different
testing/pluto/ipv6-tunnel-mode-04-rw failed east:output-different road:output-different
testing/pluto/interop-ikev2-racoon-02-psk-responder failed east:output-different west:output-different
testing/pluto/interop-ikev2-strongswan-03-psk-initiator failed west:output-different
testing/pluto/interop-ikev2-strongswan-04-x509-responder failed west:output-different
testing/pluto/interop-ikev2-strongswan-13-ah-initiator failed west:output-different
testing/pluto/interop-ikev2-strongswan-14-delete-sa failed west:output-different
testing/pluto/interop-ikev2-strongswan-15-create_child_sa incomplete east:output-different west:output-different
testing/pluto/interop-ikev2-strongswan-17-delete-sa-responder failed west:output-different
testing/pluto/interop-ikev2-strongswan-27-fragmentation failed west:output-different
testing/pluto/dnssec-pluto-01 failed west:output-different
testing/pluto/replay-authip-01 failed east:ASSERTION,CORE,output-different
testing/pluto/l2tp-01 failed east:output-different north:output-different
testing/pluto/l2tp-02 failed east:output-different north:output-different
testing/pluto/l2tp-02-netkey failed east:output-different north:output-different
testing/pluto/fips-default-ikev1-01-nofips-east failed west:output-different
testing/pluto/fips-default-ikev2-01-nofips-east failed east:output-different west:output-different
testing/pluto/fips-default-ikev1-02-nofips-west failed east:output-different
testing/pluto/fips-default-ikev2-02-nofips-west failed east:output-different west:output-different
testing/pluto/fips-03-ikev1-md5 failed east:output-different
testing/pluto/fips-04-ikev2-md5 failed east:output-different
testing/pluto/fips-06-ikev1-3des-sha1 failed west:output-different
testing/pluto/fips-07-ikev2-3des-sha256 failed west:output-different
testing/pluto/fips-08-ikev2-x509 failed east:output-different west:output-different
testing/pluto/netkey-passthrough-00 failed east:output-different west:output-different
testing/pluto/netkey-passthrough-01 failed east:output-different west:output-different
testing/pluto/netkey-passthrough-02 failed east:output-different west:output-different
testing/pluto/netkey-passthrough-03 failed east:output-different west:output-different
testing/pluto/nss-cert-04 failed west:output-different
testing/pluto/nss-cert-05 failed east:EXPECTATION west:output-different
testing/pluto/nss-cert-chain-02 failed west:output-different
testing/pluto/nss-cert-crl-01-strict failed west:output-different
testing/pluto/nss-cert-crl-02 failed west:output-different
testing/pluto/nss-cert-crl-02-fetch failed east:output-different
testing/pluto/nss-cert-crl-03-strict failed west:output-different
testing/pluto/nss-cert-nosecret failed east:output-different west:output-different
testing/pluto/nss-cert-ocsp-01-strict failed west:output-different
testing/pluto/nss-cert-ocsp-02 failed east:output-different west:output-different
testing/pluto/nss-cert-ocsp-02-ikev2 failed east:output-different west:output-different
testing/pluto/nss-cert-ocsp-02-strict failed east:output-different west:output-different
testing/pluto/nss-cert-ocsp-03-strict failed west:output-different
testing/pluto/nss-cert-ocsp-04 failed west:output-different
testing/pluto/nss-cert-ocsp-04-strict failed west:output-different
testing/pluto/nss-cert-ocsp-05-strict failed west:output-different
testing/pluto/nss-cert-ocsp-06 failed west:output-different
testing/pluto/nss-cert-ocsp-07-nourl failed east:output-different west:output-different
testing/pluto/ipsec-hostkey-01 failed east:output-different west:output-different
More information about the Swan-dev
mailing list