[Swan-dev] test system run: corrupt charon log files

[D. Hugh Redelmeier]

Does anyone know what's going on here?

I happened to look at 
  interop-ikev1-strongswan-02-psk-responder/OUTPUT/east.charon.log
in my most recent run of the tests.

The file seeems to be corrupt.  It does not start at the beginning of
the log (judging from this log in a previous run).  It ends with a
large sequence of NUL bytes and then a few lines of text.  The NULs
start about 51k into a 464K file.

The previous run (with a different version of strongswan) produced a
log of similar size but without a pile of NULs.

interop-ikev1-strongswan-03-psk-initiator/OUTPUT/west.charon.log seems
to be similary corrupt.  Again, the previous run's west.charon.log
doesn't seem to have this problem.

This run was testing HEAD as of July 15, with one change:
In testing/libvirt/fedora22base.ks lines from "# Extra yum stuff" on were
deleted (except for the "%end" at the end).

This test run used strongswan-5.4.0-2.fc22.x86_64.
The previous test run used strongSwan 5.3.2

The test system considered this test to have passed, with whitespace
differences.  But then I don't think that the charon log is considered.

Is this just expected flakiness of the test system or is it something 
else?

OK, here's a survey.
There are a LOT of NULs in most charon logs.
The pluto log files have none.
In the previous test run, charon logs have none.

Each line is a filename followed by the number of NUL bytes it contains.

$ for i in */OUTPUT/*.charon.log ; do echo -n "$i " ; tr -cd '\000' <$i | wc -c ; done

interop-ikev1-strongswan-02-psk-responder/OUTPUT/east.charon.log 411546
interop-ikev1-strongswan-03-psk-initiator/OUTPUT/west.charon.log 357077
interop-ikev1-strongswan-04-psk-aes-ccm/OUTPUT/east.charon.log 0
interop-ikev1-strongswan-04-psk-aes-gcm/OUTPUT/east.charon.log 429913
interop-ikev1-strongswan-07-cast128/OUTPUT/west.charon.log 356102
interop-ikev1-strongswan-08-strongswan-cast/OUTPUT/east.charon.log 348885
interop-ikev1-strongswan-08-strongswan-cast/OUTPUT/west.charon.log 448445
interop-ikev1-strongswan-10-ah-initiator-sha256/OUTPUT/west.charon.log 417432
interop-ikev1-strongswan-11-ah-initiator-sha512/OUTPUT/west.charon.log 0
interop-ikev1-strongswan-12-esp-sha2_256/OUTPUT/west.charon.log 352773
interop-ikev1-strongswan-13-esp-sha2_512/OUTPUT/west.charon.log 448445
interop-ikev1-strongswan-14-camellia/OUTPUT/east.charon.log 334635
interop-ikev1-strongswan-15-twofish/OUTPUT/east.charon.log 964541
interop-ikev1-strongswan-16-serpent/OUTPUT/east.charon.log 964542
interop-ikev2-strongswan-02-psk-responder/OUTPUT/east.charon.log 427966
interop-ikev2-strongswan-03-psk-initiator/OUTPUT/west.charon.log 683914
interop-ikev2-strongswan-04-x509-responder/OUTPUT/east.charon.log 1600966
interop-ikev2-strongswan-05-psk-aes/OUTPUT/east.charon.log 346177
interop-ikev2-strongswan-05-psk-md5/OUTPUT/east.charon.log 415236
interop-ikev2-strongswan-06-aes192/OUTPUT/east.charon.log 349146
interop-ikev2-strongswan-07-strongswan/OUTPUT/east.charon.log 1238344
interop-ikev2-strongswan-07-strongswan/OUTPUT/west.charon.log 484500
interop-ikev2-strongswan-09-psk-aes-ccm/OUTPUT/east.charon.log 423870
interop-ikev2-strongswan-09-psk-aes-gcm/OUTPUT/east.charon.log 395198
interop-ikev2-strongswan-10-nat-initiator/OUTPUT/road.charon.log 666746
interop-ikev2-strongswan-11-nat-initiator/OUTPUT/road.charon.log 683570
interop-ikev2-strongswan-12-nat-responder/OUTPUT/east.charon.log 931774
interop-ikev2-strongswan-13-ah-initiator/OUTPUT/west.charon.log 661643
interop-ikev2-strongswan-14-delete-sa/OUTPUT/west.charon.log 763838
interop-ikev2-strongswan-15-create_child_sa/OUTPUT/west.charon.log 821499
interop-ikev2-strongswan-16-ah-initiator-sha512/OUTPUT/west.charon.log 661809
interop-ikev2-strongswan-17-ah-initiator-sha256/OUTPUT/west.charon.log 0
interop-ikev2-strongswan-17-delete-sa-responder/OUTPUT/west.charon.log 767933
interop-ikev2-strongswan-18-psk-cast/OUTPUT/east.charon.log 407486
interop-ikev2-strongswan-19-x509-res-certreq/OUTPUT/east.charon.log 1652101
interop-ikev2-strongswan-20-psk-aes_xcbc/OUTPUT/east.charon.log 264657
interop-ikev2-strongswan-21-transport-01/OUTPUT/east.charon.log 311233
interop-ikev2-strongswan-21-transport-02/OUTPUT/east.charon.log 353240
interop-ikev2-strongswan-21-transport-03/OUTPUT/west.charon.log 267992
interop-ikev2-strongswan-21-transport-04/OUTPUT/west.charon.log 272088
interop-ikev2-strongswan-22-cp-responder-psk/OUTPUT/east.charon.log 823389
interop-ikev2-strongswan-23-initiator-cp/OUTPUT/road.charon.log 429855
interop-ikev2-strongswan-24-aes_ctr/OUTPUT/east.charon.log 267545
interop-ikev2-strongswan-25-ke-mismatch-initiator/OUTPUT/east.charon.log 424067
interop-ikev2-strongswan-26-ke-mismatch-responder/OUTPUT/west.charon.log 421850
interop-ikev2-strongswan-27-fragmentation/OUTPUT/east.charon.log 1545236
interop-ikev2-strongswan-28-reauth/OUTPUT/west.charon.log 2003101
interop-ikev2-strongswan-29-rekey/OUTPUT/west.charon.log 0
interop-ikev2-strongswan-30-esn/OUTPUT/east.charon.log 333697