[Swan-dev] pexpect failures in test summary

[Andrew Cagney]

On Thu, 7 Feb 2019 at 10:53, D. Hugh Redelmeier <hugh at mimosa.com> wrote:
>
> I like it that pexpect failures are flagged in test summaries.
>
> For example:
> testing/pluto/nss-cert-ocsp-05-ikev2 failed east:EXPECTATION west:EXPECTATION,output-different
>
> But some are not reported.  For example:
>
> tests.LOG14.results:testing/pluto/nss-cert-10-notyetvalid-responder-ikev2 failed east:output-different west:output-different
>
> testing/pluto/nss-cert-10-notyetvalid-responder-ikev2/OUTPUT/west.console.diff:14:-003 "nss-cert" #2: EXPECTATION FAILED: st != NULL && st->st_event != NULL && st->st_event->ev_type == EVENT_RETRANSMIT (in complete_v2_state_transition at /source/programs/pluto/ikev2.c:1827)

That's a leading '-' in a diff file.  Are you sure it is in the current output?

> When are they reported and when are they not?

It is looking for them in pluto.log, and all expectation failures
should get written to pluto.log