<div dir="ltr">Yes, there are many separate tests and they output in a different formats. I think some just give a number and a reference with no suggestion on what is an acceptable tolerance. So it is a bit of work to make some script that would check all this properly.</div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Nov 2, 2014 at 1:55 PM, Ryan Schmidt <span dir="ltr"><<a href="mailto:ryandesign@macports.org" target="_blank">ryandesign@macports.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><br>
On Nov 2, 2014, at 12:51 PM, David Strubbe wrote:<br>
<br>
> The point is that there is no check unfortunately on whether the tests passed. You have to read through the results to see whether they are ok. So the test phase would fail only if execution of one of the steps failed, unlike the typical situation where 'make check' would give an error code if a test gave an incorrect answer. A suggestion on how to make that clearer would be welcome.<br>
<br>
</span>Ah ok, I see. I suppose making the test phase exit with a non-zero code is difficult to do?<br>
<br>
<br>
</blockquote></div><br></div>