tag:blogger.com,1999:blog-11691629798315689242024-03-13T21:34:39.138-07:00CL Test GridA. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.comBlogger7125tag:blogger.com,1999:blog-1169162979831568924.post-78093008118113987332018-10-27T05:18:00.002-07:002018-10-27T05:20:30.062-07:00quicklisp 2018-10-18Test diff with the previous release:<br />
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2018-10-18-diff2.html">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2018-10-18-diff2.html</a><br />
<br />A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com0tag:blogger.com,1999:blog-1169162979831568924.post-39952620079299774512016-10-02T18:45:00.001-07:002016-10-02T18:49:06.182-07:00quicklisp 2016-09-29Test results for quicklisp 2016-09-29 comparing to the previous release are coming <a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-09-29-diff2.html">here</a>.<br />
<br />
If you need help reproducing or understanding particular failure, <a href="http://groups.google.com/group/cl-test-grid">email</a> or comment.A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com0tag:blogger.com,1999:blog-1169162979831568924.post-58345483105058364402016-06-09T17:44:00.001-07:002016-06-09T17:44:36.139-07:00quicklisp 2016-05-31<span style="background-color: white; color: #333333; font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif; font-size: 14.85px; line-height: 14.85px;">The difference between this and previous months:</span><br />
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
Grouped by lisp implementation first and then by library:</div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-05-31-diff.html" style="color: #771100; text-decoration: none;">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-05-31-diff.html</a></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
Grouped by library first and then by lisp impl:</div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-05-31-diff2.html" style="color: #771100; text-decoration: none;">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-05-31-diff2.html</a></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
(Both reports show the same data, just arranged differently)</div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
This time the diff is smaller than the past month. There are some regressions, some improvements.</div>
<div style="background-color: white; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: arial, tahoma, helvetica, freesans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
If you're interested in some particular failure or need help investigating something, just ask in the comments or on the <a href="https://groups.google.com/forum/#!forum/cl-test-grid" style="color: #771100; text-decoration: none;">mailing list</a>.</div>
A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com0tag:blogger.com,1999:blog-1169162979831568924.post-27675834348585850442016-05-02T17:44:00.005-07:002016-05-03T02:25:42.732-07:00quicklisp 2016-04-21<span style="background-color: white; color: #333333; font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif; font-size: 14.85px; line-height: 14.85px;">The difference between this and previous months:</span><br />
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
Grouped by lisp implementation first and then by library:</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid//ql/quicklisp-2016-04-21-diff.html" style="color: #771100; text-decoration: none;">https://common-lisp.net/project/cl-test-grid//ql/quicklisp-2016-04-21-diff.html</a></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
Grouped by library first and then by lisp impl:</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid//ql/quicklisp-2016-04-21-diff2.html" style="color: #771100; text-decoration: none;">https://common-lisp.net/project/cl-test-grid//ql/quicklisp-2016-04-21-diff2.html</a></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
(Both reports show the same data, just arranged differently)</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
As usually, some new libraries start to fail on old lisp implementations because they need newer ASDF.</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; margin-bottom: 0in;">
<span style="color: #333333;"><span style="font-size: 14.85px; line-height: 14.85px;"><span style="font-family: "courier new" , "courier" , monospace;">3d-vectors</span><span style="font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif;"> redefines constant to a value not eql to the previous value. </span></span></span><span style="background-color: transparent; font-size: 14.85px; line-height: 14.85px;"><span style="color: #333333; font-family: "courier new" , "courier" , monospace;">clinch</span><span style="color: #333333; font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif;"> starts to fail on several lisps. </span></span><span style="background-color: transparent; font-size: 14.85px; line-height: 14.85px;"><span style="color: #333333; font-family: "courier new" , "courier" , monospace;">hyperluminal-mem</span><span style="color: #333333; font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif;"> refers undefined variable </span></span><span style="background-color: transparent; font-size: 14.85px; line-height: 14.85px;"><span style="color: #333333; font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif;">MOST-POSITIVE-B+SIZE. </span></span><span style="background-color: transparent; font-size: 14.85px; line-height: 14.85px;"><span style="color: #333333; font-family: "courier new" , "courier" , monospace;">rutils</span><span style="color: #333333; font-family: "arial" , "tahoma" , "helvetica" , "freesans" , sans-serif;"> crashes CCL. And some other failures. There are improvements too of course.</span></span></div>
<div style="background-color: white; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
If you're interested in some particular failure or need help investigating something, just ask in the comments or on the <a href="https://groups.google.com/forum/#!forum/cl-test-grid" style="color: #771100; text-decoration: none;">mailing list</a>.</div>
A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com0tag:blogger.com,1999:blog-1169162979831568924.post-8345224727752007412016-02-22T14:46:00.002-08:002016-02-22T14:49:42.759-08:00quicklisp 2016-02-08<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
The difference between this and previous months:</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
Grouped by lisp implementation first and then by library:</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-02-08-diff.html" style="color: #771100; text-decoration: none;">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-02-08-diff.html</a></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
Grouped by library first and then by lisp impl:</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-02-08-diff2.html" style="color: #771100; text-decoration: none;">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2016-02-08-diff2.html</a></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
(Both reports show the same data, just arranged differently)</div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
<br /></div>
<div style="background-color: white; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; line-height: 14.85px; margin-bottom: 0in;">
The diff contains mostly improvements, but there are several regressions: varjo, gendl, lake, buffalo, binfix, data-table and others.<br />
<br />
If you're interested in some particular failure or need help investigating something, just ask in the comments or on the <a href="https://groups.google.com/forum/#!forum/cl-test-grid">mailing list</a>.</div>
A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com1tag:blogger.com,1999:blog-1169162979831568924.post-61900952757772120782015-12-28T18:54:00.000-08:002015-12-29T16:22:50.356-08:00quicklisp 2015-12-18<div style="line-height: 100%; margin-bottom: 0in;">
Almost every month
cl-test-grid detects various regressions in CL ecosystem.</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
Like this month:</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-12-18-diff2.html">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-12-18-diff2.html</a></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
And in general:
<a href="https://common-lisp.net/project/cl-test-grid/ql/">https://common-lisp.net/project/cl-test-grid/ql/</a></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
I have problem
reporting all these regressions to interested parties. <span style="line-height: 100%;">Studying why
something fails, searching for right person to report, </span><span style="line-height: 100%;">formulating and
submitting bug reports - all that easily takes more than a full
working day.</span></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
Also, sometimes it's
not necessary a bug from the library maintainer point of view, <span style="line-height: 100%;">for example if his
library fails on CLISP because CLISP ships with old ASDF, </span><span style="line-height: 100%;">maybe this
maintainer doesn't care. But maybe those who depends on this library </span><span style="line-height: 100%;">care. So, it's not
always obvious whether the situation requires to disturb people.</span></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
That's why I created
this blog. I mean it as a low volume notification channel - mostly <span style="line-height: 100%;">a notice with
reports once a month when the tests are finished, </span><span style="line-height: 100%;">and a summary of
what I understand about the failures. Then, if people are interested </span><span style="line-height: 100%;">in particular
failures, they can ask and I will help to investigate and explain why </span><span style="line-height: 100%;">exactly something
fails.</span></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
I hope this will
help to effectively fix important failures and keep the community <span style="line-height: 100%;">aware about the
factors causing fluctuations of quality in CL ecosystem.</span></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
Now about this month
regressions.</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
First of all, I
usually build two diff reports.</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
One is grouped by
lisp implementation first and then by library:</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-12-18-diff.html">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-12-18-diff.html</a></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
Another one is
grouped by library first and then by lisp impl:</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-12-18-diff2.html">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-12-18-diff2.html</a></div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
Both reports show
the same data, just arranged differently.</div>
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
The most noticeable
regressions in quicklisp 2015-12-18 comparing to the previous</div>
<div style="line-height: 100%; margin-bottom: 0in;">
release:</div>
<div style="line-height: 100%; margin-bottom: 0in;">
</div>
<ul>
<li><span style="line-height: 100%;">bordeaux-threads
uses UIOP without specifying :depends-on :uiop in the .asd file; </span><span style="line-height: 100%;">in result on lisp implementations where ASDF doesn't include UIOP, bordeaux-threads (and libraries depending on it) </span><span style="line-height: 100%;">fail to load</span></li>
<li><span style="line-height: 100%;">iolib rejects ASDF
< 3.1, so fails to load (and prevents libraries using it from
loading) on lisps with elder ASDF</span></li>
<li><span style="line-height: 100%;">cl+ssl declares
FFI binding for function SSL_CTX_set_default_verify_dir which is
absent </span><span style="line-height: 100%;">in the latest
stable OpenSSL release, and only present in OpenSSL master. </span><span style="line-height: 100%;">c+ssl doesn't use
this function, the ffi declaration was added just to allow others to
invoke it. </span><span style="line-height: 100%;">Still, cl+ssl
fails to load on CMUCL because CMUCL actually checks for foreign
symbol </span><span style="line-height: 100%;">to be present when
FFI declaration is processed. Other lisps we tested are unaffected. </span><span style="line-height: 100%;">This problem is
fixed already in cl+ssl git.</span></li>
<li><span style="line-height: 100%;">As usually, more
and more libraries start to use new ASDF features, for example
keywords :home, :at. </span><span style="line-height: 100%;">These libraries and
their dependencies fail to load on elder ASDF.</span></li>
<li><span style="line-height: 100%;">croatoan library
starts using sb-ext:posix-getenv thus fails on non-sbcl lisps (hint:
use uiop:getenv instead)</span></li>
<li><span style="line-height: 100%;">rutils (and
depending libs) fail on ABCL and ECL with "No such method for
PRINT-OBJECT"</span></li>
<li><span style="line-height: 100%;">several libraries
fail on ECL with "* is not a valid type specifier"</span></li>
<li><span style="line-height: 100%;">com.informatimago.common-lisp.telnet fails on CMUCL with "The
value of the :SLOT-NAME initarg, US, is a constant and so cannot be
bound."</span></li>
</ul>
<span style="line-height: 100%;">... and other
failures.</span><br />
<div style="line-height: 100%; margin-bottom: 0in;">
<br /></div>
<div style="line-height: 100%; margin-bottom: 0in;">
If you're interested in
some specific failure or need help investigating something, just ask <span style="line-height: 100%;">in the comments or
on the <a href="https://groups.google.com/forum/#!forum/cl-test-grid">mailing list</a>.</span></div>
A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com0tag:blogger.com,1999:blog-1169162979831568924.post-83729178060256052792015-08-27T03:11:00.006-07:002015-08-28T21:55:52.760-07:00Regressions and improvements in quicklisp 2015-08-04The difference between quicklisp 2015-07-10 and quicklisp 2015-08-04 is shown in these reports:<br />
<br />
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-08-04-diff.html">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-08-04-diff.html</a><br />
grouped by lisp implementation<br />
<br />
<a href="https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-08-04-diff2.html">https://common-lisp.net/project/cl-test-grid/ql/quicklisp-2015-08-04-diff2.html</a><br />
grouped by library<br />
<br />
(Both reports show the same data, just arranged differently)<br />
<br />
As we see, most of the new failures are caused by drakma failing to load on CCL 1.8, CLISP and SBCL 1.0.58, because drakma.asd now specifies <span style="font-family: Courier New, Courier, monospace;">test-op</span>, but in a way supported only by new ASDF, and not supported by the ASDF shipped with these old lisp implementations. Maybe the drakma-caused failures are not critical for everyone, on the other hand it is trivial to fix.<br />
<br />
There are other regressions as well as some improvements. If you care about some of the results, but don't understand the cause of particular failure, or how to read the report, just ask in the comments or on the <a href="https://groups.google.com/forum/#!forum/cl-test-grid">mailing list</a>, we will be glad to help, investigate and reproduce the problem.<br />
<div>
<br /></div>
BTW, you can click test result links in the reports to open the corresponding log.<br />
<br />
A little bit more about the cl-test-grid project. We regularly collect test results of all the Quicklisp libraries on various lisp implementations, and compute difference between Quicklisp versions to detect changes (regressions or improvements). That way we can monitor the CL ecosystem as a whole.<br />
<div>
<br /></div>
A. V.http://www.blogger.com/profile/12081946569115359377noreply@blogger.com0