[gentoo-soc] Benchmarking suite - Report 4

[gentoo-soc] Benchmarking suite - Report 4

[Andrea Arteaga]

[-- Attachment #1: Type: text/plain, Size: 3228 bytes --]

Dear all
This is my fourth weekly report regarding the benchmarking suite project.

Last week I stated the following objectives:

* Enhancing the test suite for BLAS
* Generate a report with plots using gnuplot or matplotlib -- or both,
depending on the installed tools
* Support more libraries -- at least CBLAS and LAPACK
* Remove commands and use subprocess instead.

The module that tests BLAS is now splitted within a base module, which
contains more general code, and a small BLAS-specific part. The former is
also a base for the CBLAS testing, which is now complete. The base module
for both library has gained reporting possibilities, too. The reports are
generated through matplotlib, which creates clear plots and saves them as
PNG images.

The CBLAS testing suite required some adjustment of the BTL,

The testing acilities have been enhanced: now the user can more deeply
choose the tests that the suite performs; if the user doesn't want to test
level 3 BLAS routines, much valuable time can be saved. For that, some
modification of BTL was done. Some other adjustment of BTL was also needed
in order to support the CBLAS interface. Please refer to the /btl/libs/BLAS
directory on my overlay [1] for the source of the modified BTL.

Now, some consideration about the status of the project has to be done:
* The portage interface will need a lot of work, regarding the porting to
the portage APIs and solving the dependencies -- currently only packages
without not installed dependencies can be tested
* The BLAS and CBLAS libraries can already be tested on everything relevant
* The LAPACK module will be soon available for testing
* Some minor features about the costomization of the tests will be soon
added
* The reporting features are already usable. Much features -- export to
HTML, Latex, PDF,... -- can be added.

The initial project timeline had as important milestone the complete
usability of the testing suite -- excluded the reporting features -- for
BLAS, CBLAS and LAPACK within the mid-term evaluation. In order to keep this
limit, I have to implement the LAPACK module, enhance the portage interface,
add some customization features and perform tests, possibly on different
machines. I am very optimist about this plan.

Now, the objectives I will work for during the next week are:
* Implement the LAPACK module. This will require some other BTL extension,
in order to use this powerful framework. The Eigen community is very helpful
and I hope to accomplish the mission within the middle of the next week. I
will therefore receive news about the state of the project on Wednesday or
Thrusday.
* Add the most useful customization features. This is about, for instance,
letting the user define a script for each test, in order to set up the
environemnt system before the compilation of the library to test.
* Clean the code. Currently the repository contains some old piece of code
(not so old acually...); some classes can be splitted within a base class
and a subclass. Some design pattern can be applied, in order to keep the
project scalable and easily maintenable.

That's all for now.

Cheers
Andrea Arteaga


 [1]
http://git.overlays.gentoo.org/gitweb/?p=proj/auto-numerical-bench.git;a=tree

[-- Attachment #2: Type: text/html, Size: 8514 bytes --]