Gentoo Archives: gentoo-science

From: Andrea Arteaga <andyspiros@×××××.com>
To: gentoo-science@l.g.o
Subject: [gentoo-science] Benchmark suite (SoC project)
Date: Wed, 15 Jun 2011 22:31:13
Message-Id: BANLkTinDXT=PCSdEPubfOKnbai1ZG=ou=Q@mail.gmail.com
1 Hello, scientific Gentoo folks!
2 My name is Andrea Arteaga (andyspiros) and I'm doing a Google Summer
3 of Code project on "Automated benchmark suite for numerical libraries
4 in Gentoo" [1], with Sébastien Fabbro as mentor. As you can read, the
5 project is about constructing a benchmarking suite for common
6 libraries like BLAS, CBLAS, LAPACK,... Which implementation of BLAS is
7 faster on your computer? Does ATLAS work better when compiled with
8 gcc-4.5.2 or with some version of icc? Should you compile gsl with
9 "-O3" or "-O2 -fexpensive-optimizations -fomit-frame-pointer
10 -foptimize-register-move" as flags in order to reach the maximal
11 performance? My script (is supposed to) anserws to similar questions
12 (and many more).
13
14 At this moment, a basic benchmarking suite -- based on BTL -- is ready
15 for BLAS, CBLAS and LAPACK implementations. Did I say "ready"? This is
16 wrong. It still needs to be *tested*. I'm sure it is full of bugs, and
17 I need that somebody finds them. If you are interested on helping me,
18 please read on.
19
20 The script is easy to run, but takes much computational time. The
21 prerequisite for the tests are:
22
23 * you have a Gentoo system with the bicatali overlay installed [2]
24 * no old blas,cblas,lapack libraries are installed, i.e. you make use
25 of the new "alternatives" eselect module
26 * you can spend some minutes of your personal time and some houres of
27 your machine's computational time
28
29 Now, follow the how-to on my blog [3] (the blog post is in english of
30 course, but the blog is in italian and outdated -- I'm sorry for
31 that).
32 Alas, only packages that have installed dependencies can be tested.
33 So, for now, don't expect mkl to work very good (the results could be
34 meaningless). Anyway, packages like *-reference, eigen, gsl, atlas,
35 openblas, gotoblas2 should work well.
36
37 If you run the script and find some error, bugs, problems, please send
38 an email to me with the full report (input file, command line
39 arguments and output). If you run it and don't find any problem,
40 please send me an email, too! If you find that the project is
41 interesting, but you wish some more features, please send me an email
42 too. I don't have any bugzilla or similar system for issues, so I rely
43 on emails.
44
45 Unfortunately, I will be away for some days, so I can't answer to
46 messages until my return; but I would appreciate very much finding the
47 email box full of your emails, so don't hesitate!
48
49 Best regards.
50 Andrea Arteaga
51
52
53 [1] http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/spiros/1
54 [2] http://git.overlays.gentoo.org/gitweb/?p=dev/bicatali.git
55 [3] http://andyspiros.wordpress.com/2011/06/09/gentoo-automated-bechmarks/

Replies

Subject Author
Re: [gentoo-science] Benchmark suite (SoC project) Andrea Arteaga <andyspiros@×××××.com>