From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([69.77.167.62] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1KTHid-0006Cc-Cw for garchives@archives.gentoo.org; Wed, 13 Aug 2008 14:52:59 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 83294E0351; Wed, 13 Aug 2008 14:52:58 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) by pigeon.gentoo.org (Postfix) with ESMTP id 11121E0351 for ; Wed, 13 Aug 2008 14:52:58 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp.gentoo.org (Postfix) with ESMTP id 5FC6565AA2 for ; Wed, 13 Aug 2008 14:52:57 +0000 (UTC) X-Virus-Scanned: amavisd-new at gentoo.org X-Spam-Score: -2.77 X-Spam-Level: X-Spam-Status: No, score=-2.77 required=5.5 tests=[AWL=-0.171, BAYES_00=-2.599] Received: from smtp.gentoo.org ([127.0.0.1]) by localhost (smtp.gentoo.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id u4gDRdV4dgA2 for ; Wed, 13 Aug 2008 14:52:50 +0000 (UTC) Received: from QMTA03.emeryville.ca.mail.comcast.net (qmta03.emeryville.ca.mail.comcast.net [76.96.30.32]) by smtp.gentoo.org (Postfix) with ESMTP id 94131661B9 for ; Wed, 13 Aug 2008 14:52:49 +0000 (UTC) Received: from OMTA01.emeryville.ca.mail.comcast.net ([76.96.30.11]) by QMTA03.emeryville.ca.mail.comcast.net with comcast id 1mhK1a0060EPchoA3qspSw; Wed, 13 Aug 2008 14:52:49 +0000 Received: from [192.168.1.100] ([71.59.219.205]) by OMTA01.emeryville.ca.mail.comcast.net with comcast id 1qso1a0044SVLDz8MqsoYg; Wed, 13 Aug 2008 14:52:49 +0000 X-Authority-Analysis: v=1.0 c=1 a=cZ8S8noQ92UA:10 a=y5FJAdBlpcYA:10 a=9A5hyz7JCYkA:10 a=Yh2uFS8-ag0Dm6-2-ksA:9 a=AgrOExhX0JHrJtHhX-E6hYJYaYYA:4 a=NWVoK91CQyQA:10 a=r7k-tzno6SoA:10 a=t0WRet2RL3kA:10 a=plE8mkVoi54A:10 a=FP58Ms26AAAA:8 a=DTL6b_JkAAAA:8 a=yeUJ4GXmAAAA:8 a=cbj-E6AMYwnSUk8Hdw4A:9 a=QHEiWrA4Qkytw_Y2Jp8A:7 a=6uGZTocpjaZ10FnsgiqQXxdtZkoA:4 a=6J2lsKWnzqIA:10 a=cbFiQ6H_hCAA:10 a=SM-vvayXGNUA:10 a=goEG6-0OhKsA:10 a=vek6fgvLsRAA:10 a=J95KylgKLPAA:10 a=D49WOXAEg9QA:10 a=zpjocMeDVJkA:10 a=uwX4_vx0mnkA:10 a=eZLSmJVMEtUA:10 Subject: [gentoo-science] [Fwd: [atlas-devel] 3.9.3 & testing] From: "M. Edward (Ed) Borasky" To: gentoo-science@lists.gentoo.org Content-Type: multipart/mixed; boundary="=-aS3dipmFERx3bYqDRv2q" Organization: Disorganized :) Date: Wed, 13 Aug 2008 07:52:50 -0700 Message-Id: <1218639170.1796.2.camel@DreamScape> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-science@lists.gentoo.org Reply-to: gentoo-science@lists.gentoo.org Mime-Version: 1.0 X-Mailer: Evolution 2.22.2 X-Archives-Salt: 01ced3dd-8124-4aa4-9f56-b05ec4b224f4 X-Archives-Hash: 7e39a32ec92f9014bf20a6ab7462a8c5 --=-aS3dipmFERx3bYqDRv2q Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable --=20 M. Edward (Ed) Borasky ruby-perspectives.blogspot.com "A mathematician is a machine for turning coffee into theorems." -- Alfr=C3=A9d R=C3=A9nyi via Paul Erd=C5=91s --=-aS3dipmFERx3bYqDRv2q Content-Disposition: inline Content-Description: Forwarded message - [atlas-devel] 3.9.3 & testing Content-Type: message/rfc822 Return-Path: Delivered-To: cesmail-net-znmeb@cesmail.net Received: (qmail 31698 invoked from network); 13 Aug 2008 13:38:23 -0000 X-Spam-Checker-Version: SpamAssassin 3.2.4 (2008-01-01) on filter8 X-Spam-Level: X-Spam-Status: hits=0.0 tests=none version=3.2.4 Received: from unknown (192.168.1.107) by filter8.cesmail.net with QMQP; 13 Aug 2008 13:38:23 -0000 Received: from lists-outbound.sourceforge.net (66.35.250.225) by mx70.cesmail.net with SMTP; 13 Aug 2008 13:38:22 -0000 Received: from sc8-sf-list1-new.sourceforge.net (sc8-sf-list1-new-b.sourceforge.net [10.3.1.93]) by sc8-sf-spam2.sourceforge.net (Postfix) with ESMTP id 459DB128AA; Wed, 13 Aug 2008 06:38:22 -0700 (PDT) Received: from sc8-sf-mx2-b.sourceforge.net ([10.3.1.92] helo=mail.sourceforge.net) by sc8-sf-list1-new.sourceforge.net with esmtp (Exim 4.43) id 1KTGYO-0003G8-Eo for math-atlas-devel@lists.sourceforge.net; Wed, 13 Aug 2008 06:38:20 -0700 Received: from pandora2.cs.utsa.edu ([129.115.29.24]) by mail.sourceforge.net with esmtp (Exim 4.44) id 1KTGYM-0004M7-Tk for math-atlas-devel@lists.sourceforge.net; Wed, 13 Aug 2008 06:38:20 -0700 Received: from pandora2.cs.utsa.edu (localhost [127.0.0.1]) by pandora2.cs.utsa.edu (8.13.8+Sun/8.13.8) with ESMTP id m7DDcDXo004655; Wed, 13 Aug 2008 08:38:13 -0500 (CDT) Received: (from whaley@localhost) by pandora2.cs.utsa.edu (8.13.8+Sun/8.13.8/Submit) id m7DDcDTR004654; Wed, 13 Aug 2008 08:38:13 -0500 (CDT) From: Clint Whaley Message-Id: <200808131338.m7DDcDTR004654@pandora2.cs.utsa.edu> Date: Wed, 13 Aug 2008 08:38:13 -0500 To: math-atlas-devel@lists.sourceforge.net User-Agent: Heirloom mailx 12.0 3/4/06 MIME-Version: 1.0 Cc: whaley@cs.utsa.edu Subject: [atlas-devel] 3.9.3 & testing X-BeenThere: math-atlas-devel@lists.sourceforge.net X-Mailman-Version: 2.1.8 Precedence: list Reply-To: "List for developer discussion, NOT SUPPORT." List-Id: "List for developer discussion, NOT SUPPORT." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Sender: math-atlas-devel-bounces@lists.sourceforge.net Errors-To: math-atlas-devel-bounces@lists.sourceforge.net X-SpamCop-Checked: 66.35.250.225 129.115.29.24 Content-Transfer-Encoding: 7bit Guys, I have released 3.9.3. The main new thing is that I have incorporated both Antoine's full testing scripts and the lapack testers into the package, so that they can be invoked as trivially as the sanity tests are now. I include a new section from INSTALL.txt explaining the new make targets below. I believe this will make getting a new stable release out much easier. I was planning to backport the new Core2 & K10h kernels to 3.8, but then I had this idea. What I am hoping to do now instead is to see if I can improve the ATLAS install on Windows and OS X, and then do a new stable release. Having these testers should also be helpful for people wanting to use developer releases for production code . . . Here is the ChangeLog: ATLAS 3.9.3 released 08/13/08, Changes from 3.9.2: * Added much more extensive testing capability: - make full_test / make scope_full_test + Added Antoine's testing scripts to ATLAS. Just do a "make full_test" to run them ("make full_test_nh" to use nohup for remove connection). - make lapack_test[a,s,f]l_[ab,sb,fb,pt] / make scope_lapack_test_?l_?? + Runs lapack testers linked against indicated lapack & BLAS - See INSTALL.txt/"EXTENDED ATLAS TESTING" for further details * Added several missing symbols from full LAPACK build * Fixed it so ?lamch are compiled wt no optimization. * Added ATLAS/src/blas/f77reference for ease of testing. Made it so by default Make.inc's FBLASlib and BLASlib macros are set to this lib. * Fixed errors in arch default creation for LAPACK defaults * Changed test in LAPACK build Makefile to get around solaris shell incompatibility * Added architectural defaults for LAPACK QR tuning for: - AMD64K10h32SSE3 (first time 32-bit archdefs are given for this arch) - AMD64K10h64SSE3 - PPCG564AltiVec - Core232SSE3 - HAMMER64SSE3 Cheers, Clint ***************************** EXTENDED ATLAS TESTING ************************** ATLAS has two extended testers beyond the sanity checks that can be automatically invoked from the BLDdir. These tests are longer running and more complex to interpret than the sanity tests, and so not every user will want to run them. They are particularly recommended for installers who wish to use a developer release for production code. --------------------------------- full_test ----------------------------------- The first is a set of testing scripts written by Antoine Petitet, that randomly generate testcases for a host of ATLAS's testers. This testing phase may take as long as two days to complete (and almost always takes at least 4 hours). To perform this long-running test, simply issue: make full_test If you are logged into the host machine remotely, chances are good your connection will go down before the install completes. Therefore, there is a second command that runs these scripts in the background with a no hangup command (so the tests will continue even if your network connection dies): make full_test_nh At the completion of the tests, the extensive output files will be searched for errors (much as with the sanity tests), and the output sent to the screen. If you have lost this screen of data, you can regenerate it with the command: make scope_full_test Running these tests will create a directory BLDdir/bin/AtlasTest where the tester resides, and your output files will be stored a $(ARCH) subdir. If you want to rerun the testers from scratch (rather than just searching old output), you can simply delete the entire BLDdir/bin/AtlasTest directory tree, and do "make full_test" again. ----------------------------- lapack_test ------------------------------------- If you have installed the full LAPACK library, then you can run the standard lapack testers as well. The command you give is: make lapack_test_[a,s,f]l_[ab,sb,fb,pt] The first choice (choose one of three) controls which LAPACK library macro is used in the link for testing: _l LINK FOR LAPACK Make.inc MACRO == =================== ============== a ATLAS's LAPACK $(LAPACKlib) s system LAPACK $(SLAPACKlib) f F77 reference LAPACK $(FLAPACKlib) The second choice (choose one of three) controls which BLAS macros are used in the link for testing: _b/pt LINK FOR BLAS Make.inc MACRO ==== ===================== ========================================= ab ATLAS BLAS $(F77BLASlib) $(CBLASlib) $(ATLASlib) sb system BLAS $(BLASlib) fb F77 reference BLAS $(FBLASlib) pt ATLAS' threaded BLAS $(PTF77BLASlib) $(PTCBLASlib) $(ATLASlib) Not all of these combinations will work without user modification of Make.inc. You will need to fill in values for $(BLASlib) $(SLAPACKlib) $(FLAPACKlib) if you want to run the lapack tester against these libraries. Usually, you will want to test your newly install ATLAS LAPACK & BLAS: make lapack_test_al_ab As before, once the testing is complete, you will get the output of a search for errors though all output files, and you can search them again with: make scope_lapack_test_al_ab Unfortunately, the lapack testers always show errors on almost all platforms. So, how do you know if you have a real error? Real errors will usually have residuals in the 10^6 range, rather than O(1) (smaller residuals mean less error). If you are unsure, the best way is to contrast ATLAS with an all-F77 install: make lapack_test_fl_fb (To run this test, you will have to build a stock netlib LAPACK library, and fill out Make.inc's FLAPACKlib macro appropriately.) You can then see how the errors reported by ATLAS stack up against the all-F77 version: if they are roughly the same, then you are usually OK. All the lapack testers create a directory BLDdir/bin/LAPACK_TEST. For each test you run there will be a subdirectory LAOUT_[A,S,F]L_[AB,SB,FB,PT] where all your output files will be located. Additionally, the results of the scope (search for error) will be stored in BLDdir/bin/LAPACK_TEST/SUMMARY__ Therefore, a typical round of testing might be: make lapack_test_al_ab make lapack_test_fl_fb # compare SUMMARY_al_ab with SUMMARY_fl_fb to check for error make lapack_test_al_pt # compare SUMMARY_al_pt with SUMMARY_fl_fb to check for error in parallel lib If you had an error, you might want to be sure the error was in ATLAS's BLAS and not lapack, so you could do "make lapack_test_fl_ab", and see if the error went away. If you filled in the GotoBLAS for the SLAPACKlib & BLASlib macros, you could scope the error properties of Goto's BLAS and LAPACK. Many system/vendor LAPACK/BLAS do not provide all of the routines required to run the LAPACK testers, and some ATLAS testers call ATLAS internal routines. Therefore, the safest thing if you have missing symbol errors when building system/vendor tests, is to use ATLAS to pick up any missing symbols. For instance, here is an example Make.inc output that makes all of ATLAS testers work with the GotoBLAS on my Athlon-64 workstation: BLASlib = /opt/lib/libgoto_opteronp-r1.26.a \ $(F77BLASlib) $(CBLASlib) $(ATLASlib) SLAPACKlib = /opt/lib/libgoto_opteronp-r1.26.a $(FLAPACKlib) ************************************************************************** ** R. Clint Whaley, PhD ** Assist Prof, UTSA ** www.cs.utsa.edu/~whaley ** ************************************************************************** ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Math-atlas-devel mailing list Math-atlas-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/math-atlas-devel --=-aS3dipmFERx3bYqDRv2q--