From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([69.77.167.62] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1JH2qA-0005sI-Af for garchives@archives.gentoo.org; Mon, 21 Jan 2008 20:01:54 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 1BD9CE07FA; Mon, 21 Jan 2008 20:01:52 +0000 (UTC) Received: from adsum.doit.wisc.edu (adsum.doit.wisc.edu [144.92.197.210]) by pigeon.gentoo.org (Postfix) with ESMTP id D8BFAE07F8 for ; Mon, 21 Jan 2008 20:01:51 +0000 (UTC) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-server@lists.gentoo.org Reply-to: gentoo-server@lists.gentoo.org MIME-version: 1.0 Received: from avs-daemon.smtpauth1.wiscmail.wisc.edu by smtpauth1.wiscmail.wisc.edu (Sun Java(tm) System Messaging Server 6.3-5.02 (built Oct 12 2007; 32bit)) id <0JV000G00FN3G200@smtpauth1.wiscmail.wisc.edu> for gentoo-server@lists.gentoo.org; Mon, 21 Jan 2008 14:01:51 -0600 (CST) Received: from odin.wisc.edu (static-208-212.vpn.wisc.edu [146.151.208.212]) by smtpauth1.wiscmail.wisc.edu (Sun Java(tm) System Messaging Server 6.3-5.02 (built Oct 12 2007; 32bit)) with ESMTPSA id <0JV0002NMFMYP190@smtpauth1.wiscmail.wisc.edu> for gentoo-server@lists.gentoo.org; Mon, 21 Jan 2008 14:01:50 -0600 (CST) Date: Mon, 21 Jan 2008 14:01:45 -0600 From: Brian Kroth Subject: Re: [gentoo-server] Issues with GFS2. In-reply-to: <4794EA14.9090605@iil.ie> To: gentoo-server@lists.gentoo.org Mail-followup-to: gentoo-server@lists.gentoo.org Message-id: <20080121200145.GA20186@odin.wisc.edu> Content-type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary=cNdxnHkX5QqsyA0e Content-disposition: inline X-Spam-Report: AuthenticatedSender=yes, SenderIP=146.151.208.212 X-Spam-PmxInfo: Server=avs-8, Version=5.3.3.310218, Antispam-Engine: 2.5.2.313940, Antispam-Data: 2008.1.21.115042, SenderIP=146.151.208.212 References: <479221DE.1000005@iil.ie> <20080119203929.GA5883@omnius.hslc.wisc.edu> <4794EA14.9090605@iil.ie> User-Agent: Mutt/1.5.16 (2007-06-09) X-Archives-Salt: 16c3c6c0-ea39-469c-9c8c-799205970029 X-Archives-Hash: bf6ba8964b5ef1aa55309794daf13a52 --cNdxnHkX5QqsyA0e Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable I noticed that problem once as well, but it was while issuing the "rm *" co= mmand on the shared space from cssh to 5 machines at once, which seems more understandable that you'd see a problem doing it that way. However, it sho= uld be able to handle that and I haven't been able to reproduce it yet, so I couldn't track down what actually caused it. I can send you my config deta= ils if you'd like to compare. Brian "Todd M. H=E9bert" : > Thanks Brian, there was some great info.. and even greater ebuilds. > > I've gotten things working.. but with some caveats. Locking isn't workin= g=20 > properly. > > I can get filesystems mounted on both servers just fine.. I can copy a fi= le=20 > into the shared space on one server, copy it out on the other, even delet= e=20 > them. (copy from a, delete from b, copy from b, delete from a.) > > BUT... as soon as I copy in several files and issue a rm //* > > everything stops working for that mount. (Other mounts will continue to= =20 > work until a similar command is issued) > > It appears that anything trying to access a LIST of files causes a seriou= s=20 > problem, and everything related to the affected mount just freezes. > > The /var/log/messages file shows that it freezes because it's waiting for= =20 > locks on the files to clear. > > I'm getting no compiling errors. > > Has anyone seen similar problems or even found a way to fix this? > > Thanks in advance for any further help! > > --Todd > > (P.S. please excuse the company information at the bottom.. it's required= =20 > under Irish law.) > > Brian Kroth wrote: >> I have also been dealing with this. There aren't any gfs2 tools in >> portage yet, and as I'm doing a new install I didn't want to go with an >> "old" gfs, especially since the kernel module doesn't work with newer >> kernels anymore. I ended up writing my own ebuilds. Have a look at the= se >> links below for more info. The offsite link in the forum post is more up >> to date (better init scripts). If you're upgrading from gfs please let = me >> know how that goes with the new ebuilds. I think they should work just >> fine, but I haven't tested it yet. >> Thanks, >> Brian >> http://bugs.gentoo.org/show_bug.cgi?id=3D184850 >> http://forums.gentoo.org/viewtopic-p-4732772.html#4732772 >> https://mywebspace.wisc.edu/bpkroth/web/gentoo/fs-cluster-ebuilds/fs-clu= ster_ebuilds.tar.bz2 >> BTW, I long time ago I posted a question regarding OCFS2 vs. GFS2. In my >> research I decided OCFS2 didn't have all the features I wanted (quotas, >> acls, cluster flock, etc.) but I did run some simple benchmarks of how >> they respond with multiple clients. Basically just "iozone -a" on 5=20 >> machines at >> once. Here's another link in case anyone's interested. Sorry for the >> format, but I had a student make them "pretty" and he used MS Excel 2007. >> https://mywebspace.wisc.edu/bpkroth/web/fs-cluster/fs-cluster-iozone-res= ults.xls >> "Todd M. H=E9bert" : >>> Hello all, I'm hoping someone has dealt with this by now. >>> >>> The kernel seems only to support GFS2, but the user-space tools seem to= =20 >>> only support GFS (GFS1?)=20 >>> So.. I am able to format GFS filesystems in userspace, but I cannot mou= nt=20 >>> them because the kernel doesn't understand them. (and the separate GFS= =20 >>> kernel module will not compile,.. maybe because the one in the kernel= =20 >>> source that handles GFS2 uses some of the same necessary bits?) >>> >>> I need to find a way to get either GFS or GFS2 working properly. (I'd= =20 >>> think GFS2 would be preferable.) >>> >>> I'm using the 2007.0 profile, and I already have the cluster elements= =20 >>> configured, and only need to format & mount the filesystems at this=20 >>> point. >>> >>> Can anyone point me to a resource that will help me get this last bit= =20 >>> sorted? >>> >>> Thanks, >>> >>> --Todd >>> >>> (P.S. Pardon anything below this line.. it is required under Irish law.= =20 >>> --TMH) >>> >>> ********************************************************************** >>> "Private Confidential & Privileged" >>> This Email and any files and attachments transmitted with it are >>> confidential and/or privileged. They are intended solely for >>> the use of the intended recipient. Any views and opinions expressed >>> are those of the individual author/sender and are not necessarily >>> shared or endorsed by Independent Newspapers (Ireland) Limited or any >>> associated or related company. The content of this Email and any file >>> or attachment transmitted with it may have been changed or altered >>> without the consent of the author. If you are not the intended >>> recipient, please note that any review, dissemination, disclosure, >>> alteration, printing, circulation or transmission of this Email and/or >>> any file or attachment transmitted with it, is prohibited and may be >>> unlawful. If you have received this Email or any file attachment >>> transmitted with it in error, please notify support@iil.ie or contact >>> Systems Administrator Tel: +353 (1) 411 2244 >>> Internet Interaction Limited >>> 3050 Lake Drive, Citywest digital Park, Co Dublin >>> CRO # 247783 >>> >>> >>> --=20 >>> gentoo-server@lists.gentoo.org mailing list >>> > > > > ********************************************************************** > "Private Confidential & Privileged" > This Email and any files and attachments transmitted with it are > confidential and/or privileged. They are intended solely for > the use of the intended recipient. Any views and opinions expressed > are those of the individual author/sender and are not necessarily > shared or endorsed by Independent Newspapers (Ireland) Limited or any > associated or related company. The content of this Email and any file > or attachment transmitted with it may have been changed or altered > without the consent of the author. If you are not the intended > recipient, please note that any review, dissemination, disclosure, > alteration, printing, circulation or transmission of this Email and/or > any file or attachment transmitted with it, is prohibited and may be > unlawful. If you have received this Email or any file attachment > transmitted with it in error, please notify support@iil.ie or contact > Systems Administrator Tel: +353 (1) 411 2244 > Internet Interaction Limited > 3050 Lake Drive, Citywest digital Park, Co Dublin > CRO # 247783 > > > --=20 > gentoo-server@lists.gentoo.org mailing list > --cNdxnHkX5QqsyA0e Content-Type: application/x-pkcs7-signature Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIIIjAYJKoZIhvcNAQcCoIIIfTCCCHkCAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCC BmkwggNtMIIC1qADAgECAgIDizANBgkqhkiG9w0BAQUFADCBiTELMAkGA1UEBhMCVVMxKzAp BgNVBAoTIkRpdmlzaW9uIG9mIEluZm9ybWF0aW9uIFRlY2hub2xvZ3kxIzAhBgNVBAsTGkZh Y3VsdHkgLSBTdGFmZiAtIFN0dWRlbnRzMSgwJgYDVQQDEx9Vbml2ZXJzaXR5IG9mIFdpc2Nv bnNpbi1NYWRpc29uMB4XDTA3MDYwNjE4MDI0MFoXDTA4MDYwNTE4MDI0MFowgfsxCzAJBgNV BAYTAlVTMRIwEAYDVQQIEwlXaXNjb25zaW4xEDAOBgNVBAcTB01hZGlzb24xKDAmBgNVBAoT H1VuaXZlcnNpdHkgb2YgV2lzY29uc2luLU1hZGlzb24xIzAhBgNVBAsTGkZhY3VsdHkgLSBT dGFmZiAtIFN0dWRlbnRzMRMwEQYDVQQLEwpUb2tlbiAtIG5vMRIwEAYDVQQuEwlVVzE1MFE3 MDcxFzAVBgoJkiaJk/IsZAEBEwdicGtyb3RoMRQwEgYDVQQDEwtCcmlhbiBLcm90aDEfMB0G CSqGSIb3DQEJARYQYnBrcm90aEB3aXNjLmVkdTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkC gYEAq4DtEuA/qy52kFDN9016QqYtxUAZ3NY60FwsB3zbRg/Gn4hr/XLALelcbzIPEwjw865u Y+KPgzEKYOEFTELiN4fKLoWVwx4IVuzU2b/ZVFkRUxVhZUqPgRE4ZhWA9Xx4vFDny/i6OoXN esZPYC1QuK2ppyVxGwhV4L+ZGIStbfkCAwEAAaNwMG4wDgYDVR0PAQH/BAQDAgXgMDsGA1Ud HwQ0MDIwMKAuoCyGKmh0dHA6Ly9jcmwuZ2VvdHJ1c3QuY29tL2NybHMvd2lzY29uc2luLmNy bDAfBgNVHSMEGDAWgBQcnlJSGwRiRyxrLAG4afGpNywjJDANBgkqhkiG9w0BAQUFAAOBgQB9 JDpPA+Wq7IratJDr4PL9Zf6V9WmnZ5ayNnZk1jwGkMH7QKTMa8IzlE16J1B77RLgkP4rWWB+ lBAa1sYkc4sd5n6igvkZDDvHse8Y5KXC4memMP7ntOIAOfBgUtMp6dwu31QN4IMgKwXBkgh1 TKaGe4aM37+seIi5C3CI+PQQljCCAvQwggJdoAMCAQICAkRNMA0GCSqGSIb3DQEBBQUAMFMx CzAJBgNVBAYTAlVTMRwwGgYDVQQKExNFcXVpZmF4IFNlY3VyZSBJbmMuMSYwJAYDVQQDEx1F cXVpZmF4IFNlY3VyZSBlQnVzaW5lc3MgQ0EtMTAeFw0wNTA4MjkxNjA3MjBaFw0xNTA4Mjkx NjA3MjBaMIGJMQswCQYDVQQGEwJVUzErMCkGA1UEChMiRGl2aXNpb24gb2YgSW5mb3JtYXRp b24gVGVjaG5vbG9neTEjMCEGA1UECxMaRmFjdWx0eSAtIFN0YWZmIC0gU3R1ZGVudHMxKDAm BgNVBAMTH1VuaXZlcnNpdHkgb2YgV2lzY29uc2luLU1hZGlzb24wgZ8wDQYJKoZIhvcNAQEB BQADgY0AMIGJAoGBAOhIUdwld8sfAAlrdOv5Tt8PTX1Wku/ItsIjHrkus1MbKoulSXxSsSUP APYzgT8HfhuRY+tHHzohFSu3xJWgx0wk8q2pqwo4KZ2evy7GMDFxTHyXSYa/1m0Wsg5c11u8 J6/tR8yqu7RWIJPr+edlPjx8r/cYP7AK5nA7msMFFZqDAgMBAAGjgZ8wgZwwDgYDVR0PAQH/ BAQDAgGGMB0GA1UdDgQWBBQcnlJSGwRiRyxrLAG4afGpNywjJDAfBgNVHSMEGDAWgBRKeDJS EdtZFjZe38EUNkBqR3xMoTAPBgNVHRMBAf8EBTADAQH/MDkGA1UdHwQyMDAwLqAsoCqGKGh0 dHA6Ly9jcmwuZ2VvdHJ1c3QuY29tL2NybHMvZWJpemNhMS5jcmwwDQYJKoZIhvcNAQEFBQAD gYEAJfFEWDN3f+cS1o3XqrcgmDdr5h3e37WxerB/YxVfHpsr5UzTGVBwR09zyRA+AtmBrNBE 07HcLSsri/x9o1qJPwtko8GB+ScW9lTvoSoWKf93fkeymKj4T7X2rFV+umJTSmgs850RTh+o Rx0eVGHfc1zHRNjpUiPqZRoaYqjFZ5AxggHrMIIB5wIBATCBkDCBiTELMAkGA1UEBhMCVVMx KzApBgNVBAoTIkRpdmlzaW9uIG9mIEluZm9ybWF0aW9uIFRlY2hub2xvZ3kxIzAhBgNVBAsT GkZhY3VsdHkgLSBTdGFmZiAtIFN0dWRlbnRzMSgwJgYDVQQDEx9Vbml2ZXJzaXR5IG9mIFdp c2NvbnNpbi1NYWRpc29uAgIDizAJBgUrDgMCGgUAoIGxMBgGCSqGSIb3DQEJAzELBgkqhkiG 9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA4MDEyMTIwMDE0NVowIwYJKoZIhvcNAQkEMRYEFOUQ qvYWY50MKjHYRkkn73XVaqXBMFIGCSqGSIb3DQEJDzFFMEMwCgYIKoZIhvcNAwcwDgYIKoZI hvcNAwICAgCAMA0GCCqGSIb3DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMA0GCSqG SIb3DQEBAQUABIGAKc8RfibMQll4mdapOjZ7x5gFnU+lx5nNfcx1dZWs2xo5xgqD1+hpuvKq B6wJefaGmdd6nJ5Wxh6wPVLDM70dnjmAoYggaowfjoD0a8WImWp5N+UwZSSkRcssLFEDTrMD P68cJkrvdWRQ/DVy+NFxWjdKfwlcG/4XCCgyRct3BQU= --cNdxnHkX5QqsyA0e-- -- gentoo-server@lists.gentoo.org mailing list