opteron based clusters: any technical feedbacks?
Hi All, Google shows some positive info about clusters on AMD64. However this maillist contains no feedbacks about clusters successfully running at AMD64 SUSE. Is here anybody alive who has managed to setup such a cluster based on SUSE-AMD64? Are there any technical notes/comments to read? kind regards, Valery A.Khamenya --------------------------------------------------------------------------- Bioinformatics Department BioVisioN AG, Hannover
Hi! We are running a Dual-Opteron based Linux-Cluster with 20 nodes and SuSE90 AMD64. The cluster nodes are set up as diskless clients. The cluster is a batch-job cluster with Sun's gridengine. We are running C programs both in 32bit and in 64bit as well as Matlab jobs on it. Everything works fine. Details: 20xDual Opteron 242 1.6GHz, 6x1GB memory, MSI K8D Master F Mainboard, 80GB local HDD on each node The gateway uses an Infortrend EonStor external SCSI-Raid (~3TB in 3x1TB) and an Adaptec 39320D 2-channel SCSI Controller. Gigabit ethernet is used with an HP4108GL Switch. Problems only occured with the nameserver (which needed to be recompiled) and the kernel distributed on DVD which became unstable after about 3 hours of raid disc access (fdisk's harddisc check). But that's not the case with the currently available SuSE AMD64 kernel. The kernel was a problem quite a long time (at least until christmas) because the 2.6 test kernels had problems with the masquerading support which eventually cut off NFS connection and the 2.4 kernel had difficulties with the RAID as described above. The gridengine also did not work with every kernel which is a really strange problem because it does not depend on kernel modules but just uses the network interface. Best regards, Marcus Barkowsky -- Marcus Barkowsky Telecommunications Laboratory Multimedia Communications and Signal Processing University of Erlangen-Nuremberg On Monday 01 March 2004 09:13, Khamenia, Valery wrote:
Hi All,
Google shows some positive info about clusters on AMD64. However this maillist contains no feedbacks about clusters successfully running at AMD64 SUSE.
Is here anybody alive who has managed to setup such a cluster based on SUSE-AMD64?
Are there any technical notes/comments to read?
kind regards, Valery A.Khamenya --------------------------------------------------------------------------- Bioinformatics Department BioVisioN AG, Hannover
Hi, I am trying to get java to work on my x86_64 box running SLES8. By default SLES8 comes with IBMJava2-SDK-1.3.1-5 wich throws a segmentation fault when you try to run java or javac. I updated to IBMJava2-JRE_1_4-1.4.1-0 an Now I do not get a Segmentation fault but java or javac just hangs at the shell prompt. Does any one know of any bugs or problems with this? any ideas? Thanks Rene
HI, Thanks for the info. I just went to the SUSE portal page and looked around for updates on the kernel and found that there is a new kernel k_smp-2.4.21-199.x86_64.rpm kernel-source-2.4.21-199.x86_64.rpm I was running k_smp-2.4.21-178.x86_64.rpm which was not working correctly. So after upgrading to 2.4.21-199 Java and everything else works fine. Thanks again for the help Rene On Wed, 3 Mar 2004 firenza@gmx.net wrote:
Does any one know of any bugs or problems with this? any ideas?
I had the same problem, which went away once I reverted the kernel back from 2.4.21 (comes with SP3?) to 2.4.19.
cheers, Firenza
-- Check the List-Unsubscribe header to unsubscribe For additional commands, email: suse-amd64-help@suse.com
Hello, I just tried compiling globus 3.0.2 on my opteron box running SLES8 and it fails. Has anyone managed to get globus to worked on the x86_64 platform? Thank you Rene -- Rene Salmon Tulane University Center for Computational Science Richardson Building 310 New Orleans, LA 70118 http://www.ccs.tulane.edu Tel 504-862-8393 Fax 504-862-8392
Hi Valery, At Gridcore we have quite a few Opteron based clusters up and in production, the first went up in June last year. All our Opteron based clusters run Suse 9.0 and Sun Gridengine(wich just got a release of a AMD64 version, we have before this been running the standard i386 version). Our customers are running programs such as Fluent, MSC.Marc, Ansys, Abaqus, LS-Dyna, Hmmer, Blast and more. Almost all of these are in 32-bit mode. When customers has the sourcecode, we of course recompile and optimise for running on AMD64. All clusters have been very stable and with excellent performance and our experince is that Suse is the most mature distrubtion for running Linux on AMD64. Our only real problem has actually been the comercial compiler support, but this getting better and better each day and is today almost a nonissue.(This is mostly due to the need of good Fortran compilers and support for OpenMP.) Best regards Daniel & Peter www.gridcore.se
Is here anybody alive who has managed to setup such a cluster based on SUSE-AMD64?
Are there any technical notes/comments to read?
On Monday 01 March 2004 8:13 am, Khamenia, Valery wrote:
Hi All,
Google shows some positive info about clusters on AMD64. However this maillist contains no feedbacks about clusters successfully running at AMD64 SUSE.
Is here anybody alive who has managed to setup such a cluster based on SUSE-AMD64?
We have 2 Opteron clusters in house that we use for R+D. (SLES8). One of which is open to anyone who wants to do benchmarking (http://quad.bris.ac.uk) There are no real issues with Opteron clusters - just install a standard SuSE distro, enable rsh et al and install something like MPICH. Indeed there is even an NPACI ROCKS distribution for AMD64. We also have several customers are starting to deploy quite large Opteron clusters with our QsNet II Interconnect. One of the nice things about Opteron over say Xeon or IA64 is that the memory subsytem allows the MPI latancy to be particualrly low (we measure 1.87 microseconds between a pair of nodes.) Yours, Daniel. -------------------------------------------------------------- Dr. Dan Kidger, Quadrics Ltd. daniel.kidger@quadrics.com One Bridewell St., Bristol, BS1 2AA, UK 0117 915 5505 ----------------------- www.quadrics.com --------------------
participants (6)
-
Dan Kidger -
Daniel Persson -
firenza＠gmx.net -
Khamenia, Valery -
Marcus Barkowsky -
Rene Salmon