AEC-LHEP Hardware information

BERN ATLAS T2 2016 Clusters - ce0.lhep.unibe.ch, ce02.lhep.unibe.ch, dpm.lhep.unibe.ch, bdii.lhep.unibe.ch

• Summary :

           ce01.lhep CLUSTER:
           ce01:      2*2.40GHz Intel Xeon E5645 6-Core with 24GB RAM - ROCKS 6.2 and nordugrid-arc-5.0.3-1.el6.x86_64 (epel)
           mds-2-1:   1*2.40GHz Intel Xeon E5620 4-Core with 24GB RAM for Lustre MDS (lustre-2.5.3)
           oss-2-x:   2*2.10GHz Intel E5-2620 v2 4-Core with 16GB RAM for Lustre OSS (lustre-2.5.3, 6 nodes each with 32*HDD, 31TB sw raid0)
           wn-2-x:
                      2*2.53GHz Intel Xeon E5540  8-core + HT (45 Nodes) 540 cores with 2GB RAM/core (or 720 cores with 1.33GB RAM/core)
                      2*2.53GHz Intel Xeon E5540  8-core + HT ( 4 Nodes)  32 cores with 2GB RAM/core (same HW as above with 1 dead CPU)
                      2*2.67GHz Intel Xeon X5650 12-core + HT ( 6 Nodes) 144 cores with 2GB RAM/core
                      2*2.60GHz Intel Xeon E5-2650 v2 8-core + HT (4 Nodes) 128 cores with 2GB RAM/core
                      2*2.40GHz Intel Xeon E5-2630 v3 8-core + HT (8 Nodes) 256 cores with 2GB RAM/core

           ce02.lhep CLUSTER:
           ce02       2*2.40GHz Intel Xeon E5620 4-core with 24GB RAM - ROCKS 6.2 and nordugrid-arc-5.0.4-1.el6.x86_64 (epel)
           mds-0-1    1*2.40GHz Intel Xeon E5620 4-core with 24GB RAM for Lustre MDS (lustre-2.5.3-2)
           oss-0-x    2*2.30GHz AMD Opteron 2376 4-core with 16GB RAM for Lustre OSS (lustre-2.5.3, 11 nodes each with 1*HD 2TB)
           wn-0-x:
                      2*2.30GHz AMD Opteron 2376 4-core (15 Nodes) 120 cores with 2GB RAM/core 
                      4*2.30GHz AMD Opteron 8356 4-core (20 Nodes) 320 cores with 2GB RAM/core
                      1*2.50GHz Intel Xeon E5420 4-core + HT (47 Nodes) 376 cores with 2GB RAM/core

           dpm.lhep STORAGE ELEMENT:
           dpm        2*2.40GHz Intel Xeon E5620 4-core + HT with 16GB RAM and dpm-1.8.8-4.el5 (epel)
           dpmdisk0x  1*2.67GHz Intel Xeon X5650 6-core with 12GB RAM and dpm-1.8.8-4.el6.x86_64(epel), 6 nodes, 3*raid6 each, 436.52TB net in DPM)
           dpmdisk04  1*2.33GHZ Intel Xeon E5345 4-core with  8GB RAM and dpm-1.8.10-1.el6.x86_64 (epel), 1 node 1*raid6, 21.83TB net in DPM)

           bdii.lhep INFORMATION SYSTEM:
           service running on dpm.lhep: emi-bdii-site-1.0.1-1.el5      

• Hardware :

           ce01.lhep:
           12-core Xeon E5645 @ 2.40GHz FrontEnd- Dalco
            4-core Xeon E5620 @ 2.40GHz Lustre mds - Dalco
           96 SUN Blade X6048 (workers, ~1/2 dead)
            6 IBM x3650 M3 (workers)
           12 Dalco (workers)
            6 Dalco Terraserver (Lustre)

           ce02.lhep:
            8-core Xeon E5620 @ 2.40GHz FrontEnd - Dalco
            4-core Xeon E5620 @ 2.40GHz Lustre mds - Dalco
           26 SUN Fire X2200 (Lustre and workers)
           20 SUN Blade X8840 (workers)
           47 DELL PE 1950 (workers)

           dpm.lhep:
            1 DELL PE 1950 (DPM head node) 
            6 Dalco Terraserver (DPM pool nodes) with 3*12-port Areca 1280/1880 (RAID6) each
            1 Dalco Terraserver (DPM pool node)  with 1*Areca 1880 (RAID6)
           Network:
           Dell PowerConnect 2724 (WAN), NetGear ProSafe GSM7248R and GS748T (LAN) switches.

• Benchmark (not measured):

           Quad-Core AMD Opteron(tm) Processor 2376, 2.3GHz (SUN Fire X2200): 5.676 HEP-SPEC06/core (*)
           Quad-core AMD Opteron 8356, 2.3GHz (SunBlade X8440): 7.4c97 HEP-SPEC/core (**)
           
           (*)  http://hepix.caspur.it/afs/hepix.org/project/ptrack/spec-cpu2000.html (first row in table, average, SL4 x86_64)
           (**) https://wiki.chipp.ch/twiki/bin/view/LCGTier2/BenchMarks

• Available resources (workers):

           19*8  AMD Opteron(tm) 2376:        862.752 HEP-SPEC06
           20*16 Quad-core AMD Opteron 8356:  2399.04 HEP-SPEC06
           ---------------------------------------------------------------------------------------------------------
           Total: 3261.8 HEP-SPEC06

• Network : Gateway 130.92.139.1. DNS 130.92.9.53 (default), 130.92.9.52. Subnet mask 255.255.255.0
• GOCDB Entry: https://gocdb4.esc.rl.ac.uk/portal/index.php?Page_Type=View_Object&object_id=476&grid_id=0
• ROC: NGI_CH - Certification status: Certified.

Host	IP	Service	OS	CPU	Comment
lheplsw1.unibe.ch	130.92.139.201	48-Port Switch		Brocade FCX648	Connected to eth1 on FE (on 10GbE NIC)
ce.lhep.unibe.ch	130.92.139.200	Rocks Front End (FE) 5.3 x86_64	CentOS 5.3 x86_64	2 Quad Xeon E5620 @2.4GHz	Rocks FE, SGE, ARC FE, Web Server, Ganglia
	10.1.225.254	48 Ports Switch
nas-0-2	10.1.255.253	10TB NFS server	CentOS 5.3	1 Quad Xeon E5620 @2.4GHz	ATLAS and VO software (also lhepat02.unibe.ch)
nas-0-1	10.1.255.252	1.1TB Lustre MDS/MDT	CentOS 5.3	1 Quad Xeon E5620 @2.4GHz	MDS/MDT (currently not in production)
compute-0-0/2	10.1.255.xxx	Lustre	CentOS 5.3	2 Dual AMD Opteron 2214	Managed by ce.lhep.unibe.ch
compute-0-3	10.1.255.248	Lustre MDS/MDT	CentOS 5.3	2 Dual AMD Opteron 2214	Managed by ce.lhep.unibe.ch
compute-0-4/5/6/7	10.1.255.xxx	Lustre	CentOS 5.3	2 Quad AMD Opteron 2376	Managed by ce.lhep.unibe.ch
compute-0-8 to 26	10.1.255.xxx	Worker Node 0-8 to 0-26	CentOS 5.3	2 Quad AMD Opteron 2376	Managed by ce.lhep.unibe.ch
compute-1-1 to 19	10.1.255.xxx	Worker Node 1-1 to 1-19	CentOS 5.3	4 Quad AMD Opteron 8356	Managed by ce.lhep.unibe.ch
dpm.lhep.unibe.ch	130.92.139.211	DPM head node	SLC 5.7	2 Quad Xeon E5620 @2.4GHz	DPM Head node and disk pool
dpmdisk01(to 3).lhep.unibe.ch	130.92.139.211 to 213	DPM pool node	SLC 5.7	1 Hexa Xeon X5650 @2.67GHz	DPM 60TB disk pool
dpmdisk04.lhep.unibe.ch	130.92.139.214	DPM pool node	SLC 5.7	1 Quad Xeon E5345 @2.33 GHz	DPM 22TB disk pool
dpmdisk05(to 9).lhep.unibe.ch	130.92.139.215 to 219	DPM pool node	SLC 5.x	??	Reserved for DPM disk pool
kvm01.lhep.unibe.ch	130.92.139.150	KVM host	SLC 5.7	2 Dual AMD Opteron 2218 @2.6GHz	Virtualization host for KVM
...	...	...	...	...	-