AEC-LHEP Hardware information

From LHEP Wiki
Revision as of 13:18, 20 May 2016 by Lhep (talk | contribs)
Jump to navigation Jump to search

BERN ATLAS T2 2016 Clusters - ce0.lhep.unibe.ch, ce02.lhep.unibe.ch, dpm.lhep.unibe.ch, bdii.lhep.unibe.ch

  • Summary :
           ce01.lhep CLUSTER:
           ce01:      2*2.40GHz Intel Xeon E5645 6-Core with 24GB RAM - ROCKS 6.2 and nordugrid-arc-5.0.3-1.el6.x86_64 (epel)
           mds-2-1:   1*2.40GHz Intel Xeon E5620 4-Core with 24GB RAM for Lustre MDS (lustre-2.5.3)
           oss-2-x:   2*2.10GHz Intel E5-2620 v2 4-Core with 16GB RAM for Lustre OSS (lustre-2.5.3, 6 nodes each with 32*HDD, 31TB sw raid0)
           wn-2-x:
                      2*2.53GHz Intel Xeon E5540  8-core + HT (45 Nodes) 540 cores with 2GB RAM/core (or 720 cores with 1.33GB RAM/core)
                      2*2.53GHz Intel Xeon E5540  8-core + HT ( 4 Nodes)  32 cores with 2GB RAM/core (same HW as above with 1 dead CPU)
                      2*2.67GHz Intel Xeon X5650 12-core + HT ( 6 Nodes) 144 cores with 2GB RAM/core
                      2*2.60GHz Intel Xeon E5-2650 v2 8-core + HT (4 Nodes) 128 cores with 2GB RAM/core
                      2*2.40GHz Intel Xeon E5-2630 v3 8-core + HT (8 Nodes) 256 cores with 2GB RAM/core
           ce02.lhep CLUSTER:
           ce02       2*2.40GHz Intel Xeon E5620 4-core with 24GB RAM - ROCKS 6.2 and nordugrid-arc-5.0.4-1.el6.x86_64 (epel)
           mds-0-1    1*2.40GHz Intel Xeon E5620 4-core with 24GB RAM for Lustre MDS (lustre-2.5.3-2)
           oss-0-x    2*2.30GHz AMD Opteron 2376 4-core with 16GB RAM for Lustre OSS (lustre-2.5.3, 11 nodes each with 1*HD 2TB)
           wn-0-x:
                      2*2.30GHz AMD Opteron 2376 4-core (15 Nodes) 120 cores with 2GB RAM/core 
                      4*2.30GHz AMD Opteron 8356 4-core (20 Nodes) 320 cores with 2GB RAM/core
                      1*2.50GHz Intel Xeon E5420 4-core + HT (47 Nodes) 376 cores with 2GB RAM/core
           dpm.lhep STORAGE ELEMENT:
           dpm        2*2.40GHz Intel Xeon E5620 4-core + HT with 16GB RAM and dpm-1.8.8-4.el5 (epel)
           dpmdisk0x  1*2.67GHz Intel Xeon X5650 6-core with 12GB RAM and dpm-1.8.8-4.el6.x86_64(epel), 6 nodes, 3*raid6 each, 436.52TB net in DPM)
           dpmdisk04  1*2.33GHZ Intel Xeon E5345 4-core with  8GB RAM and dpm-1.8.10-1.el6.x86_64 (epel), 1 node 1*raid6, 21.83TB net in DPM)
           bdii.lhep INFORMATION SYSTEM:
           service running on dpm.lhep: emi-bdii-site-1.0.1-1.el5      
  • Hardware :
           ce01.lhep:
           12-core Xeon E5645 @ 2.40GHz FrontEnd- Dalco
            4-core Xeon E5620 @ 2.40GHz Lustre mds - Dalco
           96 SUN Blade X6048 (workers, ~1/2 dead)
            6 IBM x3650 M3 (workers)
           12 Dalco (workers)
            6 Dalco Terraserver (Lustre)
           ce02.lhep:
            8-core Xeon E5620 @ 2.40GHz FrontEnd - Dalco
            4-core Xeon E5620 @ 2.40GHz Lustre mds - Dalco
           26 SUN Fire X2200 (Lustre and workers)
           20 SUN Blade X8840 (workers)
           47 DELL PE 1950 (workers)
           dpm.lhep:
            1 DELL PE 1950 (DPM head node) 
            6 Dalco Terraserver (DPM pool nodes) with 3*12-port Areca 1280/1880 (RAID6) each
            1 Dalco Terraserver (DPM pool node)  with 1*Areca 1880 (RAID6)
           Network:
           Dell PowerConnect 2724 (WAN), NetGear ProSafe GSM7248R and GS748T (LAN) switches.
  • Benchmark (not measured):
           Quad-Core AMD Opteron(tm) Processor 2376, 2.3GHz (SUN Fire X2200): 5.676 HEP-SPEC06/core (*)
           Quad-core AMD Opteron 8356, 2.3GHz (SunBlade X8440): 7.4c97 HEP-SPEC/core (**)
           
           (*)  http://hepix.caspur.it/afs/hepix.org/project/ptrack/spec-cpu2000.html (first row in table, average, SL4 x86_64)
           (**) https://wiki.chipp.ch/twiki/bin/view/LCGTier2/BenchMarks
  • Available resources (workers):
           19*8  AMD Opteron(tm) 2376:        862.752 HEP-SPEC06
           20*16 Quad-core AMD Opteron 8356:  2399.04 HEP-SPEC06
           ---------------------------------------------------------------------------------------------------------
           Total: 3261.8 HEP-SPEC06


Host IP Service OS CPU Comment
lheplsw1.unibe.ch 130.92.139.201 48-Port Switch Brocade FCX648 Connected to eth1 on FE (on 10GbE NIC)
ce.lhep.unibe.ch 130.92.139.200 Rocks Front End (FE) 5.3 x86_64 CentOS 5.3 x86_64 2 Quad Xeon E5620 @2.4GHz Rocks FE, SGE, ARC FE, Web Server, Ganglia
10.1.225.254 48 Ports Switch
nas-0-2 10.1.255.253 10TB NFS server CentOS 5.3 1 Quad Xeon E5620 @2.4GHz ATLAS and VO software (also lhepat02.unibe.ch)
nas-0-1 10.1.255.252 1.1TB Lustre MDS/MDT CentOS 5.3 1 Quad Xeon E5620 @2.4GHz MDS/MDT (currently not in production)
compute-0-0/2 10.1.255.xxx Lustre CentOS 5.3 2 Dual AMD Opteron 2214 Managed by ce.lhep.unibe.ch
compute-0-3 10.1.255.248 Lustre MDS/MDT CentOS 5.3 2 Dual AMD Opteron 2214 Managed by ce.lhep.unibe.ch
compute-0-4/5/6/7 10.1.255.xxx Lustre CentOS 5.3 2 Quad AMD Opteron 2376 Managed by ce.lhep.unibe.ch
compute-0-8 to 26 10.1.255.xxx Worker Node 0-8 to 0-26 CentOS 5.3 2 Quad AMD Opteron 2376 Managed by ce.lhep.unibe.ch
compute-1-1 to 19 10.1.255.xxx Worker Node 1-1 to 1-19 CentOS 5.3 4 Quad AMD Opteron 8356 Managed by ce.lhep.unibe.ch
dpm.lhep.unibe.ch 130.92.139.211 DPM head node SLC 5.7 2 Quad Xeon E5620 @2.4GHz DPM Head node and disk pool
dpmdisk01(to 3).lhep.unibe.ch 130.92.139.211 to 213 DPM pool node SLC 5.7 1 Hexa Xeon X5650 @2.67GHz DPM 60TB disk pool
dpmdisk04.lhep.unibe.ch 130.92.139.214 DPM pool node SLC 5.7 1 Quad Xeon E5345 @2.33 GHz DPM 22TB disk pool
dpmdisk05(to 9).lhep.unibe.ch 130.92.139.215 to 219 DPM pool node SLC 5.x ?? Reserved for DPM disk pool
kvm01.lhep.unibe.ch 130.92.139.150 KVM host SLC 5.7 2 Dual AMD Opteron 2218 @2.6GHz Virtualization host for KVM
... ... ... ... ... -