AEC-LHEP Hardware information: Difference between revisions

From LHEP Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:


BERN ATLAS T2 2016 Systems - ''ce0.lhep.unibe.ch'', ''ce02.lhep.unibe.ch'', ''dpm.lhep.unibe.ch'', ''bdii.lhep.unibe.ch''
BERN ATLAS T2 2016 Systems - ''ce0.lhep.unibe.ch'', ''ce02.lhep.unibe.ch'', ''dpm.lhep.unibe.ch'', ''bdii.lhep.unibe.ch''
* GOCDB Entry: https://goc.egi.eu/portal/index.php?Page_Type=Site&id=524
* ROC: NGI_CH - Certification status: Certified.
* Network : Gateway 130.92.140.1. DNS 130.92.9.53 (default), 130.92.9.52. Subnet mask 255.255.255.0


* Summary :
* Summary :
Line 87: Line 91:
             ...
             ...
             jobreport_options="urbatch:1000,archiving:/var/spool/nordugrid/urs-archive-jura,topic:/queue/global.accounting.cpu.central,gocdb_name:UNIBE-LHEP,benchmark_type:HEPSPEC,benchmark_value:8.52,use_ssl:true"
             jobreport_options="urbatch:1000,archiving:/var/spool/nordugrid/urs-archive-jura,topic:/queue/global.accounting.cpu.central,gocdb_name:UNIBE-LHEP,benchmark_type:HEPSPEC,benchmark_value:8.52,use_ssl:true"
* Network : Gateway 130.92.140.1. DNS 130.92.9.53 (default), 130.92.9.52. Subnet mask 255.255.255.0
* GOCDB Entry: https://goc.egi.eu/portal/index.php?Page_Type=Site&id=524
* ROC: NGI_CH - Certification status: Certified.




Revision as of 14:15, 20 May 2016

BERN ATLAS T2 2016 Systems - ce0.lhep.unibe.ch, ce02.lhep.unibe.ch, dpm.lhep.unibe.ch, bdii.lhep.unibe.ch

  • Summary :
           ce01.lhep CLUSTER:
           ce01:      2*2.40GHz Intel Xeon E5645 6-Core with 24GB RAM - ROCKS 6.2 and nordugrid-arc-5.0.3-1.el6.x86_64 (epel)
           mds-2-1:   1*2.40GHz Intel Xeon E5620 4-Core with 24GB RAM for Lustre MDS (lustre-2.5.3)
           oss-2-x:   2*2.10GHz Intel E5-2620 v2 4-Core with 16GB RAM for Lustre OSS (lustre-2.5.3, 6 nodes each with 32*HDD, 31TB sw raid0)
           wn-2-x:
                      2*2.53GHz Intel Xeon E5540  8-core + HT (45 Nodes) 540 cores with 2GB RAM/core (or 720 cores with 1.33GB RAM/core)
                      2*2.53GHz Intel Xeon E5540  8-core + HT ( 4 Nodes)  32 cores with 2GB RAM/core (same HW as above with 1 dead CPU)
                      2*2.67GHz Intel Xeon X5650 12-core + HT ( 6 Nodes) 144 cores with 2GB RAM/core
                      2*2.60GHz Intel Xeon E5-2650 v2 8-core + HT (4 Nodes) 128 cores with 2GB RAM/core
                      2*2.40GHz Intel Xeon E5-2630 v3 8-core + HT (8 Nodes) 256 cores with 2GB RAM/core

           ce02.lhep CLUSTER:
           ce02       2*2.40GHz Intel Xeon E5620 4-core with 24GB RAM - ROCKS 6.2 and nordugrid-arc-5.0.4-1.el6.x86_64 (epel)
           mds-0-1    1*2.40GHz Intel Xeon E5620 4-core with 24GB RAM for Lustre MDS (lustre-2.5.3-2)
           oss-0-x    2*2.30GHz AMD Opteron 2376 4-core with 16GB RAM for Lustre OSS (lustre-2.5.3, 11 nodes each with 1*HD 2TB)
           wn-0-x:
                      2*2.30GHz AMD Opteron 2376 4-core (15 Nodes) 120 cores with 2GB RAM/core 
                      4*2.30GHz AMD Opteron 8356 4-core (20 Nodes) 320 cores with 2GB RAM/core
                      1*2.50GHz Intel Xeon E5420 4-core + HT (47 Nodes) 376 cores with 2GB RAM/core

           dpm.lhep STORAGE ELEMENT:
           dpm        2*2.40GHz Intel Xeon E5620 4-core + HT with 16GB RAM and dpm-1.8.8-4.el5 (epel)
           dpmdisk0x  1*2.67GHz Intel Xeon X5650 6-core with 12GB RAM and dpm-1.8.8-4.el6.x86_64(epel), 6 nodes, 3*raid6 each, 436.52TB net in DPM)
           dpmdisk04  1*2.33GHZ Intel Xeon E5345 4-core with  8GB RAM and dpm-1.8.10-1.el6.x86_64 (epel), 1 node 1*raid6, 21.83TB net in DPM)

           bdii.lhep INFORMATION SYSTEM:
           service running on dpm.lhep: emi-bdii-site-1.0.1-1.el5
  • Hardware :
           ce01.lhep:
            1 Dalco FrontEnd 12-core Xeon E5645 @ 2.40GHz 
            1 Dalco Lustre mds 4-core Xeon E5620 @ 2.40GHz
           96 SUN Blade X6048 (workers, ~1/2 dead)
            6 IBM x3650 M3 (workers)
           12 Dalco (workers)
            6 Dalco Terraserver (Lustre)
           ce02.lhep:
            1 Dalco FrontEnd 8-core Xeon E5620 @ 2.40GHz
            1 Dalco Lustre mds 4-core Xeon E5620 @ 2.40GHz
           26 SUN Fire X2200 (Lustre and workers)
           20 SUN Blade X8840 (workers)
           47 DELL PE 1950 (workers)
           dpm.lhep:
            1 DELL PE 1950 (DPM head node) 
            6 Dalco Terraserver (DPM pool nodes) with 3*12-port Areca 1280/1880 (RAID6) each
            1 Dalco Terraserver (DPM pool node)  with 1*Areca 1880 (RAID6)
           Network:
           2 Brocade FCX648 (4*10GbE, 48*1GbE each) with 1*10GbE uplink (public LAN)
           1 NetGear ProSafe GSM7248R and GS748T (public LAN)
           2 Dell Force10 (48+48*1GbE vLAN stack) private LAN ce02.lhep CLUSTER)
           2 Dell Force10 (2*24+24*1GbE vLANs stack) private LAN ce01.lhep CLUSTER, 2nd vLAN unused)
           1 Mellanox QDR (30*40Gbit) private IB LAN ce01.lhep CLUSTER
           x QDR switched built-in the SUN Blade X6048 rack. private IB LAN ce01.lhep CLUSTER
  • Benchmark HEPspec06 (weighed average across all node types):
           ce01.lhep
           NODES * TYPE (cores)        HEPSPEC/node (total)
            8 * 32-core (256)          406.31 (3250.48)
            4 * 32-core (128)          370.36 (1481.44)
            6 * 24-core (144)          232.50 (1395.00)
            4 *  8-core ( 32)          118.48 ( 473.92)
           45 * 12-core (540)          143.06 (6437.07)
           ============================================
           67           1100                  13037.91 Installed Capacity
           
           In arc.conf arc.conf:
           processor_other_description='Cores=16.42, Benchmark=11.85-HEP-SPEC06'
           ...
           jobreport_options="urbatch:500,archiving:/var/spool/nordugrid/urs-archive-jura,topic:/queue/global.accounting.cpu.central,gocdb_name:UNIBE-LHEP,benchmark_type:HEPSPEC,benchmark_value:11.85,use_ssl:true"
           
           ce02.lhep
           NODES * TYPE (cores)        HEPSPEC/node (total)
           20 * 16-core (320)          123.74 (2474.7 )
           15 *  8-core (120)           72.72 (1090.87) 
           47 *  8-core (376)           72.14 (3390.7 )
           ============================================
           82            816                   6956.27 Installed Capacity
           Total: 3261.8 HEP-SPEC06
           
           In arc.conf arc.conf:
           processor_other_description='Cores=9.9, Benchmark=8.52-HEP-SPEC06'
           ...
           jobreport_options="urbatch:1000,archiving:/var/spool/nordugrid/urs-archive-jura,topic:/queue/global.accounting.cpu.central,gocdb_name:UNIBE-LHEP,benchmark_type:HEPSPEC,benchmark_value:8.52,use_ssl:true"


Host IP Service OS CPU Comment
lheplsw1.unibe.ch 130.92.139.201 48-Port Switch Brocade FCX648 Connected to eth1 on FE (on 10GbE NIC)
ce.lhep.unibe.ch 130.92.139.200 Rocks Front End (FE) 5.3 x86_64 CentOS 5.3 x86_64 2 Quad Xeon E5620 @2.4GHz Rocks FE, SGE, ARC FE, Web Server, Ganglia
10.1.225.254 48 Ports Switch
nas-0-2 10.1.255.253 10TB NFS server CentOS 5.3 1 Quad Xeon E5620 @2.4GHz ATLAS and VO software (also lhepat02.unibe.ch)
nas-0-1 10.1.255.252 1.1TB Lustre MDS/MDT CentOS 5.3 1 Quad Xeon E5620 @2.4GHz MDS/MDT (currently not in production)
compute-0-0/2 10.1.255.xxx Lustre CentOS 5.3 2 Dual AMD Opteron 2214 Managed by ce.lhep.unibe.ch
compute-0-3 10.1.255.248 Lustre MDS/MDT CentOS 5.3 2 Dual AMD Opteron 2214 Managed by ce.lhep.unibe.ch
compute-0-4/5/6/7 10.1.255.xxx Lustre CentOS 5.3 2 Quad AMD Opteron 2376 Managed by ce.lhep.unibe.ch
compute-0-8 to 26 10.1.255.xxx Worker Node 0-8 to 0-26 CentOS 5.3 2 Quad AMD Opteron 2376 Managed by ce.lhep.unibe.ch
compute-1-1 to 19 10.1.255.xxx Worker Node 1-1 to 1-19 CentOS 5.3 4 Quad AMD Opteron 8356 Managed by ce.lhep.unibe.ch
dpm.lhep.unibe.ch 130.92.139.211 DPM head node SLC 5.7 2 Quad Xeon E5620 @2.4GHz DPM Head node and disk pool
dpmdisk01(to 3).lhep.unibe.ch 130.92.139.211 to 213 DPM pool node SLC 5.7 1 Hexa Xeon X5650 @2.67GHz DPM 60TB disk pool
dpmdisk04.lhep.unibe.ch 130.92.139.214 DPM pool node SLC 5.7 1 Quad Xeon E5345 @2.33 GHz DPM 22TB disk pool
dpmdisk05(to 9).lhep.unibe.ch 130.92.139.215 to 219 DPM pool node SLC 5.x ?? Reserved for DPM disk pool
kvm01.lhep.unibe.ch 130.92.139.150 KVM host SLC 5.7 2 Dual AMD Opteron 2218 @2.6GHz Virtualization host for KVM
... ... ... ... ... -
Retrieved from "https://wiki.lhep.unibe.ch/index.php?title=AEC-LHEP_Hardware_information&oldid=538"