Cluster Hardware Information

交大高性能计算集群型号为浪潮TS 10000,是一台由CPU+GPU+FAT组成的异构高性能计算系统,理论峰值性能为343TFLOPS(CPU 135TFLOPS+GPU 208TFLOPS),在2013年6月发布的超级计算机TOP500世界排名158,国内排名11,教育部所属高校第1。                                       

集群目前拥有435台节点,其中CPU节点332台,GPU节点69台,胖节点20台,存储节点6台,管理登陆节点8台,CPU核数达到7000,内存30TB,聚合存储能力为5PB。使用了100块NVIDIA Kepler K20 GPU,10块K40 GPU,24块K80 GPU,4块Pascal P100 GPU,80块400GB SSD高速硬盘,节点之间使用FDR 56Gbps的Infiniband网络高速互联。详细配置如下表所示。   

Device Name Device Type Specifications Number
CPU Node Intel H2216JFFKR Nodes CPU: 2×Intel Xeon E5-2670(8 Cores, 2.6GHz, 20MB Cache, 8.0GT)
Mem: 64GB(8×8GB) ECC Registered DDR3 1600MHz Samsung Memory
332
Fat Node Intel H2216WPFKR Nodes CPU: 2×Intel Xeon E5-2670(8 Cores, 2.6GHz, 20MB Cache, 8.0GT)
Mem: 256G(16×16G) ECC Registered DDR3 1600MHz Samsung Memory
20
K20 Node Intel R2208GZ4GC CPU: 2×Intel Xeon E5-2670(8 Cores, 2.6GHz, 20MB Cache, 8.0GT)
Mem: 64GB(8×8GB) ECC Registered DDR3 1600MHz Samsung Memory
GPU: NVIDIA Tesla K20 × 2
50
K40 Node Intel R2208GZ4GC CPU: 2×Intel Xeon E5-2670(8 Cores, 2.6GHz, 20MB Cache, 8.0GT)
Mem: 64GB(8×8GB) ECC Registered DDR3 1600MHz Samsung Memory
GPU: NVIDIA Tesla K40 × 2
5
K80 Node Intel R2208GZ4GC CPU: 2×Intel Xeon E5-2680 v3(12 Cores, 2.5GHz, 30MB Cache, 9.6GT)
Mem: 96GB(16×8GB) ECC Registered DDR4 2133MHz Samsung Memory
GPU: NVIDIA Tesla K80 × 2
12
P100 Node Intel R2208GZ4GC CPU: 2×Intel Xeon E5-2680 v3(12 Cores, 2.5GHz, 30MB Cache, 9.6GT)
Mem: 96GB(16×8GB) ECC Registered DDR4 2133MHz Samsung Memory
GPU: NVIDIA Tesla P100 × 2
2
Computing Network Switch Mellanox Infiniband FDR Core Switch 648 × FDR Core Switch MSX6536-10R, Mellanox Unified Fabric Manager 1
Mellanox SX1036 40Gb Switch 36 × 40Gb Ethernet Switch SX1036, 36× QSFP Interface 1
Management Network Switch Extreme Summit X440-48t-10G 2-layer Switch 48 × 1Giga Switch Summit X440-48t-10G, authorized by ExtremeXOS 9
Extreme Summit X650-24X 3-layer Switch 24 × 10Giga 3-layer Ethernet Switch Summit X650-24X, authorized by ExtremeXOS 1
Parallel Storage DDN Parallel Storage System DDN SFA12K Storage System 1
DELL MD3420 + Intel Enterprise Edition for Lustre 1
40Gb Ethernet Card MCX314A-BCBT Mellanox ConnextX-3 Chip 40Gb Ethernet Card
2 × 40Gb Ethernet ports, enough QSFP cables
16
SSD Intel SSD910 Intel SSD910 Disk, 400GB, PCIE 80
Copyright ©2013 SJTU Network & Information Center All rights reserved.