Haswell Nodes

Supermicro TWIN^2 (2HE) 19'' chassis (SYS-6028TP-HTFR) with

• Redundant power supply (2000 Watt)
• Intel C612 Mainboard (Supermicro X10DRT-PIBF)
• Dual Socket R3 LGA 2011, 16 DIMM Slots
• 2x Intel Haswell E5-2680v3
• 256 GB RAM (10.66 GB/core) / 128 GB (5.33 GB/core) / 64 GB RAM (2.66 GB/core)
• 3 TB local disc  (SATA-III, 6 GBit/s, 7200 rpm) (TOSHIBA MG04ACA3)
• Infiniband FDR (56 GBit/s, 0.7 µs Latency)

Intel Haswell EP E5-2680v3

see here

• 22 nm Lithography, Tri-gate transistor ("3-D") technology
• 12 Core, HT = 24 threads, Intel64
• CPU Multiplier 25x (100 MHz) = 2.5 GHz
• Turbo Boost 2.0
• NON-AVX (max. 3.3 GHz), Steps 8/8/6/5/4/4/4/4/4/4/4/4: Multiplier with 1/2/3/4/5/6/7/8/9/10/11/12 cores is  33x/33x/31x/30x/29x/29x/29x/29x/29x/29x/29x/29x
• AVX (max. 3.1 GHz), Steps 6/6/4/3/3/3/3/3/3/3/3/3: Multiplier with 1/2/3/4/5/6/7/8/9/10/11/12 cores is  31x/31x/29x/28x/28x/28x/28x/28x/28x/28x/28x/28x
• L1= 12x32kB (Data) + 12x32kB (Instruction), L2=12x256kB, L3=30 MB
• Advanced Encryption Standard New Instructions (AES-NI)
• MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, AVX, AVX2, FMA3, F16C, BMI, BMI2
• Enhanced Intel SpeedStep Technology (EIST)
• RdRand instruction (Intel Secure Key), aka. Bull Mountain
• TDP 120 W

Memory

• Intel QPI 2.0, 2 x 9.6 GT/s
• 4 memory channels/CPU
• 256 GB RAM (16x16 GB DIMM DDR4 Registered (Buffered)), 1866 MHz) /  128 GB RAM (8x16 GB DIMM DDR4 Registered (Buffered)) / 64 GB RAM (8x8 GB DIMM DDR4 Registered (Buffered)), 2133 MHz) (SAMSUNG)
• Max. Memory Bandwidth  68 GB/s

NUMA Topology

Socket 0:
+-------------------------------------------------------------------------------------------------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  0  24 | |  1  25 | |  2  26 | |  3  27 | |  4  28 | |  5  29 | |  6  30 | |  7  31 | |  8  32 | |  9  33 | | 10  34 | | 11  35 | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +---------------------------------------------------------------------------------------------------------------------------------+ |
| |                                                               30MB                                                              | |
| +---------------------------------------------------------------------------------------------------------------------------------+ |
+-------------------------------------------------------------------------------------------------------------------------------------+
Socket 1:
+-------------------------------------------------------------------------------------------------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| | 12  36 | | 13  37 | | 14  38 | | 15  39 | | 16  40 | | 17  41 | | 18  42 | | 19  43 | | 20  44 | | 21  45 | | 22  46 | | 23  47 | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |  32kB  | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |  256kB | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +---------------------------------------------------------------------------------------------------------------------------------+ |
| |                                                               30MB                                                              | |
| +---------------------------------------------------------------------------------------------------------------------------------+ |
+-------------------------------------------------------------------------------------------------------------------------------------+