For almost two centuries, DTU, Technical University of Denmark, has been dedicated to fulfilling the vision of H.C. Ørsted — the father of electromagnetism — who founded the university in 1829 to develop and create value using the natural sciences and the technical sciences to benefit society. Today, DTU is ranked as one of the foremost technical universities in Europe.

High-Performance Computing Propels Materials Research

DTU promote promising fields of research within the technical and the natural sciences, especially based on usefulness to society, relevance to business and sustainability. DTU focuses on basic science that has significant challenges and clear application prospects, from atomic-scale materials analysis to quantum physics and renewable energy. As the material application environment becomes increasingly complex, laboratory research for materials performance analysis has become even more challenging.

DTU aims to understand the nature of materials by developing electron structural theory, and design new functional nanostructures through new-found insights. These studies require the analysis of the structure, strength, and characteristics of new materials, involving intensive, complex numerical computation and simulation tests on material and energy. This will produce a vast number of computational data. Therefore, High-Performance Computing (HPC) resources that can accelerate performance modeling and solving are particularly important to research in this field.

In order to speed up the process from discovery to application of new materials and maintain a leading edge in research, DTU plans to expand and upgrade its supercomputing cluster, ‘Niflheim,’ which is deployed at the Computational Atomic-scale Materials Design (CAMD) Center.

Supercomputing Cluster Running at the CAMD Center of DTU

Combining the Best of Both Worlds: Huawei X6800 High-Density Server and Intel OPA Network

The existing Niflheim cluster at DTU was built from 2009 to 2015, and was capable of a peak computing capability of only 73 TFLOPS. The cluster was equipped with previous generation and even earlier computing product hardware. The oldest products had limited processor performance, small memory capacity, with low-bandwidth but high-latency computing network. The old cluster was failing to meet the growing demands of computing-intensive simulation tests. As a result, the cluster became a bottleneck since the CAMD center needed research efficiency improvements.

DTU wanted to deploy a new supercomputing system to give the Niflheim cluster a boost in computing resources and performance, and meanwhile also prepare the cluster for future technology evolution as well as cluster-scale expansion. DTU has carefully studied various solutions in terms of overall performance, product quality, and service capabilities, and through an EU tender finally selected Huawei and Intel as the vendors to help the university build a new-generation computing cluster with their innovative technologies and computing products.

Huawei and Intel have long been partnering in the field of HPC. This time, the two partners bring together Intel’s latest computing and networking technology and Huawei’s X6800 high-density servers, and build a solution according to the needs of DTU. The solution will empower DTU with a high-performance, efficient, and easy-to-expand supercomputing cluster, meeting the current and future requirements of DTU for large-scale scientific research.

Solution highlights:

Supreme Performance, Leading Computing Efficiency

Nodes configured with Intel® Xeon® E5-2600 v4 series processors, up to 845 GFLOPS compute power per node

Nodes configured with 256 GB DIMMs and 240 GB SSDs, eliminates I/O bottlenecks, and improves data processing efficiency with high-speed data caching

Leverages the Intel® Omni-Path Architecture (OPA) to build a two-layer fat-tree fabric, delivers bandwidth of up to 100 Gbit/s, and end-to-end latency as low as 910 ns

Power Supply Units (PSUs) and fan modules shared by multiple nodes, enhanced with Huawei’s Dynamic Energy Management Technology (DEMT) to lower system energy consumption by over 10 percent

High-Density Deployment, Easy to Manage and Expand

4U chassis configured with eight 2-socket compute nodes, delivers computing density twice that of traditional 1U rack servers, significantly improves rack space utilization

Supports aggregated management network port for unified management, meanwhile reduces cable connections

Adopts a modular design, and supports hot swap for all key components, greatly improves Operations and Maintenance (O&M) efficiency

New-Generation Niflheim Cluster Expedites New Material Discovery and Application

The new-generation Niflheim cluster went live in December 2016. The new cluster helps more researchers carry out research and analysis on new materials and new energy, but also provides a great leap in feedback speeds of test results. It has enabled new levels of scientific research progress and strength, helping DTU generate new innovation capabilities in the field of material analysis.

The Niflheim cluster delivers a computing power of up to 225 TFLOPS, which is three times the level of the original system

Substantially shorten the materials’ analysis time, enabling researchers to discover and apply new materials more quickly

With flexible expandability, the cluster can seamlessly expand up to 112 nodes without requiring additional new cabinets