HPC at Compmech
The laboratory owns an HPC cluster dedicated to numerical simulations. The cluster was designed and it is maintained by the laboratory members in collaboration with the department of informatics of the University of Pavia. This cluster enters in the framework of the iCardioCloud project.
The domain of expertises, using both academic and commercial codes, are:
- Computational Fluid Dynamics (CFD) for biomedical applications using the finite elements library LifeV, in collaboration with Alessandro Veneziani (Emory University);
- Isogeometric analysis using FEAP, in collaboration with Robert L. Taylor (UC Berkeley), and LS-DYNA;
- Non-linear materials using FEAP, with a focus on Shape Alloyed Memory materials.
Particular care is taken by the staff members to improve the parallel performance of the mathematical software on the cluster, as most lab application are time critical and would benefit from such optimizations. One on-going research activity is to modify the LIFEV suite to implement hybrid parallelism, and to make the resulting software available to a broad scientific audience.
The cluster is composed of 4 computational nodes combining 256 cores and 1Tera of RAM. In addition, a login node with 32 cores and 252Giga of RAM is also used for development purposes. A third dedicated server with 24 cores and 66Giga of RAM is used for FEAP.
In details:
- 4 Computing nodes Dell PowerEdge R815
- CPUs: 4x AMD Opteron 6272 @ 2.1GHz: 16 cores per CPU
- Total number of cores per node: 64
- Ram: 252Gb
- Total disk capacity: 292Gb
- 1 Master node Dell PowerEdge R820 (Tomato):
- CPUs: 4x Intel Xeon E5-4620 @ 2.20 GHz: 8 cores per CPU
- Total number of cores: 32
- Ram: 252Gb
- Total disk capacity: 10Tb
- 1 Gigabit Switch that manages the local network of the 4 computing nodes
Software set-up:
- Debian GNU/Linux 7.5 (Wheezy).
- NFS: Network File System used to share a directory of the Master node to all others computing nodes. This directory provides data, binaries and a common workspace for the cluster.
- Mpi: message-passing interface used for parallel applications within the cluster. Two versions are used: mpich and openmpi.
- Torque: distributed resource manager used to manage batch jobs over the computing nodes.
- Trilinos: open source software libraries for scientific applications.
- Octave: A matrix laboratory.
- VMTK: the Vascular Modeling Toolkit.
Wiki:
List of tutorial presentations for a correct use of the server and how to access it using Windows and Linux OS.
CompMech server architecture presentation: Overview of the server architecture and some useful Windows applications to utilize the server from a Windows machine.
Tutorial batch file: A basic example of batch file to run simulations on our cluster.
Bash on Win10: Short presentation for a quick Ubuntu installation on Windows 10 (not a virtual machine!) to access the cluster via ssh.
Lab Members:
- Ferdinando Auricchio, Eng, PhD, Prof. (UniPV)
- Alessandro Reali, Eng, PhD, Prof. (UniPV)
- Michele Conti, Eng, PhD (UniPV)
- Simone Morganti, Eng, PhD (UniPV)
- Massimo Carraturo, Eng, PhD Student (UniPV)
- Mauro Murer, Eng, PhD Student (UniPV)
- Rodrigo M. Romarowski, Eng, PhD (IRCCS Policlinico San Donato)
Acknowledgements:
The lab activities are kindly supported also by:
- Cariplo Foundation through the Project iCardioCloud no. 2013-1179
- Regione Lombardia through the Project no. E18F13000030007
- Ministero dell’Istruzione, dell’Università e della Ricerca through the Project no. 2010BFXRHS
- European Research Council (ERC) through the ISOBIO Project
- Cariplo Foundation through the project 2009-2822