High-performance computing (HPC) is the use of supercomputers and computer clusters to solve advanced computation problems.
Overview
HPC integrates systems administration (including network and security knowledge) and parallel programming into a multidisciplinary field that combines digital electronics, computer architecture, system software, programming languages, algorithms and computational techniques. HPC technologies are the tools and systems used to implement and create high performance computing systems. Recently[when?], HPC systems have shifted from supercomputing to computing clusters and grids. Because of the need of networking in clusters and grids, High Performance Computing Technologies are being promoted[by whom?] by the use of a collapsed network backbone, because the collapsed backbone architecture is simple to troubleshoot and upgrades can be applied to a single router as opposed to multiple ones. HPC integrates with data analytics in AI engineering workflows to generate new data streams that increase simulation ability to answer the "what if" questions.
The term is most commonly associated with computing used for scientific research or computational science. A related term, high-performance technical computing (HPTC), generally refers to the engineering applications of cluster-based computing (such as computational fluid dynamics and the building and testing of virtual prototypes). HPC has also been applied to business uses such as data warehouses, line of business (LOB) applications, and transaction processing.
High-performance computing (HPC) as a term arose after the term "supercomputing". HPC is sometimes used as a synonym for supercomputing; but, in other contexts, "supercomputer" is used to refer to a more powerful subset of "high-performance computers", and the term "supercomputing" becomes a subset of "high-performance computing". The potential for confusion over the use of these terms is apparent.
Because most current applications are not designed for HPC technologies but are retrofitted, they are not designed or tested for scaling to more powerful processors or machines. Since networking clusters and grids use multiple processors and computers, these scaling problems can cripple critical systems in future supercomputing systems. Therefore, either the existing tools do not address the needs of the high performance computing community or the HPC community is unaware of these tools. A few examples of commercial HPC technologies include:
- the simulation of car crashes for structural design
- molecular interaction for new drug design
- the airflow over automobiles or airplanes
In government and research institutions, scientists simulate galaxy creation, fusion energy, and global warming, as well as work to create more accurate short- and long-term weather forecasts. The world's tenth most powerful supercomputer in 2008, IBM Roadrunner (located at the United States Department of Energy's Los Alamos National Laboratory) simulated the performance, safety, and reliability of nuclear weapons and certifies their functionality.
TOP500
TOP500 ranks the world's 500 fastest high-performance computers, as measured by the High Performance LINPACK (HPL) benchmark. Not all existing computers are ranked, either because they are ineligible (e.g., they cannot run the HPL benchmark) or because their owners have not submitted an HPL score (e.g., because they do not wish the size of their system to become public information, for defense reasons). In addition, the use of the single LINPACK benchmark is controversial, in that no single measure can test all aspects of a high-performance computer. To help overcome the limitations of the LINPACK test, the U.S. government commissioned one of its originators, Jack Dongarra of the University of Tennessee, to create a suite of benchmark tests that includes LINPACK and others, called the HPC Challenge benchmark suite. This evolving suite has been used in some HPC procurements, but, because it is not reducible to a single number, it has been unable to overcome the publicity advantage of the less useful TOP500 LINPACK test. The TOP500 list is updated twice a year, once in June at the ISC European Supercomputing Conference and again at a US Supercomputing Conference in November.
Many ideas for the new wave of grid computing were originally borrowed from HPC.
High performance computing in the cloud
Traditionally, HPC has involved an on-premises infrastructure, investing in supercomputers or computer clusters. Over the last decade, cloud computing has grown in popularity for offering computer resources in the commercial sector regardless of their investment capabilities. Some characteristics like scalability and containerization also have raised interest in academia. However security in the cloud concerns such as data confidentiality are still considered when deciding between cloud or on-premise HPC resources.
See also
- Distributed computing
- Quantum computing
- Metacomputing
- Grand Challenge
- High Productivity Computing Systems
- High-availability cluster
- High-throughput computing
- Many-task computing
- Urgent computing
- GPU workstation
References
- Brazell, Jim; Bettersworth, Michael (2005). High Performance Computing (Report). Texas State Technical College. Archived from the original on 2010-07-31.
- Collette, Michael; Corey, Bob; Johnson, John (December 2004). High Performance Tools & Technologies (PDF) (Report). Lawrence Livermore National Laboratory, U.S. Department of Energy. Archived from the original (PDF) on 2017-08-30.
- "AI-powered engineering: A modern must-have". April 24, 2024. Retrieved March 5, 2025.
- "supercomputing". Oxford English Dictionary (Online ed.). Oxford University Press. (Subscription or participating institution membership required.) "Supercomputing" is attested from 1944.
- Schulman, Michael. "High Performance Computing: RAM vs CPU". Dr. Dobbs High Performance Computing, April 30, 2007.
- "Launching a New Class of U.S. Supercomputing". Department of Energy. 17 November 2022.
- "High Performance Computing". US Department of Energy. Archived from the original on 30 July 2009.
- Morgan Eldred; Dr. Alice Good; Carl Adams (24 January 2018). "A case study on data protection and security decisions in cloud HPC" (PDF). School of Computing, University of Portsmouth, Portsmouth, U.K.
- Sebastian von Alfthan (2016). "High-performance computing in the cloud?" (PDF). CSC – IT Center for Science.
External links
- HPCwire
- Top 500 supercomputers
- Rocks Clusters Open-Source High Performance Linux Clusters
- News Articles & Policy Reports on High-Performance Scientific Computing
- The Center for Modeling Immunity to Enteric Pathogens (MIEP)
- The Art of HPC: Textbooks by Victor Eijkhout of TACC
- Vol.1: The Science of Computing
- Vol.2: Parallel Programming for Science Engineering
- Vol.3: Introduction to Scientific Programming in C++17/Fortran2008
- Vol.4: Tutorials for High Performance Scientific Computing
High performance computing HPC is the use of supercomputers and computer clusters to solve advanced computation problems The Center for Nanoscale Materials at the Advanced Photon SourceOverviewHPC integrates systems administration including network and security knowledge and parallel programming into a multidisciplinary field that combines digital electronics computer architecture system software programming languages algorithms and computational techniques HPC technologies are the tools and systems used to implement and create high performance computing systems Recently when HPC systems have shifted from supercomputing to computing clusters and grids Because of the need of networking in clusters and grids High Performance Computing Technologies are being promoted by whom by the use of a collapsed network backbone because the collapsed backbone architecture is simple to troubleshoot and upgrades can be applied to a single router as opposed to multiple ones HPC integrates with data analytics in AI engineering workflows to generate new data streams that increase simulation ability to answer the what if questions The term is most commonly associated with computing used for scientific research or computational science A related term high performance technical computing HPTC generally refers to the engineering applications of cluster based computing such as computational fluid dynamics and the building and testing of virtual prototypes HPC has also been applied to business uses such as data warehouses line of business LOB applications and transaction processing High performance computing HPC as a term arose after the term supercomputing HPC is sometimes used as a synonym for supercomputing but in other contexts supercomputer is used to refer to a more powerful subset of high performance computers and the term supercomputing becomes a subset of high performance computing The potential for confusion over the use of these terms is apparent Because most current applications are not designed for HPC technologies but are retrofitted they are not designed or tested for scaling to more powerful processors or machines Since networking clusters and grids use multiple processors and computers these scaling problems can cripple critical systems in future supercomputing systems Therefore either the existing tools do not address the needs of the high performance computing community or the HPC community is unaware of these tools A few examples of commercial HPC technologies include the simulation of car crashes for structural design molecular interaction for new drug design the airflow over automobiles or airplanes In government and research institutions scientists simulate galaxy creation fusion energy and global warming as well as work to create more accurate short and long term weather forecasts The world s tenth most powerful supercomputer in 2008 IBM Roadrunner located at the United States Department of Energy s Los Alamos National Laboratory simulated the performance safety and reliability of nuclear weapons and certifies their functionality TOP500TOP500 ranks the world s 500 fastest high performance computers as measured by the High Performance LINPACK HPL benchmark Not all existing computers are ranked either because they are ineligible e g they cannot run the HPL benchmark or because their owners have not submitted an HPL score e g because they do not wish the size of their system to become public information for defense reasons In addition the use of the single LINPACK benchmark is controversial in that no single measure can test all aspects of a high performance computer To help overcome the limitations of the LINPACK test the U S government commissioned one of its originators Jack Dongarra of the University of Tennessee to create a suite of benchmark tests that includes LINPACK and others called the HPC Challenge benchmark suite This evolving suite has been used in some HPC procurements but because it is not reducible to a single number it has been unable to overcome the publicity advantage of the less useful TOP500 LINPACK test The TOP500 list is updated twice a year once in June at the ISC European Supercomputing Conference and again at a US Supercomputing Conference in November Many ideas for the new wave of grid computing were originally borrowed from HPC High performance computing in the cloudTraditionally HPC has involved an on premises infrastructure investing in supercomputers or computer clusters Over the last decade cloud computing has grown in popularity for offering computer resources in the commercial sector regardless of their investment capabilities Some characteristics like scalability and containerization also have raised interest in academia However security in the cloud concerns such as data confidentiality are still considered when deciding between cloud or on premise HPC resources See alsoDistributed computing Quantum computing Metacomputing Grand Challenge High Productivity Computing Systems High availability cluster High throughput computing Many task computing Urgent computing GPU workstationReferencesBrazell Jim Bettersworth Michael 2005 High Performance Computing Report Texas State Technical College Archived from the original on 2010 07 31 Collette Michael Corey Bob Johnson John December 2004 High Performance Tools amp Technologies PDF Report Lawrence Livermore National Laboratory U S Department of Energy Archived from the original PDF on 2017 08 30 AI powered engineering A modern must have April 24 2024 Retrieved March 5 2025 supercomputing Oxford English Dictionary Online ed Oxford University Press Subscription or participating institution membership required Supercomputing is attested from 1944 Schulman Michael High Performance Computing RAM vs CPU Dr Dobbs High Performance Computing April 30 2007 Launching a New Class of U S Supercomputing Department of Energy 17 November 2022 High Performance Computing US Department of Energy Archived from the original on 30 July 2009 Morgan Eldred Dr Alice Good Carl Adams 24 January 2018 A case study on data protection and security decisions in cloud HPC PDF School of Computing University of Portsmouth Portsmouth U K Sebastian von Alfthan 2016 High performance computing in the cloud PDF CSC IT Center for Science External linksHPCwire Top 500 supercomputers Rocks Clusters Open Source High Performance Linux Clusters News Articles amp Policy Reports on High Performance Scientific Computing The Center for Modeling Immunity to Enteric Pathogens MIEP The Art of HPC Textbooks by Victor Eijkhout of TACC Vol 1 The Science of Computing Vol 2 Parallel Programming for Science Engineering Vol 3 Introduction to Scientific Programming in C 17 Fortran2008 Vol 4 Tutorials for High Performance Scientific Computing
