Cluster of supercomputers
Questions:
- What is the achievable efficiency?
- What system characteristics limit performance?
- What runtime tunings and application modifications would bring the best profit in terms of performance?
3D space decomposition within a supercomputer, 1D decomposition among supercomputers.
Assumptions
- Perfect load balancing through irregular data distributions
- The cost of N processors each sending B bytes is the same as the cost of 1 processor sending N*B bytes
Notes: