Question

NOTE** (anything numbered is the question that's needs to be answered, thank you.)

a)   High Performance Computing
1. What do you mean by high performance computing? Describe HA computing
b)   High Throughput computing
2. What is high throughput computing? Describe HT computing
3. Distinguish between HA and HT computing
c)   Computing Paradigm Distinctions:
Different paradigms include centralized computing, parallel computing, distributed computing and cloud computing, Learn each one of them. Such questions may be asked:
4. Describe centralized computing, parallel computing, distributed or cloud computing.
5. Distinguish between different computing paradigms
d)   Designing objectives of HPC and HTC systems
6. Describe the goals that are required to meet the designing objectives of HPC and HTC systems?
e)   Clustering for Massive Parallelism:
7. What is computer cluster? What are the benefits of computer cluster?
f)   Design Objectives of Computer Cluster:
•   Learn different design objectives of computer cluster
Short questions such as:
8. Describe how scalability, packaging, control, homogeneity, or security will impact the design of a computer cluster?
9. Also learn definitions such as latency, fault tolerance, modularity and memory wall?

Answer 1

1).

High Performance Computing:

High Performance Computing most generally refers to the practice of aggregating computing power in a way that delivers much higher performance than one could get out of a typical desktop computer or workstation in order to solve large problems in science, engineering, or commerce. Suppose you have a system having single processor and and single logical arithmetic unit. now suppose you want to perform 2 million multiplication operations which are independent of each other. now if you do this task in your computer system which has the same features mentioned above then it will do it serially one by one as it has only single processing unit and single arithmetic unit which is going to consume significant amount of time in order to finish the task. Now suppose you have another system which has 4 processing units and 4 arithmetic units. So now since you have this much resource you can utilize them simultaneously to accomplish your task in comparatively very less amount of time. The idea is to exploit all the resources you have in parallel manner. to so the job your system fetches the instructions 4 fold fast and assigns them into all arithmetic units which in turn does calculation task in 4 fold less time than what the single processor system was taking for all the instructions and thereby finishing the task much earlier than that of the system with single processing unit. provided the tasks are independent of each other. this what we call is high performance computing which is actually utilizing the many resources in parallel manner to complete the independent(mind the word "independent" here!) jobs in very less amount of time.

HA:

High availability (HA) is a characteristic of a system, which aims to ensure an agreed level of operational performance, usually uptime, for a higher than normal period. Modernization has resulted in an increased reliance on these systems. For example, hospitals and data centers require high availability of their systems to perform routine daily activities. Availability refers to the ability of the user community to obtain a service or good, access the system, whether to submit new work, update or alter existing work, or collect the results of previous work.

2):

High Throughput computing:-  It is not uncommon to find problems that require weeks or months of computation to solve. Scientists and engineers engaged in this sort of work need a computing environment that delivers large amounts of computational power over a long period of time. Such an environment is called a High-Throughput Computing (HTC) environment. In contrast, High Performance Computing (HPC) environments deliver a tremendous amount of compute power over a short period of time. HPC environments are often measured in terms of FLoating point Operations Per Second (FLOPS).

The key to HTC is to efficiently harness the use of all available resources.the goal of which is to speed up programs as much possible so that results are achieved more quickly. In some applications, all-out speed is of paramount importance making HPC use essential (think of next day weather prediction for example - an extremely accurate forecasting program is not much use if it needs to run for longer than 24 hours).