Parallel Models - Revision history

Ian.percel at 20:34, 17 March 2021

2021-03-17T20:34:13Z

← Older revision		Revision as of 20:34, 17 March 2021
Line 10:		Line 10:
	Working on modern computing clusters (like ARC or Compute Canada sites) involves multiple kinds of resources and scales of parallelism. Disentangling them will require some discussion of parallel models and resource mappings.		Working on modern computing clusters (like ARC or Compute Canada sites) involves multiple kinds of resources and scales of parallelism. Disentangling them will require some discussion of parallel models and resource mappings.

	<ui>		<ol>
	<li>Serial Computation<\li>		<li>Serial Computation</li>
	<li>Shared Memory Parallelism<\li>		<li>Shared Memory Parallelism</li>
	<li>Distributed Memory Parallelism<\li>		<li>Distributed Memory Parallelism</li>
	<li>Job Level Parallelism<\li>		<li>Job Level Parallelism</li>
	<li>GPU Parallelism<\li>		<li>GPU Parallelism</li>
	<li>Hybrid Parallelism<\li>		<li>Hybrid Parallelism</li>
	<~~\ui~~>		</ol>

	==References==		==References==

Ian.percel: /* References */

2021-03-17T20:32:38Z

References

← Older revision		Revision as of 20:32, 17 March 2021
Line 22:		Line 22:

	Introductory Talk on Parallel Models and Scheduling		Introductory Talk on Parallel Models and Scheduling

	[[:File:Parallelism_and_Scheduling_v2.pdf\|Parallelism and Scheduling Slides]]		[[:File:Parallelism_and_Scheduling_v2.pdf\|Parallelism and Scheduling Slides]]

Ian.percel: /* References */

2021-03-17T20:32:25Z

References

← Older revision		Revision as of 20:32, 17 March 2021
Line 22:		Line 22:

	Introductory Talk on Parallel Models and Scheduling		Introductory Talk on Parallel Models and Scheduling
	[:File:Parallelism_and_Scheduling_v2.pdf\|Parallelism and Scheduling Slides]		[[:File:Parallelism_and_Scheduling_v2.pdf\|Parallelism and Scheduling Slides]]

Ian.percel: /* References */

2021-03-17T20:32:00Z

References

← Older revision		Revision as of 20:32, 17 March 2021
Line 22:		Line 22:

	Introductory Talk on Parallel Models and Scheduling		Introductory Talk on Parallel Models and Scheduling
			[:File:Parallelism_and_Scheduling_v2.pdf\|Parallelism and Scheduling Slides]

Ian.percel: parallel models page

2021-03-17T20:28:49Z

parallel models page

New page

Parallel work has a long history in practical human endeavours. Rigorous reasoning about it dates back to roughly the 1950s with the development of job-shop and logistical scheduling theories and their implementation on and for parallel computers. A basic working knowledge of parallelism is valuable for learning how to work effectively on a computing cluster.

==Introduction==
It is easy to identify examples of parallelism in everyday life and scientific work:
* Coordinated construction of large structures (e.g. Hadrian's Wall)
* 12 Bakers with 12 Ovens baking 24 loaves of bread in the time it would take one baker to bake 2
* Multi-channel pipetting
* Parallel computing

Working on modern computing clusters (like ARC or Compute Canada sites) involves multiple kinds of resources and scales of parallelism. Disentangling them will require some discussion of parallel models and resource mappings.

<ui>
<li>Serial Computation<\li>
<li>Shared Memory Parallelism<\li>
<li>Distributed Memory Parallelism<\li>
<li>Job Level Parallelism<\li>
<li>GPU Parallelism<\li>
<li>Hybrid Parallelism<\li>
<\ui>

==References==

Introductory Talk on Parallel Models and Scheduling