Programming on Parallel Machines
by Norm Matloff
Publisher: University of California, Davis 2012
Number of pages: 410
This is aimed more on the practical end of things, real code is featured throughout. The primary emphasis is on simplicity and clarity of the techniques and languages used. It is assumed that the student is reasonably adept in programming, and has math background through linear algebra.
Download or read it online for free here:
by Dimitri P. Bertsekas, John Tsitsiklis - Athena Scientific
This is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the issues associated with such algorithms.
by Hank Dietz - The Aggregate
This document discusses the basic approaches to parallel processing available to Linux users: SMP Linux systems, clusters of networked Linux systems, parallel execution using multimedia instructions, and attached processors hosted by a Linux system.
by Colin Campbell, Ralph Johnson, Stephen Toub - Microsoft Press
A book that introduces .NET programmers to patterns for including parallelism in their applications. Examples of these patterns are parallel loops, parallel tasks and data aggregation with map-reduce. Each pattern has its own chapter.
by Al Geist, at al. - The MIT Press
Written by the team that developed the software, this tutorial is the definitive resource for scientists, engineers, and other computer users who want to use PVM to increase the flexibility and power of their high-performance computing resources.