Programming on Parallel Machines

(Penjaga, 18-02-2014 07:36:08)

Why is this book different from all other parallel programming books? It is aimed more on the
practical end of things, in that:
  • There is very little theoretical content, such as O() analysis, maximum theoretical speedup,PRAMs, directed acyclic graphs (DAGs) and so on.
  • Real code is featured throughout.
  • We use the main parallel platforms|OpenMP, CUDA and MPI|rather than languages that at this stage are largely experimental or arcane.
  • The running performance themes|communications latency, memory/network contention, load balancing and so on|are interleaved throughout the book, discussed in the context of specic platforms or applications.
  • Considerable attention is paid to techniques for debugging.
Download full text