Previous: Data Structures
Up: Related Issues
Previous Page: CRS-based Factorization Transpose Solve
Next Page: Inner products

Parallelism

In this section we discuss aspects of parallelism in the iterative methods discussed in this book.

Since the iterative methods share most of their computational kernels we will discuss these independent of the method. The basic time-consuming kernels of iterative schemes are:

• inner products,
• vector updates,
• matrix--vector products, e.g., (for some methods also ),
• preconditioner solves.

We will examine each of these in turn. We will conclude this section by discussing two particular issues, namely computational wavefronts in the SOR method, and block operations in the GMRES method.

• Inner products
  • Overlapping communication and computation
  • Fewer synchronization points
• Vector updates
• Matrix-vector products
• Preconditioning
  • Discovering parallelism in sequential preconditioners.
  • More parallel variants of sequential preconditioners.
  • Fully decoupled preconditioners.
• Wavefronts in the Gauss-Seidel and Conjugate Gradient methods
• Blocked operations in the GMRES method