Heterogeneous Computing
Software intended to be used in this context
Communication of ft. pt. numbers between processors
Repeatability and Coherency
Machine precision and other machine specific parameters
Iterative convergence across clusters of processors
Defensive programming required