Heterogeneous Networks

Challenges associated with writing reliable numerical software on networks containing heterogeneous processors
Processors which may do floating point arithmetic differently
Even supposedly identical machines running with different compilers or even just different compiler options
The basic problem lies in making data dependent branches on different processors

http://www.netlib.org/utk/people/JackDongarra/