Architecture and system models of networked computing components that coordinate through message passing. Many-core and many-task methods; grid, GPU-based, and cloud computing; programming systems and models including MPI, web services, and map reduce; virtualization.