Title

Adding Data Parallelism to Streaming Pipelines for Throughput Optimization

Authors

Peng Li, Washington University in St Louis
Kunal Agrawal, Washington University in St LouisFollow
Jeremy Buhler, Washington University in St LouisFollow
Roger D. Chamberlain, Washington University in St. LouisFollow

Document Type

Technical Report

Department

Computer Science and Engineering

Publication Date

2013

Filename

WUCSE-2013-10.pdf

DOI:

10.7936/K7736P4S

Technical Report Number

WUCSE-2013-10

Abstract

The streaming model is a popular model for writing high-throughput parallel applications. A streaming application is represented by a graph of computation stages that communicate with each other via FIFO channels. In this report, we consider the problem of mapping streaming pipelines — streaming applications where the graph is a linear chain — in order to maximize throughput. In a parallel setting, subsets of stages, called components can be mapped onto different computing resources. The through-put of an application is determined by the throughput of the slowest component. Therefore, if some stage is much slower than others, then it may be useful to replicate the stage’s code and divide its workload among two or more replicas in order to increase throughput. However, pipelines may consist of some replicable and some non-replicable stages. In this paper, we address the problem of mapping these partially replicable streaming pipelines on both homogeneous and heterogeneous platforms so as to maximize throughput. We consider two types of platforms, homogeneous platforms — where all resources are identical, and heterogeneous platforms — where resources may have different speeds. In both cases, we consider two network topologies — unidirectional chain and clique. We provide polynomial-time algorithms for mapping partially replicable pipelines onto unidirectional chains for both homogeneous and heterogeneous platforms. For homogeneous platforms, the algorithm for unidirectional chains generalizes to clique topologies. However, for heterogeneous platforms, mapping these pipelines onto clique topologies is NP-complete. We provide heuristics to generate solutions for cliques by applying our chain algorithms to a series of chains sampled from the clique. Our empirical results show that these heuristics rapidly converge to near-optimal solutions.

Comments

Permanent URL: http://dx.doi.org/10.7936/K7736P4S

Recommended Citation

Li, Peng; Agrawal, Kunal; Buhler, Jeremy; and Chamberlain, Roger D., "Adding Data Parallelism to Streaming Pipelines for Throughput Optimization" Report Number: WUCSE-2013-10 (2013). All Computer Science and Engineering Research.
https://openscholarship.wustl.edu/cse_research/97