Thumbnail
Access Restriction
Subscribed

Author Sax, M.J. ♦ Castellanos, M. ♦ Qiming Chen ♦ Meichun Hsu
Sponsorship IEEE Comput. Soc.
Source IEEE Xplore Digital Library
Content type Text
Publisher Institute of Electrical and Electronics Engineers, Inc. (IEEE)
File Format PDF
Copyright Year ©2013
Language English
Subject Domain (in DDC) Computer science, information & general works ♦ Data processing & computer science
Subject Keyword Topology ♦ Optimization ♦ Storms ♦ Network topology ♦ Parallel processing ♦ Monitoring ♦ Throughput
Abstract Aeolus is a prototype implementation of a topology optimizer on top of the distributed streaming system Storm. Aeolus extends Storm with a batching layer which can increase the topology's throughput by more than one order of magnitude. Furthermore, Aeolus implements an optimization algorithm that computes the optimal batch size and degree of parallelism for each node in the topology automatically. Even if Aeolus is built on top of Storm, the developed concepts are not limited to Storm and can be applied to any distributed intra-node-parallel streaming system. We propose to demo Aeolus using an interactive Web UI. One part of the Web UI is a topology builder allowing the user to interact with the system. Topologies can be created from scratch and their structure and/or parameters can be modified. Furthermore, the user is able to observe the impact of the changes on the optimization decisions and runtime behavior. Additionally, the Web UI gives a deep insight in the optimization process by visualizing it. The user can interactively step through the optimization process while the UI shows the optimizer's state, computations, and decisions. The Web UI is also able to monitor the execution of a non-optimized and optimized topology simultaneously showing the advantage of using Aeolus.
Description Author affiliation: Databases & Inf. Syst. Group, Humboldt-Univ. zu Berlin, Berlin, Germany (Sax, M.J.) || Hewlett-Packard Labs., Palo Alto, CA, USA (Castellanos, M.; Qiming Chen; Meichun Hsu)
ISBN 9781467349093
ISSN 10636382
Educational Role Student ♦ Teacher
Age Range above 22 year
Educational Use Research ♦ Reading
Education Level UG and PG
Learning Resource Type Article
Publisher Date 2013-04-08
Publisher Place Australia
Rights Holder Institute of Electrical and Electronics Engineers, Inc. (IEEE)
e-ISBN 9781467349109
Size (in Bytes) 546.20 kB
Page Count 4
Starting Page 1280
Ending Page 1283


Source: IEEE Xplore Digital Library