Thumbnail
Access Restriction
Subscribed

Author Isard, Michael ♦ Barham, Paul ♦ Abadi, Martin ♦ Isaacs, Rebecca ♦ Murray, Derek G. ♦ McSherry, Frank
Source ACM Digital Library
Content type Text
Publisher Association for Computing Machinery (ACM)
File Format PDF
Language English
Abstract We describe the timely dataflow model for distributed computation and its implementation in the Naiad system. The model supports stateful iterative and incremental computations. It enables both low-latency stream processing and high-throughput batch processing, using a new approach to coordination that combines asynchronous and fine-grained synchronous execution. We describe two of the programming frameworks built on Naiad: GraphLINQ for parallel graph processing, and differential dataflow for nested iterative and incremental computations. We show that a general-purpose system can achieve performance that matches, and sometimes exceeds, that of specialized systems.
Description Affiliation: Google, Mountain View, CA, (Murray, Derek G.; Isard, Michael; Isaacs, Rebecca; Barham, Paul; Abadi, Martin)
Age Range 18 to 22 years ♦ above 22 year
Educational Use Research
Education Level UG and PG
Learning Resource Type Article
Publisher Date 2005-08-01
Publisher Place New York
Journal Communications of the ACM (CACM)
Volume Number 59
Issue Number 10
Page Count 9
Starting Page 75
Ending Page 83


Open content in new tab

   Open content in new tab
Source: ACM Digital Library