Complexity Science Seminar Series - Abstracts
Title:
iFlow: An Internet-Scale Data Processing System
Presenter:
Dr. Jeong-Hyon Hwang, Dept. of Computer Science, SUNY Albany
Date and Time: Thursday, July 16th, 2009 11:00am-12:00pm
Abstract:
Advances in hardware manufacturing have enabled proliferation of various computing machines ranging from commodity servers and supercomputers to mobile devices and sensors. Furthermore, the rapid growth of online services has accelerated the pace of data production. The confluence of these trends necessitates software systems that can efficiently process massive amounts of data by orchestrating a large number of heterogenous computing machines.
In this talk, I will introduce iFlow, a software system that aims to help users with limited experience in parallel and distributed computing easily develop Internet-scale data processing applications. In iFlow, users express the desired computation as a network of operators. iFlow's off-the-shelf operators provide fundamental processing capabilities such as filtering, aggregation, and correlation that are essential to typical data management applications. In addition, custom operators for specific applications can easily be developed and plugged into the system. Given a large number of computers around the world, iFlow strives to deploy operators in a manner that maximizes the performance/cost ratio. It also prevents service disruptions by replicating operators and rerouting around network outages.
iFlow is under development at the University at Albany - State University of New York. This talk will include a brief demonstration of the current iFlow system.
Seminar Location: The seminars are held at:
Virginia Tech, Corporate Research Center
1880 Pratt Drive, Building XV
Seminar Room, First Floor
Directions: Map (PDF)
Back to: NDSSL Seminar Page