From Federal Express to Lambdas: Transporting SDSS Data Using UDT
|
URL: www.teraflowtestbed.net www.sdss.org Contact: Robert Grossman, National Center for Data Mining (NCDM), University of Illinois at Chicago (UIC), USA, grossman @ uic.edu Collaborators: NCDM, UIC, USA: Robert Grossman, Yunhong Gu, David Hanley, David Turkington, Shirley Connelly Johns Hopkins University, USA: Alex Szalay Korea Astronomy and Space Science Institute, Korea: Changbom Park, Jongsoo Kim, Bongkyu Kim Korea Institute of Science and Technology Information, Korea: Minsun Lee Department of Astronomy, School of Science, University of Tokyo, Japan: Sadanori Okamura National Astronomical Observatory, China: Chenzhou Cui, Yongheng Zhao Chinese Academy of Sciences, China: Kai Nan School of Physics, University of Melbourne, Australia: David Barnes Max-Planck-Institut für Plasmaphysik, Germany: Hermann Lederer Until now, Sloan Digital Sky Survey (SDSS) datasets have been shared with collaborators using Federal Express. Optical paths and new transport protocols are enabling these datasets to be transported using networks over long distances. The SDSS DR3 multi-terabyte dataset is transported between Chicago and various sites in Europe and Asia using NCDM’s data transport protocol UDT (UDP-based Data Transport Protocol) over the Teraflow Testbed. The Teraflow Testbed is an infrastructure designed to test new 10Gb network protocols and data services with high-volume data flows, or teraflows, over both traditional routed networks as well as optical networks. |
 
|