From Federal Express to Lambdas: Transporting SDSS Data Using UDT

Until now, Sloan Digital Sky Survey (SDSS) datasets have been shared with collaborators using Federal Express. Optical paths and new transport protocols are enabling these datasets to be transported using networks over long distances. The SDSS DR3 multi-terabyte dataset is transported between Chicago and various sites in Europe and Asia using NCDM's data transport protocol UDT (UDP-based Data Transport Protocol) over the Teraflow Testbed. The Teraflow Testbed is an infrastructure designed to test new 10Gb network protocols and data services with high-volume data flows, or teraflows, over both traditional routed networks as well as optical networks.

URL:

www.teraflowtestbed.net
www.sdss.org

Contact:

Robert Grossman, National Center for Data Mining (NCDM), University of Illinois at Chicago (UIC), USA, grossman @ uic.edu

Collaborators:

NCDM, UIC, USA:
Robert Grossman, Yunhong Gu, David Hanley, David Turkington, Shirley Connelly

Korea Astronomy and Space Science Institute, Korea:
Changbom Park, Jongsoo Kim, Bongkyu Kim

Korea Institute of Science and Technology Information, Korea:
Minsun Lee

Department of Astronomy, School of Science, University of Tokyo, Japan:
Sadanori Okamura

National Astronomical Observatory, China:
Chenzhou Cui, Yongheng Zhao

Chinese Academy of Sciences, China:
Kai Nan

School of Physics, University of Melbourne, Australia:
David Barnes

Max-Planck-Institut für Plasmaphysik, Germany:
Hermann Lederer