2019-2021 Data Mobility Exhibition
Data mobility is a critical component of the process of science. Being able to predictably and efficiently move scientific data between experimental source, processing facilities, long term storage, and collaborators is a common use case that transcends the boundaries of research disciplines.
Description
Current and previous CC* Awardees, along with the greater R&E community, are encouraged to participate in an exciting and beneficial data mobility exhibition that will be highlighted at the 2019 and 2021 CC* PI Meetings. Using reference data sets, and existing campus CI components, participants will download, measure, and potentially improve their scientific data movement capabilities. This event will begin in August of 2019, and will extend for two full years (through the CC* 2021 PI meeting).
Participation
This event is open to anyone in the R&E community, and CC* awardees (prior and current) are strongly encouraged to participate. Preliminary steps involve:
- Creating a brief (1-2 page) description of the network and data architecture for your campus environment using this template. An example can be found here.
- Prepare a local data transfer machine, and the Globus Connect software. Help can be requested at epoc@iu.edu
- Download the reference data sets and record the results. Information on this is available here: https://www.globusworld.org/tour/data-mobility-exhibition
- Share the description, and your results on a standardized spreadsheet, with the organizers via this form.
- For those that want to accelerate their results, 1:1 assistance, via the Engagement and Performance Operations Center (EPOC), is available: epoc@iu.edu
Continuing Community Involvement
Exhibition participants that will be attending the 2019 CC and CICI PI meeting on September 23-25 in Minneapolis, MN can attend the data mobility workshop to further discuss and share their results. After the meeting, through Sept of 2021, participants can:
- Continue steps 1-5.
- Discuss results and strategies via the CI Engineering list: cybinf-engr@es.net
- Assist in the writing a report and presentation for the 2021 CC and CICI PI Meeting that highlights the capabilities and improvements that have been made since 2019.
DTN and Data Mobility Performance Chart
10G DTN |
x10G, 25G, 40G, 100G DTNs |
x400G |
||||||
DTN host Transfer Rates | 1/6 PetaScale |
1/3 PetaScale |
1/2 PetaScale |
|
PetaScale: 1 PB/wk |
PetaScale: 1 PB/day |
|
Future ExaScale: 1 XB/month |
Data Transfer Volume (Researcher) |
1 TB/hr |
2 TB/hr | 3 TB/hr | 5.95 TB/hr | 41.67 TB/hr | 33.33 PB/day | ||
Network Transfer Rate (Network Admin) | 2.22 Gb/s | 4.44 Gb/s | 6.67 Gb/s | 13.23 Gb/s | 92.59 Gb/s | 3.09 Tb/s | ||
Storage Transfer Rate (Sys/Storage Admin) | 277.78 MB/s | 555.54 MB/s | 833.33 MB/s | 1.65 GB/s | 11.57 GB/s | 385.80 GB/s |