The large-scale data transfer study team led by Brian Freitag (ST13) of NASA IMPACT completed initial data transfer tests with newly developed software architecture designed to support petabyte-scale data transfer between NASA and ESA. Two sample volumes of 10 TBs each were staged for transfer from ESA’s OVH-managed cloud bucket to NASA’s Amazon Web Service (AWS) managed S3 bucket. Initial benchmarks of the E2E tests suggest the architecture can support throughput on the order of 2 PB/month. Further testing is planned to confirm these initial benchmarks, but the ability to transfer data at such throughputs opens the door for future collaborations between NASA and ESA in Earth science and beyond.
