Primary tabs

Using Globus on RCC’s Midway Clusters: Simplifying Data Transfer, Sharing, and Automation

Globus, developed at the University of Chicago, is an extremely powerful, interactive, and flexible platform for managing data and compute workflows, enabling secure, efficient collaboration and data sharing across research environments. Available to all faculty, researchers, and students, Globus is fully integrated with the RCC’s Midway compute ecosystem and ready for immediate use.

 

In this hands-on workshop, we will demonstrate how to use Globus to streamline the transfer of datasets from local machines or scientific instruments (e.g. microscopes, telescopes, etc.) to RCC Midway storage systems. Participants will learn how to automate these transfers, build user-friendly data portals for searching and viewing, and easily share research data, including high resolution images, with collaborators or the broader community.

 

The workshop will include a demonstration of an automated instrument-to-Midway workflow using the Globus platform and guided time for participants to begin creating their own data pipelines on RCC Midway using Globus.

 

Agenda

  • 1:00 – 3:00 pm: Introduction and data lifecycle management with Globus
    • Introductions to RCC and Globus
    • Overview: Managing the instrument Data Lifecycle
    • Automating Data Workflows Using Globus at RCC
      • Globus Flows–Automate multi-step data processes
      • Globus Data Transfer and Sharing–Efficient, secure file movement
      • Globus Compute – Remote computation and task execution
      • Globus Search – Indexing and discovery of research data

o Building a Globus Data Portal/Data commons framework

 

  • 3:00 – 3:30pm: Break

 

  • 3:30 – 4:30pm: Open Discussion and Hands-on Practice
    • Interactive Q&A: Bring your questions and specific use cases
    • Hand-on Setup:
      • Install and configure Globus Connect Personal
      • Practice transferring data between your laptop or any system to Midway clusters
      • Start setting up your own automated workflow or data portals.

 

Level: Introductory/Intermediate

Register

Tuesday, May 13, 2025 - 13:00 to 16:30