Skip to content

[Issue 124] Adding a task and example for concurrent transfer submission#125

Merged
davramov merged 5 commits intoals-computing:mainfrom
davramov:transfer_copy_task_submit
Mar 9, 2026
Merged

[Issue 124] Adding a task and example for concurrent transfer submission#125
davramov merged 5 commits intoals-computing:mainfrom
davramov:transfer_copy_task_submit

Conversation

@davramov
Copy link
Contributor

@davramov davramov commented Feb 21, 2026

With Prefect, if we have a function annotated with a @task, we can use success = task_name.submit(params) to run it in the background as a non-blocking command. If we want to know the results, we can then call success.result() if we need to know the result (this is a blocking command).

This PR creates a wrapper for Globus transfers with the @task annotation in transfer_controller.py, as well as a test in examples/submit_transfer_task_async_example.py. This will be helpful in HPC flows where we want to copy data back to the beamline between steps.

@davramov davramov changed the title [Issue 124] Adding a task and test for concurrent transfer submission [Issue 124] Adding a task and example for concurrent transfer submission Mar 9, 2026
@davramov davramov merged commit 014f81e into als-computing:main Mar 9, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant