Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#627 expired SAS tokens] Place runner only once rather than for each task on any given compute node #629

Closed
BMurri opened this issue Feb 29, 2024 · 0 comments · Fixed by #639
Labels
enhancement New feature or request TES Priority: P2 Groomed to a Priority 2 issue
Milestone

Comments

@BMurri
Copy link
Collaborator

BMurri commented Feb 29, 2024

Problem:
The task runner is downloaded for each and every task attempt. That wastes time, network bandwidth, and customer money.

Solution:

  1. Download the task runner using the pool's start task. Colocate it under batch's "shared" folder.
  2. Utilize the downloaded task runner (rather than redownloading it) in the batch_script generated by BatchNodeScriptBuilder.

Additional context
When #627 is fully implemented, this download should be the only time that TES will place a SAS token anywhere in any Azure Batch API/metadata.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request TES Priority: P2 Groomed to a Priority 2 issue
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant