Void the checkpoint repo to point to empty model so that it minimizes… #1847
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… the default download process when cache_internal is specified
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Nullify the default download process by pointing
checkpoint_repoto an empty HF repo whencache_internalis specified🚀 What
When
cache_internalis specified forinference_stack: v2, the defaultmodel_cacheworkflow still runs on the CheckpointRepository. This has to be worked around by manually setting the empty repository to minimize this workflow, which isn't a great user experience. This PR makes it happen by default.💻 How
Inject empty repository if
inference_stack: v2andcache_internalare both specified.🔬 Testing