Skip to content

Commit 54764a8

Browse files
McPatateremi-or
andauthored
refactor(cb): move log line before stop call
Co-authored-by: Rémi Ouazan <83456801+remi-or@users.noreply.github.com>
1 parent e662c19 commit 54764a8

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/transformers/generation/continuous_batching/continuous_api.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1088,8 +1088,8 @@ def continuous_batching_context_manager(
10881088
try:
10891089
yield manager
10901090
finally:
1091+
logger.debug("Continuous batching loop finished") # a dummy log needed for the logs of stop to show. Won't show
10911092
manager.stop(block=block, timeout=timeout)
1092-
logger.debug("Continuous batching manager stopped")
10931093

10941094
# NOTE: don't forget to update `continuous_batching_context_manager` when changing this method's definition
10951095
def init_continuous_batching(

0 commit comments

Comments
 (0)