Skip to content

Commit 4c8daae

Browse files
gshtraspaulpak58
authored andcommitted
[ROCm][Bugfix] Compilation passes fix (vllm-project#22202)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com> Signed-off-by: Paul Pak <paulpak58@gmail.com>
1 parent 4a85394 commit 4c8daae

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

vllm/compilation/pass_manager.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,11 +7,13 @@
77
from vllm.logger import init_logger
88
from vllm.platforms import current_platform
99

10-
if current_platform.is_cuda():
10+
if current_platform.is_cuda_alike():
1111
from .fusion import FusionPass
12-
from .collective_fusion import AllReduceFusionPass, AsyncTPPass
1312
from .fusion_attn import AttnFusionPass
1413

14+
if current_platform.is_cuda():
15+
from .collective_fusion import AllReduceFusionPass, AsyncTPPass
16+
1517
from .activation_quant_fusion import ActivationQuantFusionPass
1618
from .fix_functionalization import FixFunctionalizationPass
1719
from .inductor_pass import CustomGraphPass, InductorPass, get_pass_context

0 commit comments

Comments
 (0)