[CI Failure]: mi325_1: Entrypoints Integration Test (Pooling)

[AndreasKaratzas]

Name of failing test

export VLLM_WORKER_MULTIPROC_METHOD=spawn && pytest -v -s entrypoints/pooling

Basic information

• Flaky test
• Can reproduce locally
• Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

Collection Errors in pooling entrypoint tests (2 errors)

Failing Tests:

• entrypoints/pooling/embed/test_correctness_mteb.py - Collection error
• entrypoints/pooling/score/test_correctness_mteb.py - Collection error

Failure: ModuleNotFoundError at import time - from mteb.types import Array fails because mteb.types module doesn't exist in the installed mteb version.

Configuration:

• Tests use MTEB (Massive Text Embedding Benchmark) library for correctness validation
• Import chain: test file → tests.models.language.pooling_mteb_test.mteb_utils → mteb.types

Likely cause: Version incompatibility - the mteb library installed in the test environment has a different module structure than expected. The mteb.types module may have been moved, renamed, or removed in the installed version. The deprecation warnings visible in logs (207 warnings about MultilingualTask, 378 about metadata_dict, etc.) suggest an older/incompatible mteb version is installed.

Additional context: 9 tests skipped (expected - ROCm encoder self-attention tests), 637 deprecation warnings from mteb library indicating API changes between versions.

📝 History of failing test

AMD-CI build Buildkite references:

• 1041
• 1077
• 1088
• 1109
• 1111

CC List.

No response

[AndreasKaratzas]

@AndreasKaratzas has posted a PR for this: #28979

[AndreasKaratzas]

Test is green for the moment. PR is still pending.