trying something out #42240

ArthurZucker · 2025-11-17T12:38:59Z

What does this PR do?

Update

HuggingFaceDocBuilderDev · 2025-11-17T12:47:53Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

github-actions · 2025-11-17T18:25:48Z

Failure summary

By test

Test	Failures	Full error(s)
tests/models/llama/test_tokenization_llama.py::LlamaTokenizationTest::test_add_prefix_space	1	1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [1, 29950, 1032, 920, 526, 366, 2599] != [1, 18637, 920, 526, 366, 2599]
tests/models/llama/test_tokenization_llama.py::LlamaIntegrationTest::test_some_edge_cases	1	1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: ['▁'] != ['▁▁']
tests/models/llama/test_tokenization_llama.py::CommonSpmIntegrationTests::test_add_dummy_prefix	1	1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [4, 156, 86, 20] != [7, 4, 156, 86, 20]
tests/models/llama/test_tokenization_llama.py::CommonSpmIntegrationTests::test_character_after_special_token	1	1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [262, 15, 30, 1, 100] != [156, 30, 1, 100]
tests/models/llama/test_tokenization_llama.py::CommonSpmIntegrationTests::test_special_tokens_strip	1	1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [516, 1, 156] != [284, 1, 156]
tests/models/glm46v/test_processor_glm46v.py::Glm46VProcessorTest::test_apply_chat_template_video_frame_sampling	1	1× /usr/local/lib/python3.10/site-packages/torch/_ops.py:841: RuntimeError: expected scalar type Long but found Double

By model

Model	Failures	Full error(s)
llama	5	1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [1, 29950, 1032, 920, 526, 366, 2599] != [1, 18637, 920, 526, 366, 2599]; 1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: ['▁'] != ['▁▁']; 1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [4, 156, 86, 20] != [7, 4, 156, 86, 20]; 1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [262, 15, 30, 1, 100] != [156, 30, 1, 100]; 1× /usr/local/lib/python3.10/unittest/case.py:675: AssertionError: Lists differ: [516, 1, 156] != [284, 1, 156]
glm46v	1	1× /usr/local/lib/python3.10/site-packages/torch/_ops.py:841: RuntimeError: expected scalar type Long but found Double

github-actions · 2025-11-18T08:23:55Z

View the CircleCI test collection helper for this PR:\n\nhttps://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=9664edac08729aabb154073c9cd52e944b7cbb3d

ydshieh · 2025-11-19T13:42:02Z

thanks. will finalize this on my side

github-actions · 2025-11-20T16:21:11Z

View the CircleCI test collection helper for this PR:\n\nhttps://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=215ea77a013c435cfc01194c5b089173cf96ada0

github-actions · 2025-11-21T14:56:56Z

View the CircleCI test collection helper for this PR:\n\nhttps://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=b2f0d8e0d4d0795f463b975be208866ec04fc587

github-actions · 2025-11-21T15:15:49Z

View the CircleCI test collection helper for this PR:\n\nhttps://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=b5fdb80c080328bb4731b25c6ac2211b02c5296b

ydshieh · 2025-11-27T14:42:07Z

i am back to working on this

github-actions · 2025-11-27T15:11:55Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=f637e2602674fa7252ccf62985363718c25ab9ce

github-actions · 2025-11-27T15:19:34Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=45cdd2ca6efc3a0d6a5104fa4338ae6c4d28569a

github-actions · 2025-11-27T15:55:25Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=3c6d3c09ebd7cdddfbda177472be5a287865777d

github-actions · 2025-11-27T16:45:18Z

⏳ Waiting for CircleCI to complete for commit 8733209e8498...

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=8733209e84981d3d880dab9b1211f7a544aef25e

github-actions · 2025-11-27T17:03:43Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=3c6d3c09ebd7cdddfbda177472be5a287865777d

github-actions · 2025-11-27T17:22:31Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=1cf3e2161de942785e3306671d8d7106754746ab

github-actions · 2025-11-27T17:51:43Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=53c1c41395055ff45fc3e6ea9008b681692e7f88

github-actions · 2025-11-27T17:56:37Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=21a39beca8d4ae3bfb2d2906fd0cf1c5c2c9cc08

github-actions · 2025-11-27T18:44:38Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=e3fa6244b205155c8444df0cda06be47d07701e6

github-actions · 2025-11-27T18:50:17Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=f403e6f2b1c4c3c73595f00dd84f65cb240335c9

github-actions · 2025-11-27T19:33:31Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=4154f6a55ea1073d7724bd7d09ff2c94a44486ff

github-actions · 2025-11-27T20:30:46Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=5d1188136705d058d6bddae24177eefa91a941c5

github-actions · 2025-11-28T07:35:53Z

[For maintainers] Suggested jobs to run (before merge)

run-slow: llama, mixtral

ArthurZucker · 2025-11-28T07:36:15Z

https://huggingface.co/datasets/transformers-community/circleci-test-results/blob/main/pr-42240/sha-04aa4f066590/failure_summary.json for people who want to check!

🤗 very nice ty @ydshieh for pushing this 🟢 approved

github-actions · 2025-11-28T07:39:27Z

View the CircleCI test collection helper for this PR:

https://huggingface.co/spaces/transformers-community/circleci-test-collection-helper?repo=huggingface%2Ftransformers&pr=42240&sha=8ac9c14372d0c83b153d7e93ed780e7d923fa67b

ydshieh · 2025-11-28T14:02:18Z

As discussed internally, it's better to merge this PR only after we fix the space issue and making it public space.

will work on that.

ArthurZucker added 2 commits November 17, 2025 13:38

trying something out

af806d6

add forcful failures

29a4e09

ArthurZucker added 5 commits November 17, 2025 14:43

add prints to debug the hell out of it

7fb1375

small updates

e5f8eb4

try

8f794eb

use another token.

8edef99

nit

bbdce1c

ArthurZucker marked this pull request as ready for review November 17, 2025 16:44

ArthurZucker added 5 commits November 17, 2025 18:30

update?

98ce578

up up up

be22c6b

up

bc4915b

new secret

3e9912e

try it for real!

03562e6

ArthurZucker added 3 commits November 18, 2025 08:40

small updates

dbfc674

update query

7fcf84e

a different token

9664eda

trigger

215ea77

ydshieh added 2 commits November 21, 2025 09:40

revert changes 1: create_circleci_config.py

c81523d

try 1: shieh

b2f0d8e

ydshieh added 2 commits November 21, 2025 16:08

try 2: shieh

b5fdb80

try 3: shieh

1f87f18

ydshieh added 2 commits November 21, 2025 16:49

try 4: shieh

b015a16

try 5: shieh

1870291

try 11: shieh

f637e26

try 12: shieh

45cdd2c

try 13: shieh

3c6d3c0

ydshieh force-pushed the collection-helpers branch from 8733209 to 3c6d3c0 Compare November 27, 2025 16:58

try 14: slim script

1cf3e21

ydshieh added 2 commits November 27, 2025 18:46

try 15: slim script more

53c1c41

try 16: slim script further more

21a39be

ydshieh and others added 2 commits November 27, 2025 19:29

try 16: bring fields back

10d4074

Merge branch 'main' into collection-helpers

e3fa624

try 17: remove md relevant lines

f403e6f

try 18: add tests field back

4154f6a

try 19: security

5d11881

Merge branch 'main' into collection-helpers

8ac9c14

trying something out #42240

Are you sure you want to change the base?

trying something out #42240

Uh oh!

Conversation

ArthurZucker commented Nov 17, 2025

What does this PR do?

Uh oh!

HuggingFaceDocBuilderDev commented Nov 17, 2025

Uh oh!

github-actions bot commented Nov 17, 2025

Failure summary

By test

By model

Uh oh!

github-actions bot commented Nov 18, 2025

Uh oh!

ydshieh commented Nov 19, 2025

Uh oh!

github-actions bot commented Nov 20, 2025

Uh oh!

github-actions bot commented Nov 21, 2025

Uh oh!

github-actions bot commented Nov 21, 2025

Uh oh!

ydshieh commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 27, 2025

Uh oh!

github-actions bot commented Nov 28, 2025

Uh oh!

ArthurZucker commented Nov 28, 2025

Uh oh!

github-actions bot commented Nov 28, 2025

Uh oh!

ydshieh commented Nov 28, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants