Skip to content

[Doc] Huge doc refactoring #3231

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 7 commits into from
Nov 6, 2025
Merged

[Doc] Huge doc refactoring #3231

merged 7 commits into from
Nov 6, 2025

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Nov 6, 2025 •
edited
Loading

@vmoens
Update
8889aaf 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
78b9313 
ghstack-source-id: 4c64a65
Pull-Request: #3231
@vmoens vmoens mentioned this pull request Nov 6, 2025
Merged
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 6, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3231

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Nov 5, 2025
Merged
Merged
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2025
@github-actions
Copy link

github-actions bot commented Nov 6, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}16$. Worsened: $\large\color{#d91a1a}13$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 83.0990μs 82.6664μs 12.0968 KOps/s 12.2327 KOps/s $\color{#d91a1a}-1.11\%$
test_tensor_to_bytestream_speed[torch.save] 0.1386ms 0.1370ms 7.3010 KOps/s 7.0362 KOps/s $\color{#35bf28}+3.76\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1198s 0.1196s 8.3588 Ops/s 8.8347 Ops/s $\textbf{\color{#d91a1a}-5.39\%}$
test_tensor_to_bytestream_speed[numpy] 2.8230μs 2.8198μs 354.6374 KOps/s 358.9186 KOps/s $\color{#d91a1a}-1.19\%$
test_tensor_to_bytestream_speed[safetensors] 41.4945μs 41.3013μs 24.2123 KOps/s 24.2567 KOps/s $\color{#d91a1a}-0.18\%$
test_simple 0.6606s 0.5653s 1.7689 Ops/s 1.7826 Ops/s $\color{#d91a1a}-0.77\%$
test_transformed 1.1926s 1.1283s 0.8863 Ops/s 0.8891 Ops/s $\color{#d91a1a}-0.32\%$
test_serial 1.6586s 1.6517s 0.6054 Ops/s 0.6062 Ops/s $\color{#d91a1a}-0.13\%$
test_parallel 1.1242s 1.0775s 0.9281 Ops/s 0.9376 Ops/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-True-True-True-True] 0.2734ms 46.9279μs 21.3093 KOps/s 22.7623 KOps/s $\textbf{\color{#d91a1a}-6.38\%}$
test_step_mdp_speed[True-True-True-True-False] 72.8010μs 25.7484μs 38.8373 KOps/s 40.5293 KOps/s $\color{#d91a1a}-4.17\%$
test_step_mdp_speed[True-True-True-False-True] 65.6310μs 25.7681μs 38.8076 KOps/s 40.1879 KOps/s $\color{#d91a1a}-3.43\%$
test_step_mdp_speed[True-True-True-False-False] 38.4710μs 14.5029μs 68.9516 KOps/s 73.9899 KOps/s $\textbf{\color{#d91a1a}-6.81\%}$
test_step_mdp_speed[True-True-False-True-True] 0.1068ms 48.1712μs 20.7593 KOps/s 21.0412 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[True-True-False-True-False] 59.1910μs 27.8601μs 35.8937 KOps/s 36.1547 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[True-True-False-False-True] 54.9410μs 29.0105μs 34.4703 KOps/s 36.2038 KOps/s $\color{#d91a1a}-4.79\%$
test_step_mdp_speed[True-True-False-False-False] 47.8010μs 17.0532μs 58.6401 KOps/s 61.1551 KOps/s $\color{#d91a1a}-4.11\%$
test_step_mdp_speed[True-False-True-True-True] 84.6710μs 52.3375μs 19.1068 KOps/s 19.9341 KOps/s $\color{#d91a1a}-4.15\%$
test_step_mdp_speed[True-False-True-True-False] 55.3810μs 30.7428μs 32.5280 KOps/s 33.3886 KOps/s $\color{#d91a1a}-2.58\%$
test_step_mdp_speed[True-False-True-False-True] 59.6710μs 29.0942μs 34.3712 KOps/s 36.5955 KOps/s $\textbf{\color{#d91a1a}-6.08\%}$
test_step_mdp_speed[True-False-True-False-False] 47.8100μs 16.8407μs 59.3799 KOps/s 61.3563 KOps/s $\color{#d91a1a}-3.22\%$
test_step_mdp_speed[True-False-False-True-True] 85.1710μs 53.5268μs 18.6822 KOps/s 19.1827 KOps/s $\color{#d91a1a}-2.61\%$
test_step_mdp_speed[True-False-False-True-False] 58.6310μs 33.1624μs 30.1546 KOps/s 30.7825 KOps/s $\color{#d91a1a}-2.04\%$
test_step_mdp_speed[True-False-False-False-True] 57.7910μs 31.3735μs 31.8741 KOps/s 33.7059 KOps/s $\textbf{\color{#d91a1a}-5.43\%}$
test_step_mdp_speed[True-False-False-False-False] 56.3810μs 19.4538μs 51.4038 KOps/s 53.8371 KOps/s $\color{#d91a1a}-4.52\%$
test_step_mdp_speed[False-True-True-True-True] 78.8020μs 51.0821μs 19.5763 KOps/s 20.6031 KOps/s $\color{#d91a1a}-4.98\%$
test_step_mdp_speed[False-True-True-True-False] 53.5210μs 30.0602μs 33.2665 KOps/s 33.3074 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[False-True-True-False-True] 2.2843ms 33.3323μs 30.0009 KOps/s 31.2832 KOps/s $\color{#d91a1a}-4.10\%$
test_step_mdp_speed[False-True-True-False-False] 44.0510μs 18.5554μs 53.8926 KOps/s 55.4658 KOps/s $\color{#d91a1a}-2.84\%$
test_step_mdp_speed[False-True-False-True-True] 85.5910μs 54.0869μs 18.4888 KOps/s 19.1961 KOps/s $\color{#d91a1a}-3.68\%$
test_step_mdp_speed[False-True-False-True-False] 74.8610μs 33.4794μs 29.8691 KOps/s 30.5718 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[False-True-False-False-True] 70.0310μs 35.9073μs 27.8495 KOps/s 28.5870 KOps/s $\color{#d91a1a}-2.58\%$
test_step_mdp_speed[False-True-False-False-False] 48.4710μs 21.0743μs 47.4511 KOps/s 48.5868 KOps/s $\color{#d91a1a}-2.34\%$
test_step_mdp_speed[False-False-True-True-True] 92.6320μs 57.2576μs 17.4649 KOps/s 17.9232 KOps/s $\color{#d91a1a}-2.56\%$
test_step_mdp_speed[False-False-True-True-False] 95.6920μs 36.3421μs 27.5163 KOps/s 28.3051 KOps/s $\color{#d91a1a}-2.79\%$
test_step_mdp_speed[False-False-True-False-True] 67.9610μs 34.8003μs 28.7354 KOps/s 29.3436 KOps/s $\color{#d91a1a}-2.07\%$
test_step_mdp_speed[False-False-True-False-False] 63.1310μs 21.2296μs 47.1040 KOps/s 48.5485 KOps/s $\color{#d91a1a}-2.98\%$
test_step_mdp_speed[False-False-False-True-True] 0.1044ms 59.9328μs 16.6854 KOps/s 17.5928 KOps/s $\textbf{\color{#d91a1a}-5.16\%}$
test_step_mdp_speed[False-False-False-True-False] 66.5010μs 38.7898μs 25.7800 KOps/s 26.0957 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[False-False-False-False-True] 67.3510μs 36.3645μs 27.4994 KOps/s 27.6649 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[False-False-False-False-False] 48.8000μs 22.8791μs 43.7081 KOps/s 43.1276 KOps/s $\color{#35bf28}+1.35\%$
test_values[generalized_advantage_estimate-True-True] 9.8848ms 9.5106ms 105.1460 Ops/s 106.9359 Ops/s $\color{#d91a1a}-1.67\%$
test_values[vec_generalized_advantage_estimate-True-True] 20.1507ms 18.0728ms 55.3318 Ops/s 55.4946 Ops/s $\color{#d91a1a}-0.29\%$
test_values[td0_return_estimate-False-False] 0.2339ms 0.1271ms 7.8660 KOps/s 7.8059 KOps/s $\color{#35bf28}+0.77\%$
test_values[td1_return_estimate-False-False] 27.2579ms 26.0868ms 38.3336 Ops/s 38.8370 Ops/s $\color{#d91a1a}-1.30\%$
test_values[vec_td1_return_estimate-False-False] 18.4759ms 18.0653ms 55.3548 Ops/s 55.5250 Ops/s $\color{#d91a1a}-0.31\%$
test_values[td_lambda_return_estimate-True-False] 40.9517ms 39.0285ms 25.6223 Ops/s 25.9417 Ops/s $\color{#d91a1a}-1.23\%$
test_values[vec_td_lambda_return_estimate-True-False] 17.9287ms 17.6549ms 56.6416 Ops/s 55.6011 Ops/s $\color{#35bf28}+1.87\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.9847ms 8.5379ms 117.1250 Ops/s 123.1145 Ops/s $\color{#d91a1a}-4.86\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7110ms 1.4906ms 670.8567 Ops/s 693.1391 Ops/s $\color{#d91a1a}-3.21\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5204ms 0.3952ms 2.5305 KOps/s 2.5600 KOps/s $\color{#d91a1a}-1.15\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 35.2592ms 34.4144ms 29.0576 Ops/s 28.7375 Ops/s $\color{#35bf28}+1.11\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.9064ms 1.7440ms 573.3827 Ops/s 575.3158 Ops/s $\color{#d91a1a}-0.34\%$
test_dqn_speed[False-None] 6.3675ms 1.4327ms 697.9778 Ops/s 720.5373 Ops/s $\color{#d91a1a}-3.13\%$
test_dqn_speed[False-backward] 1.9506ms 1.9057ms 524.7346 Ops/s 522.7512 Ops/s $\color{#35bf28}+0.38\%$
test_dqn_speed[True-None] 0.6909ms 0.5113ms 1.9558 KOps/s 1.9281 KOps/s $\color{#35bf28}+1.43\%$
test_dqn_speed[True-backward] 1.0066ms 0.9527ms 1.0496 KOps/s 1.0367 KOps/s $\color{#35bf28}+1.24\%$
test_dqn_speed[reduce-overhead-None] 0.6212ms 0.5043ms 1.9829 KOps/s 1.9414 KOps/s $\color{#35bf28}+2.14\%$
test_dqn_speed[reduce-overhead-backward] 0.9843ms 0.9384ms 1.0657 KOps/s 867.0748 Ops/s $\textbf{\color{#35bf28}+22.91\%}$
test_ddpg_speed[False-None] 3.2872ms 2.8705ms 348.3766 Ops/s 354.2341 Ops/s $\color{#d91a1a}-1.65\%$
test_ddpg_speed[False-backward] 4.1264ms 4.0118ms 249.2627 Ops/s 253.5864 Ops/s $\color{#d91a1a}-1.70\%$
test_ddpg_speed[True-None] 1.8611ms 1.3660ms 732.0410 Ops/s 733.3927 Ops/s $\color{#d91a1a}-0.18\%$
test_ddpg_speed[True-backward] 2.3976ms 2.2675ms 441.0070 Ops/s 424.8586 Ops/s $\color{#35bf28}+3.80\%$
test_ddpg_speed[reduce-overhead-None] 1.8996ms 1.3740ms 727.7777 Ops/s 738.7354 Ops/s $\color{#d91a1a}-1.48\%$
test_ddpg_speed[reduce-overhead-backward] 2.4171ms 2.3304ms 429.1160 Ops/s 375.3773 Ops/s $\textbf{\color{#35bf28}+14.32\%}$
test_sac_speed[False-None] 8.2256ms 7.8246ms 127.8024 Ops/s 128.7082 Ops/s $\color{#d91a1a}-0.70\%$
test_sac_speed[False-backward] 11.3344ms 10.8448ms 92.2103 Ops/s 91.4851 Ops/s $\color{#35bf28}+0.79\%$
test_sac_speed[True-None] 2.2595ms 2.1130ms 473.2687 Ops/s 459.7154 Ops/s $\color{#35bf28}+2.95\%$
test_sac_speed[True-backward] 4.2842ms 4.0626ms 246.1451 Ops/s 219.4090 Ops/s $\textbf{\color{#35bf28}+12.19\%}$
test_sac_speed[reduce-overhead-None] 2.4611ms 2.1277ms 469.9855 Ops/s 465.3188 Ops/s $\color{#35bf28}+1.00\%$
test_sac_speed[reduce-overhead-backward] 4.1040ms 4.0221ms 248.6241 Ops/s 215.7079 Ops/s $\textbf{\color{#35bf28}+15.26\%}$
test_redq_speed[False-None] 15.1658ms 10.5176ms 95.0788 Ops/s 87.7867 Ops/s $\textbf{\color{#35bf28}+8.31\%}$
test_redq_speed[False-backward] 25.0831ms 18.7683ms 53.2815 Ops/s 56.3714 Ops/s $\textbf{\color{#d91a1a}-5.48\%}$
test_redq_speed[True-None] 4.5370ms 4.3623ms 229.2372 Ops/s 230.2072 Ops/s $\color{#d91a1a}-0.42\%$
test_redq_speed[True-backward] 10.0276ms 9.7471ms 102.5942 Ops/s 101.7070 Ops/s $\color{#35bf28}+0.87\%$
test_redq_speed[reduce-overhead-None] 4.5076ms 4.3738ms 228.6354 Ops/s 227.5365 Ops/s $\color{#35bf28}+0.48\%$
test_redq_speed[reduce-overhead-backward] 10.2725ms 9.9375ms 100.6290 Ops/s 98.3553 Ops/s $\color{#35bf28}+2.31\%$
test_redq_deprec_speed[False-None] 11.3538ms 10.8921ms 91.8094 Ops/s 93.2373 Ops/s $\color{#d91a1a}-1.53\%$
test_redq_deprec_speed[False-backward] 16.1500ms 15.5579ms 64.2759 Ops/s 64.8827 Ops/s $\color{#d91a1a}-0.94\%$
test_redq_deprec_speed[True-None] 4.0860ms 3.6398ms 274.7409 Ops/s 282.7806 Ops/s $\color{#d91a1a}-2.84\%$
test_redq_deprec_speed[True-backward] 7.7700ms 7.3610ms 135.8506 Ops/s 133.3889 Ops/s $\color{#35bf28}+1.85\%$
test_redq_deprec_speed[reduce-overhead-None] 4.1513ms 3.5460ms 282.0086 Ops/s 273.5617 Ops/s $\color{#35bf28}+3.09\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.4802ms 7.2776ms 137.4082 Ops/s 125.3976 Ops/s $\textbf{\color{#35bf28}+9.58\%}$
test_td3_speed[False-None] 8.0438ms 7.7449ms 129.1178 Ops/s 128.8690 Ops/s $\color{#35bf28}+0.19\%$
test_td3_speed[False-backward] 11.0594ms 10.4116ms 96.0466 Ops/s 94.4903 Ops/s $\color{#35bf28}+1.65\%$
test_td3_speed[True-None] 1.8102ms 1.7820ms 561.1598 Ops/s 553.8270 Ops/s $\color{#35bf28}+1.32\%$
test_td3_speed[True-backward] 3.7408ms 3.5850ms 278.9398 Ops/s 245.5128 Ops/s $\textbf{\color{#35bf28}+13.62\%}$
test_td3_speed[reduce-overhead-None] 1.8018ms 1.7539ms 570.1568 Ops/s 569.5872 Ops/s $\color{#35bf28}+0.10\%$
test_td3_speed[reduce-overhead-backward] 3.6580ms 3.5530ms 281.4544 Ops/s 275.7941 Ops/s $\color{#35bf28}+2.05\%$
test_cql_speed[False-None] 29.5766ms 25.8415ms 38.6974 Ops/s 38.8405 Ops/s $\color{#d91a1a}-0.37\%$
test_cql_speed[False-backward] 38.7463ms 35.2693ms 28.3533 Ops/s 28.4346 Ops/s $\color{#d91a1a}-0.29\%$
test_cql_speed[True-None] 13.0005ms 12.4078ms 80.5944 Ops/s 80.1906 Ops/s $\color{#35bf28}+0.50\%$
test_cql_speed[True-backward] 18.8114ms 18.2618ms 54.7593 Ops/s 55.2655 Ops/s $\color{#d91a1a}-0.92\%$
test_cql_speed[reduce-overhead-None] 12.7233ms 12.3730ms 80.8213 Ops/s 78.8397 Ops/s $\color{#35bf28}+2.51\%$
test_cql_speed[reduce-overhead-backward] 18.6746ms 18.3933ms 54.3675 Ops/s 54.6539 Ops/s $\color{#d91a1a}-0.52\%$
test_a2c_speed[False-None] 5.6271ms 5.4038ms 185.0552 Ops/s 191.8600 Ops/s $\color{#d91a1a}-3.55\%$
test_a2c_speed[False-backward] 12.1619ms 11.7888ms 84.8262 Ops/s 86.1170 Ops/s $\color{#d91a1a}-1.50\%$
test_a2c_speed[True-None] 10.2261ms 3.8347ms 260.7773 Ops/s 264.7277 Ops/s $\color{#d91a1a}-1.49\%$
test_a2c_speed[True-backward] 9.1919ms 8.6684ms 115.3617 Ops/s 115.4291 Ops/s $\color{#d91a1a}-0.06\%$
test_a2c_speed[reduce-overhead-None] 4.1549ms 3.7041ms 269.9711 Ops/s 273.4081 Ops/s $\color{#d91a1a}-1.26\%$
test_a2c_speed[reduce-overhead-backward] 9.1054ms 8.7752ms 113.9569 Ops/s 110.5243 Ops/s $\color{#35bf28}+3.11\%$
test_ppo_speed[False-None] 6.1331ms 5.8025ms 172.3382 Ops/s 171.7193 Ops/s $\color{#35bf28}+0.36\%$
test_ppo_speed[False-backward] 12.5725ms 12.2550ms 81.5992 Ops/s 80.4002 Ops/s $\color{#35bf28}+1.49\%$
test_ppo_speed[True-None] 3.9873ms 3.6472ms 274.1796 Ops/s 268.6043 Ops/s $\color{#35bf28}+2.08\%$
test_ppo_speed[True-backward] 8.4996ms 8.3763ms 119.3842 Ops/s 118.7963 Ops/s $\color{#35bf28}+0.49\%$
test_ppo_speed[reduce-overhead-None] 3.7917ms 3.6528ms 273.7616 Ops/s 275.5539 Ops/s $\color{#d91a1a}-0.65\%$
test_ppo_speed[reduce-overhead-backward] 8.8301ms 8.6603ms 115.4698 Ops/s 113.0661 Ops/s $\color{#35bf28}+2.13\%$
test_reinforce_speed[False-None] 4.8652ms 4.5685ms 218.8917 Ops/s 221.8449 Ops/s $\color{#d91a1a}-1.33\%$
test_reinforce_speed[False-backward] 7.5354ms 7.3727ms 135.6361 Ops/s 136.5153 Ops/s $\color{#d91a1a}-0.64\%$
test_reinforce_speed[True-None] 3.2175ms 2.8710ms 348.3069 Ops/s 349.9574 Ops/s $\color{#d91a1a}-0.47\%$
test_reinforce_speed[True-backward] 8.0249ms 7.6734ms 130.3202 Ops/s 111.6169 Ops/s $\textbf{\color{#35bf28}+16.76\%}$
test_reinforce_speed[reduce-overhead-None] 3.3140ms 2.8383ms 352.3216 Ops/s 344.9005 Ops/s $\color{#35bf28}+2.15\%$
test_reinforce_speed[reduce-overhead-backward] 8.3764ms 7.9070ms 126.4710 Ops/s 117.1352 Ops/s $\textbf{\color{#35bf28}+7.97\%}$
test_iql_speed[False-None] 24.3495ms 19.9905ms 50.0237 Ops/s 50.8856 Ops/s $\color{#d91a1a}-1.69\%$
test_iql_speed[False-backward] 36.4518ms 30.3019ms 33.0012 Ops/s 33.5647 Ops/s $\color{#d91a1a}-1.68\%$
test_iql_speed[True-None] 9.1240ms 8.4959ms 117.7037 Ops/s 118.2415 Ops/s $\color{#d91a1a}-0.45\%$
test_iql_speed[True-backward] 17.3435ms 16.6934ms 59.9039 Ops/s 60.1018 Ops/s $\color{#d91a1a}-0.33\%$
test_iql_speed[reduce-overhead-None] 8.7510ms 8.4980ms 117.6754 Ops/s 107.6682 Ops/s $\textbf{\color{#35bf28}+9.29\%}$
test_iql_speed[reduce-overhead-backward] 17.5467ms 17.1002ms 58.4789 Ops/s 59.1008 Ops/s $\color{#d91a1a}-1.05\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.4590ms 5.9682ms 167.5541 Ops/s 165.7576 Ops/s $\color{#35bf28}+1.08\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5538ms 0.3235ms 3.0912 KOps/s 2.8542 KOps/s $\textbf{\color{#35bf28}+8.30\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6178ms 0.3104ms 3.2222 KOps/s 2.9365 KOps/s $\textbf{\color{#35bf28}+9.73\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.9333ms 5.6978ms 175.5054 Ops/s 176.7028 Ops/s $\color{#d91a1a}-0.68\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.2912ms 0.3013ms 3.3185 KOps/s 2.9375 KOps/s $\textbf{\color{#35bf28}+12.97\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5612ms 0.2878ms 3.4745 KOps/s 3.3030 KOps/s $\textbf{\color{#35bf28}+5.19\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5158ms 1.2782ms 782.3292 Ops/s 749.7888 Ops/s $\color{#35bf28}+4.34\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6724ms 1.2001ms 833.2423 Ops/s 797.4115 Ops/s $\color{#35bf28}+4.49\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.9781ms 5.8377ms 171.3009 Ops/s 168.8351 Ops/s $\color{#35bf28}+1.46\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1994ms 0.4413ms 2.2658 KOps/s 2.2233 KOps/s $\color{#35bf28}+1.91\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6507ms 0.4218ms 2.3708 KOps/s 2.2623 KOps/s $\color{#35bf28}+4.80\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.7897ms 5.6871ms 175.8372 Ops/s 174.3466 Ops/s $\color{#35bf28}+0.86\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0227ms 0.3359ms 2.9774 KOps/s 3.3739 KOps/s $\textbf{\color{#d91a1a}-11.75\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4810ms 0.3063ms 3.2647 KOps/s 3.8963 KOps/s $\textbf{\color{#d91a1a}-16.21\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.9042ms 5.6101ms 178.2489 Ops/s 174.4078 Ops/s $\color{#35bf28}+2.20\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.8191ms 0.3568ms 2.8024 KOps/s 3.1401 KOps/s $\textbf{\color{#d91a1a}-10.75\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7239ms 0.3435ms 2.9112 KOps/s 3.0542 KOps/s $\color{#d91a1a}-4.68\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.9545ms 5.7526ms 173.8344 Ops/s 169.6308 Ops/s $\color{#35bf28}+2.48\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.0764ms 0.4292ms 2.3298 KOps/s 2.1664 KOps/s $\textbf{\color{#35bf28}+7.54\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6358ms 0.4616ms 2.1662 KOps/s 2.2694 KOps/s $\color{#d91a1a}-4.55\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.4820s 14.7730ms 67.6911 Ops/s 194.8661 Ops/s $\textbf{\color{#d91a1a}-65.26\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 10.9642ms 2.0922ms 477.9684 Ops/s 491.5540 Ops/s $\color{#d91a1a}-2.76\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 3.6586ms 1.1314ms 883.8477 Ops/s 860.0210 Ops/s $\color{#35bf28}+2.77\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 9.4670ms 5.3788ms 185.9146 Ops/s 194.6674 Ops/s $\color{#d91a1a}-4.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.2556ms 2.0725ms 482.5155 Ops/s 485.7040 Ops/s $\color{#d91a1a}-0.66\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 9.0218ms 1.2159ms 822.4447 Ops/s 929.5950 Ops/s $\textbf{\color{#d91a1a}-11.53\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.4205s 13.8699ms 72.0987 Ops/s 58.3586 Ops/s $\textbf{\color{#35bf28}+23.54\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.9987ms 2.1884ms 456.9628 Ops/s 548.8742 Ops/s $\textbf{\color{#d91a1a}-16.75\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.9829ms 1.3398ms 746.3811 Ops/s 748.5814 Ops/s $\color{#d91a1a}-0.29\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 36.1873ms 33.0369ms 30.2692 Ops/s 30.6723 Ops/s $\color{#d91a1a}-1.31\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.2006ms 17.6896ms 56.5303 Ops/s 59.1565 Ops/s $\color{#d91a1a}-4.44\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 35.6678ms 33.4067ms 29.9341 Ops/s 29.5453 Ops/s $\color{#35bf28}+1.32\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.7253ms 18.0773ms 55.3180 Ops/s 57.9243 Ops/s $\color{#d91a1a}-4.50\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 40.2273ms 35.0286ms 28.5481 Ops/s 28.0358 Ops/s $\color{#35bf28}+1.83\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.5450ms 18.8237ms 53.1246 Ops/s 53.1852 Ops/s $\color{#d91a1a}-0.11\%$

@vmoens
Update
95a8461 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
571142f 
ghstack-source-id: bdeddbc
Pull-Request: #3231
@vmoens
Update
e9d8d3b 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
928035c 
ghstack-source-id: fe5682e
Pull-Request: #3231
@vmoens
Update
54917c1 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
43bafa3 
ghstack-source-id: 5925d2b
Pull-Request: #3231
@vmoens
Update
518898f 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
2c6e7df 
ghstack-source-id: 5747424
Pull-Request: #3231
@vmoens vmoens mentioned this pull request Nov 6, 2025
Merged
@vmoens
Update
28076ff 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
66c6777 
ghstack-source-id: 5eb6796
Pull-Request: #3231
@vmoens
Update
11a1012 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
a6e2ccd 
ghstack-source-id: 117aa76
Pull-Request: #3231
@vmoens vmoens added documentation Improvements or additions to documentation major major refactoring in the code base labels Nov 6, 2025
vmoens added a commit that referenced this pull request Nov 6, 2025
@vmoens
[Doc] Huge doc refactoring
3d5dd1a 
ghstack-source-id: 117aa76
Pull-Request: #3231
@vmoens vmoens merged commit 11a1012 into gh/vmoens/173/base Nov 6, 2025
50 of 61 checks passed
@vmoens vmoens deleted the gh/vmoens/173/head branch November 6, 2025 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation major major refactoring in the code base

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens