Skip to content

[Feature] Documentation #3192

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 18 commits into
base: gh/vmoens/155/base
Choose a base branch
from
Open

[Feature] Documentation #3192

wants to merge 18 commits into from

Conversation

vmoens
Copy link
Collaborator

@vmoens vmoens commented Oct 14, 2025 •
edited
Loading

@vmoens
Update
e9756e2 
[ghstack-poisoned]
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Oct 14, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3192

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 6 New Failures, 1 Pending, 9 Unrelated Failures

As of commit 36b0936 with merge base e7ec9c3 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Oct 14, 2025
@vmoens
[Feature] Documentation
1776f5c 
ghstack-source-id: 82ba745
Pull-Request: #3192
This was referenced Oct 14, 2025
Merged
Merged
Merged
Merged
Merged
Open
Open
Open
Open
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 14, 2025
@vmoens
Update
0915502 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 16, 2025
@vmoens
[Feature] Documentation
39e1f41 
ghstack-source-id: 9bec4ff
Pull-Request: #3192
@vmoens
Update
c69220c 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
182f9c2 
ghstack-source-id: d0d0cf5
Pull-Request: #3192
@vmoens
Update
f329065 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
352ef18 
ghstack-source-id: 6cb0086
Pull-Request: #3192
@vmoens
Update
b6640d4 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
4a27b91 
ghstack-source-id: f17f26c
Pull-Request: #3192
@vmoens
Update
dced4a7 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
69220a8 
ghstack-source-id: 6683361
Pull-Request: #3192
@vmoens
Update
49733a8 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 18, 2025
@vmoens
[Feature] Documentation
107ab58 
ghstack-source-id: bb9f0e2
Pull-Request: #3192
@vmoens
Update
e4ef881 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Oct 18, 2025
Open
vmoens added 3 commits October 18, 2025 16:15
@vmoens
Update
ba7d03f 
[ghstack-poisoned]
@vmoens
Update
936b651 
[ghstack-poisoned]
@vmoens
Update
c4b7847 
[ghstack-poisoned]
vmoens added 2 commits October 19, 2025 17:03
@vmoens
Update
60f0310 
[ghstack-poisoned]
@vmoens
Update
8dfc00b 
[ghstack-poisoned]
@vmoens vmoens added the documentation Improvements or additions to documentation label Oct 20, 2025
@vmoens
Update
69be737 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Oct 20, 2025
Merged
@vmoens
Update
cd8aed5 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Oct 20, 2025
Open
@vmoens
Update
88e5ca9 
[ghstack-poisoned]
@github-actions GitHub Actions
Copy link

github-actions bot commented Oct 20, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}26$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 80.3675μs 78.7934μs 12.6914 KOps/s 12.4356 KOps/s $\color{#35bf28}+2.06\%$
test_tensor_to_bytestream_speed[torch.save] 0.1378ms 0.1367ms 7.3175 KOps/s 7.3065 KOps/s $\color{#35bf28}+0.15\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1111s 0.1108s 9.0217 Ops/s 8.9149 Ops/s $\color{#35bf28}+1.20\%$
test_tensor_to_bytestream_speed[numpy] 2.8569μs 2.8534μs 350.4631 KOps/s 347.0199 KOps/s $\color{#35bf28}+0.99\%$
test_tensor_to_bytestream_speed[safetensors] 41.0827μs 40.9073μs 24.4455 KOps/s 24.0510 KOps/s $\color{#35bf28}+1.64\%$
test_simple 0.5409s 0.5392s 1.8546 Ops/s 1.7811 Ops/s $\color{#35bf28}+4.13\%$
test_transformed 1.2136s 1.1159s 0.8961 Ops/s 0.8984 Ops/s $\color{#d91a1a}-0.25\%$
test_serial 1.6333s 1.6276s 0.6144 Ops/s 0.6024 Ops/s $\color{#35bf28}+2.00\%$
test_parallel 1.1645s 1.0762s 0.9292 Ops/s 0.9255 Ops/s $\color{#35bf28}+0.40\%$
test_step_mdp_speed[True-True-True-True-True] 0.1397ms 42.7762μs 23.3775 KOps/s 22.5557 KOps/s $\color{#35bf28}+3.64\%$
test_step_mdp_speed[True-True-True-True-False] 0.4309ms 24.4268μs 40.9387 KOps/s 40.0936 KOps/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[True-True-True-False-True] 0.4358ms 24.4256μs 40.9407 KOps/s 40.5912 KOps/s $\color{#35bf28}+0.86\%$
test_step_mdp_speed[True-True-True-False-False] 45.9310μs 13.4039μs 74.6051 KOps/s 73.6979 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-False-True-True] 0.4611ms 46.2705μs 21.6120 KOps/s 21.2517 KOps/s $\color{#35bf28}+1.70\%$
test_step_mdp_speed[True-True-False-True-False] 0.4323ms 27.0426μs 36.9786 KOps/s 37.4155 KOps/s $\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-True-False-False-True] 0.4344ms 26.7234μs 37.4204 KOps/s 36.8291 KOps/s $\color{#35bf28}+1.61\%$
test_step_mdp_speed[True-True-False-False-False] 66.5710μs 16.1912μs 61.7618 KOps/s 62.1195 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[True-False-True-True-True] 0.4502ms 49.1065μs 20.3639 KOps/s 20.4789 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[True-False-True-True-False] 0.4389ms 30.1369μs 33.1819 KOps/s 33.6490 KOps/s $\color{#d91a1a}-1.39\%$
test_step_mdp_speed[True-False-True-False-True] 68.7910μs 27.3102μs 36.6164 KOps/s 35.8061 KOps/s $\color{#35bf28}+2.26\%$
test_step_mdp_speed[True-False-True-False-False] 0.4322ms 16.4635μs 60.7403 KOps/s 61.3664 KOps/s $\color{#d91a1a}-1.02\%$
test_step_mdp_speed[True-False-False-True-True] 0.4549ms 52.0257μs 19.2213 KOps/s 19.2582 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-False-False-True-False] 0.4395ms 33.2287μs 30.0944 KOps/s 30.8057 KOps/s $\color{#d91a1a}-2.31\%$
test_step_mdp_speed[True-False-False-False-True] 0.4312ms 30.0346μs 33.2950 KOps/s 33.4847 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-False-False-False-False] 69.0720μs 18.9503μs 52.7696 KOps/s 53.4612 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[False-True-True-True-True] 0.4585ms 48.6187μs 20.5682 KOps/s 20.2688 KOps/s $\color{#35bf28}+1.48\%$
test_step_mdp_speed[False-True-True-True-False] 0.4341ms 29.8015μs 33.5553 KOps/s 34.0252 KOps/s $\color{#d91a1a}-1.38\%$
test_step_mdp_speed[False-True-True-False-True] 2.4463ms 31.5305μs 31.7154 KOps/s 31.5387 KOps/s $\color{#35bf28}+0.56\%$
test_step_mdp_speed[False-True-True-False-False] 52.3810μs 18.1492μs 55.0989 KOps/s 56.3045 KOps/s $\color{#d91a1a}-2.14\%$
test_step_mdp_speed[False-True-False-True-True] 0.4679ms 53.3834μs 18.7324 KOps/s 19.2356 KOps/s $\color{#d91a1a}-2.62\%$
test_step_mdp_speed[False-True-False-True-False] 0.4404ms 32.4987μs 30.7704 KOps/s 31.1576 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[False-True-False-False-True] 0.4412ms 33.7875μs 29.5967 KOps/s 29.9382 KOps/s $\color{#d91a1a}-1.14\%$
test_step_mdp_speed[False-True-False-False-False] 53.6710μs 20.6977μs 48.3145 KOps/s 49.6353 KOps/s $\color{#d91a1a}-2.66\%$
test_step_mdp_speed[False-False-True-True-True] 0.4643ms 55.4153μs 18.0455 KOps/s 18.5943 KOps/s $\color{#d91a1a}-2.95\%$
test_step_mdp_speed[False-False-True-True-False] 0.4405ms 35.2639μs 28.3576 KOps/s 28.6040 KOps/s $\color{#d91a1a}-0.86\%$
test_step_mdp_speed[False-False-True-False-True] 0.4491ms 34.2621μs 29.1868 KOps/s 29.7786 KOps/s $\color{#d91a1a}-1.99\%$
test_step_mdp_speed[False-False-True-False-False] 55.5110μs 20.4533μs 48.8918 KOps/s 49.4255 KOps/s $\color{#d91a1a}-1.08\%$
test_step_mdp_speed[False-False-False-True-True] 0.4642ms 56.7350μs 17.6258 KOps/s 17.7051 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[False-False-False-True-False] 0.4349ms 37.6421μs 26.5660 KOps/s 26.9190 KOps/s $\color{#d91a1a}-1.31\%$
test_step_mdp_speed[False-False-False-False-True] 0.4487ms 35.9104μs 27.8471 KOps/s 28.2515 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[False-False-False-False-False] 0.4212ms 22.8327μs 43.7967 KOps/s 44.1158 KOps/s $\color{#d91a1a}-0.72\%$
test_values[generalized_advantage_estimate-True-True] 10.2230ms 10.0003ms 99.9967 Ops/s 99.5592 Ops/s $\color{#35bf28}+0.44\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.4358ms 17.4773ms 57.2171 Ops/s 56.2140 Ops/s $\color{#35bf28}+1.78\%$
test_values[td0_return_estimate-False-False] 0.2106ms 0.1304ms 7.6670 KOps/s 7.9631 KOps/s $\color{#d91a1a}-3.72\%$
test_values[td1_return_estimate-False-False] 27.5784ms 27.1449ms 36.8394 Ops/s 37.3932 Ops/s $\color{#d91a1a}-1.48\%$
test_values[vec_td1_return_estimate-False-False] 18.1703ms 17.6172ms 56.7626 Ops/s 56.7800 Ops/s $\color{#d91a1a}-0.03\%$
test_values[td_lambda_return_estimate-True-False] 40.7573ms 40.1379ms 24.9141 Ops/s 24.9801 Ops/s $\color{#d91a1a}-0.26\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.1338ms 17.5631ms 56.9376 Ops/s 55.9312 Ops/s $\color{#35bf28}+1.80\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.0241ms 8.4019ms 119.0208 Ops/s 119.6426 Ops/s $\color{#d91a1a}-0.52\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7295ms 1.5126ms 661.0940 Ops/s 661.4397 Ops/s $\color{#d91a1a}-0.05\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8442ms 0.4111ms 2.4323 KOps/s 2.4173 KOps/s $\color{#35bf28}+0.62\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.8701ms 32.1141ms 31.1389 Ops/s 28.5812 Ops/s $\textbf{\color{#35bf28}+8.95\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1702ms 1.7090ms 585.1336 Ops/s 578.1109 Ops/s $\color{#35bf28}+1.21\%$
test_dqn_speed[False-None] 1.8190ms 1.3946ms 717.0651 Ops/s 709.4722 Ops/s $\color{#35bf28}+1.07\%$
test_dqn_speed[False-backward] 2.0738ms 1.9236ms 519.8670 Ops/s 520.4596 Ops/s $\color{#d91a1a}-0.11\%$
test_dqn_speed[True-None] 0.9205ms 0.5168ms 1.9351 KOps/s 1.8842 KOps/s $\color{#35bf28}+2.70\%$
test_dqn_speed[True-backward] 0.9948ms 0.9614ms 1.0401 KOps/s 854.3513 Ops/s $\textbf{\color{#35bf28}+21.74\%}$
test_dqn_speed[reduce-overhead-None] 0.8153ms 0.5168ms 1.9350 KOps/s 1.8715 KOps/s $\color{#35bf28}+3.40\%$
test_dqn_speed[reduce-overhead-backward] 0.9854ms 0.9528ms 1.0496 KOps/s 1.0056 KOps/s $\color{#35bf28}+4.37\%$
test_ddpg_speed[False-None] 3.4116ms 2.8758ms 347.7307 Ops/s 351.0501 Ops/s $\color{#d91a1a}-0.95\%$
test_ddpg_speed[False-backward] 4.1642ms 4.0742ms 245.4447 Ops/s 244.3321 Ops/s $\color{#35bf28}+0.46\%$
test_ddpg_speed[True-None] 1.8062ms 1.4147ms 706.8662 Ops/s 694.6747 Ops/s $\color{#35bf28}+1.75\%$
test_ddpg_speed[True-backward] 2.4499ms 2.4122ms 414.5535 Ops/s 405.8465 Ops/s $\color{#35bf28}+2.15\%$
test_ddpg_speed[reduce-overhead-None] 1.7940ms 1.4212ms 703.6334 Ops/s 705.4903 Ops/s $\color{#d91a1a}-0.26\%$
test_ddpg_speed[reduce-overhead-backward] 2.4512ms 2.3939ms 417.7335 Ops/s 402.5554 Ops/s $\color{#35bf28}+3.77\%$
test_sac_speed[False-None] 8.4043ms 7.9027ms 126.5389 Ops/s 127.7028 Ops/s $\color{#d91a1a}-0.91\%$
test_sac_speed[False-backward] 11.6376ms 11.1889ms 89.3745 Ops/s 89.6586 Ops/s $\color{#d91a1a}-0.32\%$
test_sac_speed[True-None] 2.4403ms 2.1597ms 463.0349 Ops/s 450.2438 Ops/s $\color{#35bf28}+2.84\%$
test_sac_speed[True-backward] 4.2524ms 4.0653ms 245.9825 Ops/s 239.2224 Ops/s $\color{#35bf28}+2.83\%$
test_sac_speed[reduce-overhead-None] 2.5522ms 2.1451ms 466.1815 Ops/s 454.2636 Ops/s $\color{#35bf28}+2.62\%$
test_sac_speed[reduce-overhead-backward] 4.3935ms 4.1297ms 242.1484 Ops/s 237.9315 Ops/s $\color{#35bf28}+1.77\%$
test_redq_speed[False-None] 16.3019ms 12.0152ms 83.2277 Ops/s 92.9343 Ops/s $\textbf{\color{#d91a1a}-10.44\%}$
test_redq_speed[False-backward] 25.6394ms 19.1418ms 52.2418 Ops/s 54.6439 Ops/s $\color{#d91a1a}-4.40\%$
test_redq_speed[True-None] 4.8351ms 4.4483ms 224.8073 Ops/s 225.1123 Ops/s $\color{#d91a1a}-0.14\%$
test_redq_speed[True-backward] 10.5339ms 10.1018ms 98.9923 Ops/s 97.8230 Ops/s $\color{#35bf28}+1.20\%$
test_redq_speed[reduce-overhead-None] 4.7190ms 4.5201ms 221.2322 Ops/s 226.6720 Ops/s $\color{#d91a1a}-2.40\%$
test_redq_speed[reduce-overhead-backward] 10.7811ms 10.3859ms 96.2840 Ops/s 99.5173 Ops/s $\color{#d91a1a}-3.25\%$
test_redq_deprec_speed[False-None] 11.5838ms 11.1453ms 89.7235 Ops/s 89.8800 Ops/s $\color{#d91a1a}-0.17\%$
test_redq_deprec_speed[False-backward] 16.6001ms 16.0593ms 62.2693 Ops/s 61.7557 Ops/s $\color{#35bf28}+0.83\%$
test_redq_deprec_speed[True-None] 4.0497ms 3.6985ms 270.3787 Ops/s 257.9234 Ops/s $\color{#35bf28}+4.83\%$
test_redq_deprec_speed[True-backward] 8.3655ms 7.8024ms 128.1659 Ops/s 116.7213 Ops/s $\textbf{\color{#35bf28}+9.81\%}$
test_redq_deprec_speed[reduce-overhead-None] 4.0165ms 3.7384ms 267.4964 Ops/s 252.5718 Ops/s $\textbf{\color{#35bf28}+5.91\%}$
test_redq_deprec_speed[reduce-overhead-backward] 7.9893ms 7.7642ms 128.7957 Ops/s 127.5675 Ops/s $\color{#35bf28}+0.96\%$
test_td3_speed[False-None] 7.9609ms 7.8716ms 127.0389 Ops/s 127.0143 Ops/s $\color{#35bf28}+0.02\%$
test_td3_speed[False-backward] 11.4805ms 10.8805ms 91.9073 Ops/s 92.9259 Ops/s $\color{#d91a1a}-1.10\%$
test_td3_speed[True-None] 1.9372ms 1.8732ms 533.8445 Ops/s 523.8916 Ops/s $\color{#35bf28}+1.90\%$
test_td3_speed[True-backward] 3.9549ms 3.7468ms 266.8977 Ops/s 249.7149 Ops/s $\textbf{\color{#35bf28}+6.88\%}$
test_td3_speed[reduce-overhead-None] 1.8132ms 1.7772ms 562.6771 Ops/s 539.5327 Ops/s $\color{#35bf28}+4.29\%$
test_td3_speed[reduce-overhead-backward] 3.8758ms 3.6644ms 272.8995 Ops/s 231.8260 Ops/s $\textbf{\color{#35bf28}+17.72\%}$
test_cql_speed[False-None] 28.6371ms 25.8399ms 38.6998 Ops/s 37.7697 Ops/s $\color{#35bf28}+2.46\%$
test_cql_speed[False-backward] 35.7608ms 35.0446ms 28.5351 Ops/s 27.4897 Ops/s $\color{#35bf28}+3.80\%$
test_cql_speed[True-None] 12.9058ms 12.5787ms 79.4994 Ops/s 77.4638 Ops/s $\color{#35bf28}+2.63\%$
test_cql_speed[True-backward] 19.7570ms 19.2652ms 51.9070 Ops/s 53.2637 Ops/s $\color{#d91a1a}-2.55\%$
test_cql_speed[reduce-overhead-None] 13.3523ms 12.8690ms 77.7064 Ops/s 65.2197 Ops/s $\textbf{\color{#35bf28}+19.15\%}$
test_cql_speed[reduce-overhead-backward] 19.4737ms 19.0589ms 52.4691 Ops/s 53.4799 Ops/s $\color{#d91a1a}-1.89\%$
test_a2c_speed[False-None] 5.8187ms 5.5081ms 181.5509 Ops/s 178.8583 Ops/s $\color{#35bf28}+1.51\%$
test_a2c_speed[False-backward] 12.3819ms 12.0419ms 83.0432 Ops/s 80.3045 Ops/s $\color{#35bf28}+3.41\%$
test_a2c_speed[True-None] 4.0132ms 3.7919ms 263.7172 Ops/s 262.4707 Ops/s $\color{#35bf28}+0.47\%$
test_a2c_speed[True-backward] 8.8889ms 8.7240ms 114.6266 Ops/s 113.5881 Ops/s $\color{#35bf28}+0.91\%$
test_a2c_speed[reduce-overhead-None] 4.0710ms 3.7813ms 264.4590 Ops/s 266.2896 Ops/s $\color{#d91a1a}-0.69\%$
test_a2c_speed[reduce-overhead-backward] 9.4096ms 9.1096ms 109.7745 Ops/s 102.8381 Ops/s $\textbf{\color{#35bf28}+6.74\%}$
test_ppo_speed[False-None] 6.3560ms 5.9943ms 166.8254 Ops/s 169.7701 Ops/s $\color{#d91a1a}-1.73\%$
test_ppo_speed[False-backward] 13.2814ms 12.9692ms 77.1059 Ops/s 80.2998 Ops/s $\color{#d91a1a}-3.98\%$
test_ppo_speed[True-None] 3.9939ms 3.7088ms 269.6295 Ops/s 271.4609 Ops/s $\color{#d91a1a}-0.67\%$
test_ppo_speed[True-backward] 9.3820ms 8.7070ms 114.8498 Ops/s 110.1693 Ops/s $\color{#35bf28}+4.25\%$
test_ppo_speed[reduce-overhead-None] 4.0135ms 3.7022ms 270.1105 Ops/s 269.4270 Ops/s $\color{#35bf28}+0.25\%$
test_ppo_speed[reduce-overhead-backward] 9.3898ms 8.9024ms 112.3292 Ops/s 107.0175 Ops/s $\color{#35bf28}+4.96\%$
test_reinforce_speed[False-None] 5.0885ms 4.6694ms 214.1586 Ops/s 211.6136 Ops/s $\color{#35bf28}+1.20\%$
test_reinforce_speed[False-backward] 7.8334ms 7.5241ms 132.9064 Ops/s 131.1021 Ops/s $\color{#35bf28}+1.38\%$
test_reinforce_speed[True-None] 3.3054ms 2.9449ms 339.5666 Ops/s 304.2734 Ops/s $\textbf{\color{#35bf28}+11.60\%}$
test_reinforce_speed[True-backward] 8.4793ms 7.9225ms 126.2227 Ops/s 120.8894 Ops/s $\color{#35bf28}+4.41\%$
test_reinforce_speed[reduce-overhead-None] 3.3363ms 2.9275ms 341.5869 Ops/s 342.3213 Ops/s $\color{#d91a1a}-0.21\%$
test_reinforce_speed[reduce-overhead-backward] 8.3860ms 8.0377ms 124.4132 Ops/s 111.0368 Ops/s $\textbf{\color{#35bf28}+12.05\%}$
test_iql_speed[False-None] 21.1250ms 20.3672ms 49.0986 Ops/s 45.7974 Ops/s $\textbf{\color{#35bf28}+7.21\%}$
test_iql_speed[False-backward] 37.1002ms 31.5528ms 31.6929 Ops/s 30.8625 Ops/s $\color{#35bf28}+2.69\%$
test_iql_speed[True-None] 10.3966ms 8.8411ms 113.1085 Ops/s 111.9061 Ops/s $\color{#35bf28}+1.07\%$
test_iql_speed[True-backward] 17.5078ms 16.8892ms 59.2093 Ops/s 57.3118 Ops/s $\color{#35bf28}+3.31\%$
test_iql_speed[reduce-overhead-None] 8.9116ms 8.5455ms 117.0210 Ops/s 110.4293 Ops/s $\textbf{\color{#35bf28}+5.97\%}$
test_iql_speed[reduce-overhead-backward] 17.7485ms 17.2520ms 57.9644 Ops/s 55.6450 Ops/s $\color{#35bf28}+4.17\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.2969ms 5.8051ms 172.2637 Ops/s 174.3446 Ops/s $\color{#d91a1a}-1.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5519ms 0.2883ms 3.4685 KOps/s 3.4978 KOps/s $\color{#d91a1a}-0.84\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6478ms 0.3555ms 2.8126 KOps/s 3.2549 KOps/s $\textbf{\color{#d91a1a}-13.59\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.9789ms 5.6084ms 178.3039 Ops/s 182.8007 Ops/s $\color{#d91a1a}-2.46\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8358ms 0.2752ms 3.6332 KOps/s 3.2368 KOps/s $\textbf{\color{#35bf28}+12.25\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5060ms 0.2564ms 3.8998 KOps/s 2.9950 KOps/s $\textbf{\color{#35bf28}+30.21\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5893ms 1.2543ms 797.2698 Ops/s 800.2239 Ops/s $\color{#d91a1a}-0.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4050ms 1.1714ms 853.6650 Ops/s 851.7329 Ops/s $\color{#35bf28}+0.23\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.6259ms 5.8870ms 169.8649 Ops/s 177.3305 Ops/s $\color{#d91a1a}-4.21\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8299ms 0.4961ms 2.0157 KOps/s 1.9810 KOps/s $\color{#35bf28}+1.75\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6656ms 0.4239ms 2.3589 KOps/s 1.9147 KOps/s $\textbf{\color{#35bf28}+23.20\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.6159ms 5.5267ms 180.9404 Ops/s 179.8603 Ops/s $\color{#35bf28}+0.60\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.4656ms 0.3583ms 2.7910 KOps/s 2.6908 KOps/s $\color{#35bf28}+3.72\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5349ms 0.3260ms 3.0671 KOps/s 2.8005 KOps/s $\textbf{\color{#35bf28}+9.52\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.6669ms 5.4546ms 183.3308 Ops/s 178.2625 Ops/s $\color{#35bf28}+2.84\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.0252ms 0.2829ms 3.5352 KOps/s 2.7272 KOps/s $\textbf{\color{#35bf28}+29.63\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4828ms 0.2616ms 3.8225 KOps/s 2.9270 KOps/s $\textbf{\color{#35bf28}+30.59\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.7735ms 5.6908ms 175.7231 Ops/s 173.2920 Ops/s $\color{#35bf28}+1.40\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.2550ms 0.4348ms 2.3001 KOps/s 1.9286 KOps/s $\textbf{\color{#35bf28}+19.27\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6503ms 0.4125ms 2.4240 KOps/s 2.0142 KOps/s $\textbf{\color{#35bf28}+20.35\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.5768ms 4.9937ms 200.2509 Ops/s 190.6306 Ops/s $\textbf{\color{#35bf28}+5.05\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.0830ms 2.2834ms 437.9501 Ops/s 435.8751 Ops/s $\color{#35bf28}+0.48\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.5412ms 1.1829ms 845.3661 Ops/s 837.6454 Ops/s $\color{#35bf28}+0.92\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.5377s 15.6780ms 63.7835 Ops/s 52.5946 Ops/s $\textbf{\color{#35bf28}+21.27\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 10.4961ms 2.1462ms 465.9295 Ops/s 514.7640 Ops/s $\textbf{\color{#d91a1a}-9.49\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.2509ms 1.0767ms 928.7841 Ops/s 829.6546 Ops/s $\textbf{\color{#35bf28}+11.95\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.8118ms 5.2115ms 191.8850 Ops/s 181.6262 Ops/s $\textbf{\color{#35bf28}+5.65\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 7.6604ms 2.1390ms 467.5037 Ops/s 454.4534 Ops/s $\color{#35bf28}+2.87\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 3.6052ms 1.0708ms 933.8694 Ops/s 730.6953 Ops/s $\textbf{\color{#35bf28}+27.81\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 34.6931ms 32.2318ms 31.0253 Ops/s 30.8154 Ops/s $\color{#35bf28}+0.68\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.6307ms 17.2526ms 57.9622 Ops/s 57.4715 Ops/s $\color{#35bf28}+0.85\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 34.9448ms 32.7620ms 30.5232 Ops/s 29.7786 Ops/s $\color{#35bf28}+2.50\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 20.1601ms 17.6713ms 56.5888 Ops/s 56.5607 Ops/s $\color{#35bf28}+0.05\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 35.9639ms 34.2912ms 29.1620 Ops/s 28.7887 Ops/s $\color{#35bf28}+1.30\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 19.8541ms 18.7485ms 53.3375 Ops/s 31.9601 Ops/s $\textbf{\color{#35bf28}+66.89\%}$

vmoens added 2 commits October 19, 2025 20:56
@vmoens
Update
27c2dc6 
[ghstack-poisoned]
@vmoens
Update
36b0936 
[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens