[Doc] Fix tutos

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2772

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}16$. Worsened: $\large\color{#d91a1a}9$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_simple	0.6008s	0.5109s	1.9574 Ops/s	2.0857 Ops/s	$\textbf{\color{#d91a1a}-6.15\%}$
test_transformed	1.0833s	0.9852s	1.0151 Ops/s	1.0325 Ops/s	$\color{#d91a1a}-1.68\%$
test_serial	1.4951s	1.4924s	0.6701 Ops/s	0.6635 Ops/s	$\color{#35bf28}+0.98\%$
test_parallel	1.3810s	1.2792s	0.7817 Ops/s	0.7951 Ops/s	$\color{#d91a1a}-1.68\%$
test_step_mdp_speed[True-True-True-True-True]	0.2327ms	30.0051μs	33.3277 KOps/s	32.3170 KOps/s	$\color{#35bf28}+3.13\%$
test_step_mdp_speed[True-True-True-True-False]	45.8160μs	17.7134μs	56.4544 KOps/s	55.6688 KOps/s	$\color{#35bf28}+1.41\%$
test_step_mdp_speed[True-True-True-False-True]	52.7180μs	16.9336μs	59.0540 KOps/s	56.8745 KOps/s	$\color{#35bf28}+3.83\%$
test_step_mdp_speed[True-True-True-False-False]	33.4020μs	9.8963μs	101.0483 KOps/s	99.4844 KOps/s	$\color{#35bf28}+1.57\%$
test_step_mdp_speed[True-True-False-True-True]	61.4950μs	31.8562μs	31.3910 KOps/s	30.3820 KOps/s	$\color{#35bf28}+3.32\%$
test_step_mdp_speed[True-True-False-True-False]	52.6580μs	19.7310μs	50.6816 KOps/s	50.5857 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-True-False-False-True]	48.1490μs	18.9024μs	52.9033 KOps/s	51.6025 KOps/s	$\color{#35bf28}+2.52\%$
test_step_mdp_speed[True-True-False-False-False]	43.1200μs	11.9086μs	83.9730 KOps/s	83.8086 KOps/s	$\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-False-True-True-True]	0.6243ms	34.1171μs	29.3109 KOps/s	28.6409 KOps/s	$\color{#35bf28}+2.34\%$
test_step_mdp_speed[True-False-True-True-False]	49.4220μs	21.4145μs	46.6974 KOps/s	45.8860 KOps/s	$\color{#35bf28}+1.77\%$
test_step_mdp_speed[True-False-True-False-True]	46.6070μs	18.8594μs	53.0239 KOps/s	51.3491 KOps/s	$\color{#35bf28}+3.26\%$
test_step_mdp_speed[True-False-True-False-False]	0.1774ms	12.1877μs	82.0497 KOps/s	83.5288 KOps/s	$\color{#d91a1a}-1.77\%$
test_step_mdp_speed[True-False-False-True-True]	0.3320ms	36.8811μs	27.1142 KOps/s	27.3187 KOps/s	$\color{#d91a1a}-0.75\%$
test_step_mdp_speed[True-False-False-True-False]	51.9470μs	23.5109μs	42.5335 KOps/s	42.6014 KOps/s	$\color{#d91a1a}-0.16\%$
test_step_mdp_speed[True-False-False-False-True]	63.1370μs	20.6157μs	48.5068 KOps/s	47.5421 KOps/s	$\color{#35bf28}+2.03\%$
test_step_mdp_speed[True-False-False-False-False]	43.0110μs	13.6734μs	73.1348 KOps/s	72.4660 KOps/s	$\color{#35bf28}+0.92\%$
test_step_mdp_speed[False-True-True-True-True]	66.2840μs	34.0579μs	29.3618 KOps/s	28.8954 KOps/s	$\color{#35bf28}+1.61\%$
test_step_mdp_speed[False-True-True-True-False]	68.1170μs	21.6204μs	46.2526 KOps/s	45.8899 KOps/s	$\color{#35bf28}+0.79\%$
test_step_mdp_speed[False-True-True-False-True]	0.1572ms	21.5877μs	46.3227 KOps/s	45.2568 KOps/s	$\color{#35bf28}+2.36\%$
test_step_mdp_speed[False-True-True-False-False]	37.8000μs	13.2044μs	75.7326 KOps/s	75.2748 KOps/s	$\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-True-False-True-True]	73.0460μs	35.5197μs	28.1534 KOps/s	27.5661 KOps/s	$\color{#35bf28}+2.13\%$
test_step_mdp_speed[False-True-False-True-False]	62.7370μs	23.4505μs	42.6430 KOps/s	43.1707 KOps/s	$\color{#d91a1a}-1.22\%$
test_step_mdp_speed[False-True-False-False-True]	2.6290ms	23.2944μs	42.9287 KOps/s	41.6316 KOps/s	$\color{#35bf28}+3.12\%$
test_step_mdp_speed[False-True-False-False-False]	64.7710μs	15.1257μs	66.1129 KOps/s	66.3295 KOps/s	$\color{#d91a1a}-0.33\%$
test_step_mdp_speed[False-False-True-True-True]	0.6204ms	37.4396μs	26.7097 KOps/s	26.2914 KOps/s	$\color{#35bf28}+1.59\%$
test_step_mdp_speed[False-False-True-True-False]	67.4650μs	25.2748μs	39.5650 KOps/s	39.7502 KOps/s	$\color{#d91a1a}-0.47\%$
test_step_mdp_speed[False-False-True-False-True]	51.8260μs	22.9139μs	43.6417 KOps/s	41.4057 KOps/s	$\textbf{\color{#35bf28}+5.40\%}$
test_step_mdp_speed[False-False-True-False-False]	38.5920μs	14.8430μs	67.3718 KOps/s	65.7966 KOps/s	$\color{#35bf28}+2.39\%$
test_step_mdp_speed[False-False-False-True-True]	0.1005ms	38.6238μs	25.8908 KOps/s	25.1358 KOps/s	$\color{#35bf28}+3.00\%$
test_step_mdp_speed[False-False-False-True-False]	65.3020μs	26.7399μs	37.3974 KOps/s	37.3130 KOps/s	$\color{#35bf28}+0.23\%$
test_step_mdp_speed[False-False-False-False-True]	51.7560μs	24.7840μs	40.3487 KOps/s	39.3132 KOps/s	$\color{#35bf28}+2.63\%$
test_step_mdp_speed[False-False-False-False-False]	55.4230μs	16.5418μs	60.4528 KOps/s	59.6767 KOps/s	$\color{#35bf28}+1.30\%$
test_values[generalized_advantage_estimate-True-True]	10.1796ms	9.9509ms	100.4937 Ops/s	101.8653 Ops/s	$\color{#d91a1a}-1.35\%$
test_values[vec_generalized_advantage_estimate-True-True]	28.0857ms	26.0961ms	38.3199 Ops/s	41.1851 Ops/s	$\textbf{\color{#d91a1a}-6.96\%}$
test_values[td0_return_estimate-False-False]	0.2377ms	0.1840ms	5.4337 KOps/s	5.0289 KOps/s	$\textbf{\color{#35bf28}+8.05\%}$
test_values[td1_return_estimate-False-False]	28.3156ms	25.0857ms	39.8634 Ops/s	40.7432 Ops/s	$\color{#d91a1a}-2.16\%$
test_values[vec_td1_return_estimate-False-False]	40.4799ms	26.8689ms	37.2177 Ops/s	39.3209 Ops/s	$\textbf{\color{#d91a1a}-5.35\%}$
test_values[td_lambda_return_estimate-True-False]	43.7446ms	35.9139ms	27.8444 Ops/s	28.3332 Ops/s	$\color{#d91a1a}-1.73\%$
test_values[vec_td_lambda_return_estimate-True-False]	29.0819ms	26.3092ms	38.0095 Ops/s	40.8308 Ops/s	$\textbf{\color{#d91a1a}-6.91\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.5618ms	8.6900ms	115.0744 Ops/s	116.9973 Ops/s	$\color{#d91a1a}-1.64\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.1864ms	1.9066ms	524.4839 Ops/s	511.9052 Ops/s	$\color{#35bf28}+2.46\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.5907ms	0.3683ms	2.7152 KOps/s	2.7274 KOps/s	$\color{#d91a1a}-0.45\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	54.5467ms	44.6500ms	22.3964 Ops/s	24.6244 Ops/s	$\textbf{\color{#d91a1a}-9.05\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	4.3507ms	3.4366ms	290.9863 Ops/s	289.2291 Ops/s	$\color{#35bf28}+0.61\%$
test_dqn_speed[False-None]	2.0444ms	1.4122ms	708.1284 Ops/s	705.7767 Ops/s	$\color{#35bf28}+0.33\%$
test_dqn_speed[False-backward]	2.0325ms	1.8968ms	527.2074 Ops/s	532.6088 Ops/s	$\color{#d91a1a}-1.01\%$
test_dqn_speed[True-None]	0.1792s	0.5743ms	1.7412 KOps/s	1.9815 KOps/s	$\textbf{\color{#d91a1a}-12.12\%}$
test_dqn_speed[True-backward]	0.9634ms	0.9149ms	1.0930 KOps/s	1.1051 KOps/s	$\color{#d91a1a}-1.10\%$
test_dqn_speed[reduce-overhead-None]	0.8333ms	0.4828ms	2.0713 KOps/s	2.0839 KOps/s	$\color{#d91a1a}-0.60\%$
test_dqn_speed[reduce-overhead-backward]	0.9382ms	0.8950ms	1.1174 KOps/s	1.0820 KOps/s	$\color{#35bf28}+3.27\%$
test_ddpg_speed[False-None]	6.8860ms	2.9699ms	336.7167 Ops/s	344.4940 Ops/s	$\color{#d91a1a}-2.26\%$
test_ddpg_speed[False-backward]	4.2083ms	4.0434ms	247.3183 Ops/s	248.4576 Ops/s	$\color{#d91a1a}-0.46\%$
test_ddpg_speed[True-None]	1.7026ms	1.2398ms	806.5588 Ops/s	813.2491 Ops/s	$\color{#d91a1a}-0.82\%$
test_ddpg_speed[True-backward]	2.1942ms	2.1283ms	469.8681 Ops/s	463.6339 Ops/s	$\color{#35bf28}+1.34\%$
test_ddpg_speed[reduce-overhead-None]	1.7744ms	1.2315ms	812.0001 Ops/s	792.7472 Ops/s	$\color{#35bf28}+2.43\%$
test_ddpg_speed[reduce-overhead-backward]	2.2311ms	2.1466ms	465.8500 Ops/s	448.1398 Ops/s	$\color{#35bf28}+3.95\%$
test_sac_speed[False-None]	8.5812ms	8.0852ms	123.6824 Ops/s	120.4076 Ops/s	$\color{#35bf28}+2.72\%$
test_sac_speed[False-backward]	13.2715ms	10.8842ms	91.8761 Ops/s	90.2135 Ops/s	$\color{#35bf28}+1.84\%$
test_sac_speed[True-None]	3.0381ms	2.1143ms	472.9634 Ops/s	461.2141 Ops/s	$\color{#35bf28}+2.55\%$
test_sac_speed[True-backward]	4.1218ms	3.8255ms	261.4020 Ops/s	228.9398 Ops/s	$\textbf{\color{#35bf28}+14.18\%}$
test_sac_speed[reduce-overhead-None]	3.0342ms	2.1155ms	472.7074 Ops/s	459.9879 Ops/s	$\color{#35bf28}+2.77\%$
test_sac_speed[reduce-overhead-backward]	4.6083ms	3.8145ms	262.1564 Ops/s	245.8627 Ops/s	$\textbf{\color{#35bf28}+6.63\%}$
test_redq_speed[False-None]	14.1091ms	13.0679ms	76.5237 Ops/s	72.6159 Ops/s	$\textbf{\color{#35bf28}+5.38\%}$
test_redq_speed[False-backward]	32.0021ms	22.7303ms	43.9941 Ops/s	41.8968 Ops/s	$\textbf{\color{#35bf28}+5.01\%}$
test_redq_speed[True-None]	7.1220ms	5.1299ms	194.9338 Ops/s	170.0293 Ops/s	$\textbf{\color{#35bf28}+14.65\%}$
test_redq_speed[True-backward]	13.6869ms	12.8143ms	78.0380 Ops/s	73.4016 Ops/s	$\textbf{\color{#35bf28}+6.32\%}$
test_redq_speed[reduce-overhead-None]	6.9468ms	5.5349ms	180.6722 Ops/s	171.8785 Ops/s	$\textbf{\color{#35bf28}+5.12\%}$
test_redq_speed[reduce-overhead-backward]	14.2647ms	12.5924ms	79.4131 Ops/s	72.0424 Ops/s	$\textbf{\color{#35bf28}+10.23\%}$
test_redq_deprec_speed[False-None]	14.2366ms	13.1317ms	76.1516 Ops/s	71.8138 Ops/s	$\textbf{\color{#35bf28}+6.04\%}$
test_redq_deprec_speed[False-backward]	19.8766ms	19.0523ms	52.4871 Ops/s	51.1370 Ops/s	$\color{#35bf28}+2.64\%$
test_redq_deprec_speed[True-None]	4.8729ms	3.9847ms	250.9606 Ops/s	252.2241 Ops/s	$\color{#d91a1a}-0.50\%$
test_redq_deprec_speed[True-backward]	9.5117ms	8.7497ms	114.2895 Ops/s	106.4964 Ops/s	$\textbf{\color{#35bf28}+7.32\%}$
test_redq_deprec_speed[reduce-overhead-None]	4.9751ms	3.8969ms	256.6120 Ops/s	245.3478 Ops/s	$\color{#35bf28}+4.59\%$
test_redq_deprec_speed[reduce-overhead-backward]	8.9242ms	8.5192ms	117.3826 Ops/s	115.2105 Ops/s	$\color{#35bf28}+1.89\%$
test_td3_speed[False-None]	9.8859ms	8.0854ms	123.6802 Ops/s	119.1695 Ops/s	$\color{#35bf28}+3.79\%$
test_td3_speed[False-backward]	11.3566ms	10.5530ms	94.7600 Ops/s	91.6077 Ops/s	$\color{#35bf28}+3.44\%$
test_td3_speed[True-None]	1.9760ms	1.7878ms	559.3609 Ops/s	540.8492 Ops/s	$\color{#35bf28}+3.42\%$
test_td3_speed[True-backward]	3.8855ms	3.5285ms	283.4101 Ops/s	282.2893 Ops/s	$\color{#35bf28}+0.40\%$
test_td3_speed[reduce-overhead-None]	1.8689ms	1.7966ms	556.6163 Ops/s	539.1218 Ops/s	$\color{#35bf28}+3.25\%$
test_td3_speed[reduce-overhead-backward]	3.6833ms	3.5022ms	285.5357 Ops/s	287.7775 Ops/s	$\color{#d91a1a}-0.78\%$
test_cql_speed[False-None]	38.5723ms	36.7113ms	27.2396 Ops/s	27.2253 Ops/s	$\color{#35bf28}+0.05\%$
test_cql_speed[False-backward]	49.2035ms	46.7638ms	21.3841 Ops/s	20.9996 Ops/s	$\color{#35bf28}+1.83\%$
test_cql_speed[True-None]	17.4749ms	16.3364ms	61.2130 Ops/s	59.8810 Ops/s	$\color{#35bf28}+2.22\%$
test_cql_speed[True-backward]	44.6947ms	23.9190ms	41.8077 Ops/s	41.5367 Ops/s	$\color{#35bf28}+0.65\%$
test_cql_speed[reduce-overhead-None]	17.9927ms	16.2956ms	61.3661 Ops/s	60.6662 Ops/s	$\color{#35bf28}+1.15\%$
test_cql_speed[reduce-overhead-backward]	24.2399ms	22.9549ms	43.5636 Ops/s	42.0371 Ops/s	$\color{#35bf28}+3.63\%$
test_a2c_speed[False-None]	10.0052ms	7.3193ms	136.6253 Ops/s	131.1531 Ops/s	$\color{#35bf28}+4.17\%$
test_a2c_speed[False-backward]	15.1487ms	14.6187ms	68.4056 Ops/s	65.9349 Ops/s	$\color{#35bf28}+3.75\%$
test_a2c_speed[True-None]	4.1825ms	3.7360ms	267.6676 Ops/s	264.6460 Ops/s	$\color{#35bf28}+1.14\%$
test_a2c_speed[True-backward]	11.8305ms	10.7366ms	93.1396 Ops/s	96.2882 Ops/s	$\color{#d91a1a}-3.27\%$
test_a2c_speed[reduce-overhead-None]	4.7100ms	3.7471ms	266.8765 Ops/s	264.7873 Ops/s	$\color{#35bf28}+0.79\%$
test_a2c_speed[reduce-overhead-backward]	11.2495ms	10.3056ms	97.0349 Ops/s	95.9703 Ops/s	$\color{#35bf28}+1.11\%$
test_ppo_speed[False-None]	8.9302ms	7.6097ms	131.4104 Ops/s	129.2376 Ops/s	$\color{#35bf28}+1.68\%$
test_ppo_speed[False-backward]	15.7864ms	15.1016ms	66.2181 Ops/s	65.7465 Ops/s	$\color{#35bf28}+0.72\%$
test_ppo_speed[True-None]	4.6173ms	4.1219ms	242.6076 Ops/s	234.2134 Ops/s	$\color{#35bf28}+3.58\%$
test_ppo_speed[True-backward]	10.8021ms	10.1752ms	98.2780 Ops/s	96.2264 Ops/s	$\color{#35bf28}+2.13\%$
test_ppo_speed[reduce-overhead-None]	4.7584ms	4.1996ms	238.1205 Ops/s	226.5450 Ops/s	$\textbf{\color{#35bf28}+5.11\%}$
test_ppo_speed[reduce-overhead-backward]	10.8489ms	10.3253ms	96.8496 Ops/s	98.2997 Ops/s	$\color{#d91a1a}-1.48\%$
test_reinforce_speed[False-None]	9.6377ms	6.8016ms	147.0251 Ops/s	150.8182 Ops/s	$\color{#d91a1a}-2.52\%$
test_reinforce_speed[False-backward]	11.6575ms	10.3023ms	97.0657 Ops/s	96.6294 Ops/s	$\color{#35bf28}+0.45\%$
test_reinforce_speed[True-None]	4.6452ms	3.1016ms	322.4153 Ops/s	314.4303 Ops/s	$\color{#35bf28}+2.54\%$
test_reinforce_speed[True-backward]	9.5227ms	9.1840ms	108.8850 Ops/s	105.9512 Ops/s	$\color{#35bf28}+2.77\%$
test_reinforce_speed[reduce-overhead-None]	3.8063ms	3.2037ms	312.1437 Ops/s	307.2166 Ops/s	$\color{#35bf28}+1.60\%$
test_reinforce_speed[reduce-overhead-backward]	9.8745ms	9.1874ms	108.8450 Ops/s	101.3378 Ops/s	$\textbf{\color{#35bf28}+7.41\%}$
test_iql_speed[False-None]	34.3428ms	32.7050ms	30.5764 Ops/s	29.4069 Ops/s	$\color{#35bf28}+3.98\%$
test_iql_speed[False-backward]	47.5688ms	45.9540ms	21.7609 Ops/s	21.6557 Ops/s	$\color{#35bf28}+0.49\%$
test_iql_speed[True-None]	19.0533ms	11.7964ms	84.7718 Ops/s	86.7507 Ops/s	$\color{#d91a1a}-2.28\%$
test_iql_speed[True-backward]	24.2794ms	22.9804ms	43.5153 Ops/s	42.9074 Ops/s	$\color{#35bf28}+1.42\%$
test_iql_speed[reduce-overhead-None]	12.0076ms	11.4222ms	87.5489 Ops/s	85.3115 Ops/s	$\color{#35bf28}+2.62\%$
test_iql_speed[reduce-overhead-backward]	23.4749ms	22.4702ms	44.5034 Ops/s	42.5287 Ops/s	$\color{#35bf28}+4.64\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.3774ms	4.9396ms	202.4453 Ops/s	194.3463 Ops/s	$\color{#35bf28}+4.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.9064ms	0.5514ms	1.8136 KOps/s	1.8316 KOps/s	$\color{#d91a1a}-0.98\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7732ms	0.4963ms	2.0150 KOps/s	1.9911 KOps/s	$\color{#35bf28}+1.20\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	7.1286ms	4.7757ms	209.3931 Ops/s	212.5032 Ops/s	$\color{#d91a1a}-1.46\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.1169ms	0.5111ms	1.9564 KOps/s	1.9399 KOps/s	$\color{#35bf28}+0.85\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.8062ms	0.4911ms	2.0363 KOps/s	2.0388 KOps/s	$\color{#d91a1a}-0.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.8854ms	1.6538ms	604.6660 Ops/s	606.0980 Ops/s	$\color{#d91a1a}-0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	2.2223ms	1.5716ms	636.3067 Ops/s	631.4279 Ops/s	$\color{#35bf28}+0.77\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	7.1881ms	4.8085ms	207.9638 Ops/s	205.0316 Ops/s	$\color{#35bf28}+1.43\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.9790ms	0.6544ms	1.5282 KOps/s	1.5108 KOps/s	$\color{#35bf28}+1.15\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9729ms	0.6322ms	1.5818 KOps/s	1.5778 KOps/s	$\color{#35bf28}+0.25\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.0833ms	4.7315ms	211.3506 Ops/s	205.8778 Ops/s	$\color{#35bf28}+2.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	2.0443ms	0.5652ms	1.7692 KOps/s	1.9126 KOps/s	$\textbf{\color{#d91a1a}-7.50\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7213ms	0.4978ms	2.0088 KOps/s	2.0151 KOps/s	$\color{#d91a1a}-0.32\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	5.4515ms	4.7768ms	209.3472 Ops/s	207.1473 Ops/s	$\color{#35bf28}+1.06\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.6084ms	0.5115ms	1.9549 KOps/s	1.9351 KOps/s	$\color{#35bf28}+1.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.9025ms	0.4924ms	2.0310 KOps/s	1.9989 KOps/s	$\color{#35bf28}+1.60\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	7.2239ms	4.8441ms	206.4357 Ops/s	197.3425 Ops/s	$\color{#35bf28}+4.61\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.3164ms	0.6537ms	1.5297 KOps/s	1.5013 KOps/s	$\color{#35bf28}+1.89\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	1.2016ms	0.6343ms	1.5765 KOps/s	1.5825 KOps/s	$\color{#d91a1a}-0.38\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	5.5352ms	4.2339ms	236.1862 Ops/s	224.7789 Ops/s	$\textbf{\color{#35bf28}+5.07\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	3.4319ms	2.1987ms	454.8222 Ops/s	437.8695 Ops/s	$\color{#35bf28}+3.87\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	7.2788ms	1.3991ms	714.7314 Ops/s	742.9421 Ops/s	$\color{#d91a1a}-3.80\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.4712s	13.6286ms	73.3753 Ops/s	231.5945 Ops/s	$\textbf{\color{#d91a1a}-68.32\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	7.1021ms	2.3533ms	424.9436 Ops/s	430.2783 Ops/s	$\color{#d91a1a}-1.24\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	5.6532ms	1.3953ms	716.6785 Ops/s	729.0763 Ops/s	$\color{#d91a1a}-1.70\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	5.9139ms	4.4320ms	225.6336 Ops/s	212.7339 Ops/s	$\textbf{\color{#35bf28}+6.06\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	10.0185ms	2.6136ms	382.6200 Ops/s	404.9614 Ops/s	$\textbf{\color{#d91a1a}-5.52\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	5.0032ms	1.5069ms	663.5938 Ops/s	646.3377 Ops/s	$\color{#35bf28}+2.67\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	14.0592ms	11.9314ms	83.8125 Ops/s	81.5062 Ops/s	$\color{#35bf28}+2.83\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	15.9909ms	14.8000ms	67.5678 Ops/s	69.3810 Ops/s	$\color{#d91a1a}-2.61\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	21.5149ms	20.8288ms	48.0106 Ops/s	47.8532 Ops/s	$\color{#35bf28}+0.33\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	16.1014ms	14.9730ms	66.7870 Ops/s	68.2724 Ops/s	$\color{#d91a1a}-2.18\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	21.1057ms	20.7346ms	48.2286 Ops/s	48.2248 Ops/s	$+0.01\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	17.5393ms	15.9161ms	62.8295 Ops/s	62.9860 Ops/s	$\color{#d91a1a}-0.25\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}14$. Worsened: $\large\color{#d91a1a}18$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_simple	0.8778s	0.7894s	1.2668 Ops/s	1.2634 Ops/s	$\color{#35bf28}+0.27\%$
test_transformed	1.4702s	1.3824s	0.7234 Ops/s	0.7229 Ops/s	$\color{#35bf28}+0.07\%$
test_serial	2.3714s	2.2805s	0.4385 Ops/s	0.4371 Ops/s	$\color{#35bf28}+0.31\%$
test_parallel	1.9494s	1.8422s	0.5428 Ops/s	0.5369 Ops/s	$\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-True-True-True-True]	0.2064ms	41.7692μs	23.9411 KOps/s	24.6910 KOps/s	$\color{#d91a1a}-3.04\%$
test_step_mdp_speed[True-True-True-True-False]	52.1710μs	24.7806μs	40.3541 KOps/s	42.5720 KOps/s	$\textbf{\color{#d91a1a}-5.21\%}$
test_step_mdp_speed[True-True-True-False-True]	57.2710μs	23.3916μs	42.7504 KOps/s	44.6829 KOps/s	$\color{#d91a1a}-4.33\%$
test_step_mdp_speed[True-True-True-False-False]	39.0300μs	13.2748μs	75.3306 KOps/s	76.4781 KOps/s	$\color{#d91a1a}-1.50\%$
test_step_mdp_speed[True-True-False-True-True]	0.1058ms	41.5491μs	24.0679 KOps/s	23.4994 KOps/s	$\color{#35bf28}+2.42\%$
test_step_mdp_speed[True-True-False-True-False]	54.0110μs	25.6330μs	39.0122 KOps/s	38.9090 KOps/s	$\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-True-False-False-True]	54.6510μs	24.9505μs	40.0793 KOps/s	41.5711 KOps/s	$\color{#d91a1a}-3.59\%$
test_step_mdp_speed[True-True-False-False-False]	42.4500μs	15.4617μs	64.6757 KOps/s	64.8004 KOps/s	$\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-False-True-True-True]	88.9110μs	45.7099μs	21.8771 KOps/s	22.4701 KOps/s	$\color{#d91a1a}-2.64\%$
test_step_mdp_speed[True-False-True-True-False]	57.0000μs	28.3496μs	35.2739 KOps/s	35.8569 KOps/s	$\color{#d91a1a}-1.63\%$
test_step_mdp_speed[True-False-True-False-True]	50.1610μs	24.9233μs	40.1231 KOps/s	40.3887 KOps/s	$\color{#d91a1a}-0.66\%$
test_step_mdp_speed[True-False-True-False-False]	45.4110μs	15.6816μs	63.7691 KOps/s	64.1839 KOps/s	$\color{#d91a1a}-0.65\%$
test_step_mdp_speed[True-False-False-True-True]	91.5010μs	47.5022μs	21.0517 KOps/s	21.1994 KOps/s	$\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-False-False-True-False]	72.0610μs	30.1855μs	33.1285 KOps/s	33.1543 KOps/s	$\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-False-False-False-True]	75.3510μs	28.3227μs	35.3074 KOps/s	37.4376 KOps/s	$\textbf{\color{#d91a1a}-5.69\%}$
test_step_mdp_speed[True-False-False-False-False]	48.0110μs	18.3757μs	54.4198 KOps/s	56.4995 KOps/s	$\color{#d91a1a}-3.68\%$
test_step_mdp_speed[False-True-True-True-True]	79.8710μs	45.4919μs	21.9819 KOps/s	22.0499 KOps/s	$\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-True-True-True-False]	78.8410μs	27.7642μs	36.0176 KOps/s	35.5266 KOps/s	$\color{#35bf28}+1.38\%$
test_step_mdp_speed[False-True-True-False-True]	57.2910μs	28.3346μs	35.2925 KOps/s	34.4746 KOps/s	$\color{#35bf28}+2.37\%$
test_step_mdp_speed[False-True-True-False-False]	46.1500μs	16.9727μs	58.9182 KOps/s	58.2136 KOps/s	$\color{#35bf28}+1.21\%$
test_step_mdp_speed[False-True-False-True-True]	73.5010μs	47.7466μs	20.9439 KOps/s	21.0442 KOps/s	$\color{#d91a1a}-0.48\%$
test_step_mdp_speed[False-True-False-True-False]	61.4510μs	30.2806μs	33.0245 KOps/s	32.8308 KOps/s	$\color{#35bf28}+0.59\%$
test_step_mdp_speed[False-True-False-False-True]	3.1782ms	31.2328μs	32.0176 KOps/s	31.5873 KOps/s	$\color{#35bf28}+1.36\%$
test_step_mdp_speed[False-True-False-False-False]	71.3410μs	19.7254μs	50.6961 KOps/s	51.1602 KOps/s	$\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-False-True-True-True]	87.7010μs	50.0782μs	19.9688 KOps/s	20.1886 KOps/s	$\color{#d91a1a}-1.09\%$
test_step_mdp_speed[False-False-True-True-False]	0.1012ms	32.9687μs	30.3318 KOps/s	30.3480 KOps/s	$\color{#d91a1a}-0.05\%$
test_step_mdp_speed[False-False-True-False-True]	72.9710μs	31.6446μs	31.6010 KOps/s	32.0223 KOps/s	$\color{#d91a1a}-1.32\%$
test_step_mdp_speed[False-False-True-False-False]	59.4810μs	20.3904μs	49.0427 KOps/s	51.6963 KOps/s	$\textbf{\color{#d91a1a}-5.13\%}$
test_step_mdp_speed[False-False-False-True-True]	93.4120μs	52.1043μs	19.1923 KOps/s	19.6531 KOps/s	$\color{#d91a1a}-2.34\%$
test_step_mdp_speed[False-False-False-True-False]	70.5810μs	35.7388μs	27.9808 KOps/s	29.5840 KOps/s	$\textbf{\color{#d91a1a}-5.42\%}$
test_step_mdp_speed[False-False-False-False-True]	65.7510μs	32.5561μs	30.7162 KOps/s	30.4277 KOps/s	$\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-False-False-False-False]	52.3410μs	22.4100μs	44.6230 KOps/s	46.7262 KOps/s	$\color{#d91a1a}-4.50\%$
test_values[generalized_advantage_estimate-True-True]	24.9044ms	23.8170ms	41.9868 Ops/s	42.1660 Ops/s	$\color{#d91a1a}-0.43\%$
test_values[vec_generalized_advantage_estimate-True-True]	0.1109s	3.1023ms	322.3363 Ops/s	339.1740 Ops/s	$\color{#d91a1a}-4.96\%$
test_values[td0_return_estimate-False-False]	0.1041ms	78.2861μs	12.7737 KOps/s	12.7326 KOps/s	$\color{#35bf28}+0.32\%$
test_values[td1_return_estimate-False-False]	55.6759ms	53.0603ms	18.8465 Ops/s	19.1063 Ops/s	$\color{#d91a1a}-1.36\%$
test_values[vec_td1_return_estimate-False-False]	1.2991ms	1.0573ms	945.8246 Ops/s	934.3240 Ops/s	$\color{#35bf28}+1.23\%$
test_values[td_lambda_return_estimate-True-False]	88.6330ms	85.8202ms	11.6523 Ops/s	11.9852 Ops/s	$\color{#d91a1a}-2.78\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.2804ms	1.0558ms	947.1191 Ops/s	938.1645 Ops/s	$\color{#35bf28}+0.95\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	23.4900ms	23.1611ms	43.1758 Ops/s	40.7554 Ops/s	$\textbf{\color{#35bf28}+5.94\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.0498ms	0.7276ms	1.3745 KOps/s	1.3608 KOps/s	$\color{#35bf28}+1.00\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7422ms	0.6476ms	1.5440 KOps/s	1.5311 KOps/s	$\color{#35bf28}+0.85\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5239ms	1.4576ms	686.0403 Ops/s	681.4016 Ops/s	$\color{#35bf28}+0.68\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.7249ms	0.6625ms	1.5094 KOps/s	1.4966 KOps/s	$\color{#35bf28}+0.86\%$
test_dqn_speed[False-None]	6.8799ms	1.5062ms	663.9265 Ops/s	662.1473 Ops/s	$\color{#35bf28}+0.27\%$
test_dqn_speed[False-backward]	2.1461ms	2.0855ms	479.5077 Ops/s	478.5830 Ops/s	$\color{#35bf28}+0.19\%$
test_dqn_speed[True-None]	0.6950ms	0.5634ms	1.7750 KOps/s	1.7229 KOps/s	$\color{#35bf28}+3.02\%$
test_dqn_speed[True-backward]	1.2456ms	1.1999ms	833.3769 Ops/s	902.2098 Ops/s	$\textbf{\color{#d91a1a}-7.63\%}$
test_dqn_speed[reduce-overhead-None]	0.6954ms	0.5965ms	1.6764 KOps/s	1.6984 KOps/s	$\color{#d91a1a}-1.30\%$
test_dqn_speed[reduce-overhead-backward]	1.0864ms	1.0478ms	954.4137 Ops/s	1.0564 KOps/s	$\textbf{\color{#d91a1a}-9.66\%}$
test_ddpg_speed[False-None]	3.1367ms	2.8302ms	353.3376 Ops/s	350.0149 Ops/s	$\color{#35bf28}+0.95\%$
test_ddpg_speed[False-backward]	4.5525ms	4.1521ms	240.8415 Ops/s	246.1597 Ops/s	$\color{#d91a1a}-2.16\%$
test_ddpg_speed[True-None]	1.4061ms	1.3193ms	758.0062 Ops/s	751.7752 Ops/s	$\color{#35bf28}+0.83\%$
test_ddpg_speed[True-backward]	2.6518ms	2.5665ms	389.6402 Ops/s	415.3437 Ops/s	$\textbf{\color{#d91a1a}-6.19\%}$
test_ddpg_speed[reduce-overhead-None]	1.5104ms	1.3549ms	738.0746 Ops/s	745.7610 Ops/s	$\color{#d91a1a}-1.03\%$
test_ddpg_speed[reduce-overhead-backward]	2.0869ms	2.0110ms	497.2717 Ops/s	533.1001 Ops/s	$\textbf{\color{#d91a1a}-6.72\%}$
test_sac_speed[False-None]	8.4126ms	7.9833ms	125.2611 Ops/s	126.2856 Ops/s	$\color{#d91a1a}-0.81\%$
test_sac_speed[False-backward]	11.5959ms	11.1435ms	89.7384 Ops/s	93.0555 Ops/s	$\color{#d91a1a}-3.56\%$
test_sac_speed[True-None]	2.0069ms	1.8259ms	547.6679 Ops/s	543.7046 Ops/s	$\color{#35bf28}+0.73\%$
test_sac_speed[True-backward]	3.7425ms	3.6789ms	271.8185 Ops/s	282.6779 Ops/s	$\color{#d91a1a}-3.84\%$
test_sac_speed[reduce-overhead-None]	21.4372ms	12.2115ms	81.8899 Ops/s	83.6801 Ops/s	$\color{#d91a1a}-2.14\%$
test_sac_speed[reduce-overhead-backward]	1.8121ms	1.7465ms	572.5688 Ops/s	611.4834 Ops/s	$\textbf{\color{#d91a1a}-6.36\%}$
test_redq_speed[False-None]	8.0138ms	7.3505ms	136.0447 Ops/s	133.3331 Ops/s	$\color{#35bf28}+2.03\%$
test_redq_speed[False-backward]	11.8297ms	11.3107ms	88.4122 Ops/s	89.5266 Ops/s	$\color{#d91a1a}-1.24\%$
test_redq_speed[True-None]	2.4784ms	2.2843ms	437.7664 Ops/s	433.4981 Ops/s	$\color{#35bf28}+0.98\%$
test_redq_speed[True-backward]	4.5399ms	4.1007ms	243.8636 Ops/s	251.2695 Ops/s	$\color{#d91a1a}-2.95\%$
test_redq_speed[reduce-overhead-None]	2.3946ms	2.2967ms	435.4150 Ops/s	428.9756 Ops/s	$\color{#35bf28}+1.50\%$
test_redq_speed[reduce-overhead-backward]	4.5183ms	4.1172ms	242.8810 Ops/s	237.1769 Ops/s	$\color{#35bf28}+2.41\%$
test_redq_deprec_speed[False-None]	9.2232ms	8.8613ms	112.8505 Ops/s	111.5528 Ops/s	$\color{#35bf28}+1.16\%$
test_redq_deprec_speed[False-backward]	12.4678ms	11.9666ms	83.5657 Ops/s	82.7480 Ops/s	$\color{#35bf28}+0.99\%$
test_redq_deprec_speed[True-None]	2.6927ms	2.5893ms	386.2089 Ops/s	378.0860 Ops/s	$\color{#35bf28}+2.15\%$
test_redq_deprec_speed[True-backward]	4.7954ms	4.4856ms	222.9345 Ops/s	223.8364 Ops/s	$\color{#d91a1a}-0.40\%$
test_redq_deprec_speed[reduce-overhead-None]	2.7012ms	2.5957ms	385.2517 Ops/s	380.1304 Ops/s	$\color{#35bf28}+1.35\%$
test_redq_deprec_speed[reduce-overhead-backward]	4.8368ms	4.4102ms	226.7483 Ops/s	229.7593 Ops/s	$\color{#d91a1a}-1.31\%$
test_td3_speed[False-None]	8.0220ms	7.7647ms	128.7879 Ops/s	128.3594 Ops/s	$\color{#35bf28}+0.33\%$
test_td3_speed[False-backward]	10.8509ms	10.2507ms	97.5542 Ops/s	99.5254 Ops/s	$\color{#d91a1a}-1.98\%$
test_td3_speed[True-None]	1.6542ms	1.6233ms	616.0180 Ops/s	584.2232 Ops/s	$\textbf{\color{#35bf28}+5.44\%}$
test_td3_speed[True-backward]	3.3705ms	3.2945ms	303.5387 Ops/s	301.6352 Ops/s	$\color{#35bf28}+0.63\%$
test_td3_speed[reduce-overhead-None]	52.3090ms	26.3584ms	37.9386 Ops/s	38.7152 Ops/s	$\color{#d91a1a}-2.01\%$
test_td3_speed[reduce-overhead-backward]	1.5124ms	1.4536ms	687.9622 Ops/s	744.7420 Ops/s	$\textbf{\color{#d91a1a}-7.62\%}$
test_cql_speed[False-None]	17.0548ms	16.4087ms	60.9432 Ops/s	60.6633 Ops/s	$\color{#35bf28}+0.46\%$
test_cql_speed[False-backward]	22.2475ms	21.6878ms	46.1090 Ops/s	46.8562 Ops/s	$\color{#d91a1a}-1.59\%$
test_cql_speed[True-None]	3.3186ms	3.2154ms	311.0006 Ops/s	307.9217 Ops/s	$\color{#35bf28}+1.00\%$
test_cql_speed[True-backward]	6.4498ms	5.5821ms	179.1425 Ops/s	177.0286 Ops/s	$\color{#35bf28}+1.19\%$
test_cql_speed[reduce-overhead-None]	21.6993ms	13.2142ms	75.6765 Ops/s	76.2451 Ops/s	$\color{#d91a1a}-0.75\%$
test_cql_speed[reduce-overhead-backward]	2.1132ms	1.9659ms	508.6814 Ops/s	497.0442 Ops/s	$\color{#35bf28}+2.34\%$
test_a2c_speed[False-None]	3.2735ms	3.1109ms	321.4527 Ops/s	314.7611 Ops/s	$\color{#35bf28}+2.13\%$
test_a2c_speed[False-backward]	6.9144ms	6.1380ms	162.9184 Ops/s	160.8012 Ops/s	$\color{#35bf28}+1.32\%$
test_a2c_speed[True-None]	1.4744ms	1.3378ms	747.4723 Ops/s	745.1303 Ops/s	$\color{#35bf28}+0.31\%$
test_a2c_speed[True-backward]	3.4807ms	3.0531ms	327.5341 Ops/s	326.1466 Ops/s	$\color{#35bf28}+0.43\%$
test_a2c_speed[reduce-overhead-None]	15.8280ms	9.0341ms	110.6917 Ops/s	113.3022 Ops/s	$\color{#d91a1a}-2.30\%$
test_a2c_speed[reduce-overhead-backward]	1.7396ms	1.5836ms	631.4912 Ops/s	621.7315 Ops/s	$\color{#35bf28}+1.57\%$
test_ppo_speed[False-None]	3.7375ms	3.6078ms	277.1806 Ops/s	272.3608 Ops/s	$\color{#35bf28}+1.77\%$
test_ppo_speed[False-backward]	7.1990ms	6.8487ms	146.0135 Ops/s	145.3609 Ops/s	$\color{#35bf28}+0.45\%$
test_ppo_speed[True-None]	1.5456ms	1.4057ms	711.3738 Ops/s	706.9570 Ops/s	$\color{#35bf28}+0.62\%$
test_ppo_speed[True-backward]	3.4415ms	3.1674ms	315.7203 Ops/s	309.9292 Ops/s	$\color{#35bf28}+1.87\%$
test_ppo_speed[reduce-overhead-None]	1.0232ms	0.9612ms	1.0404 KOps/s	1.0432 KOps/s	$\color{#d91a1a}-0.28\%$
test_ppo_speed[reduce-overhead-backward]	1.7422ms	1.5429ms	648.1288 Ops/s	693.0360 Ops/s	$\textbf{\color{#d91a1a}-6.48\%}$
test_reinforce_speed[False-None]	2.3196ms	2.2345ms	447.5340 Ops/s	438.1814 Ops/s	$\color{#35bf28}+2.13\%$
test_reinforce_speed[False-backward]	3.7581ms	3.3121ms	301.9189 Ops/s	297.9487 Ops/s	$\color{#35bf28}+1.33\%$
test_reinforce_speed[True-None]	1.3922ms	1.2878ms	776.4934 Ops/s	765.7444 Ops/s	$\color{#35bf28}+1.40\%$
test_reinforce_speed[True-backward]	3.0513ms	3.0081ms	332.4324 Ops/s	332.0845 Ops/s	$\color{#35bf28}+0.10\%$
test_reinforce_speed[reduce-overhead-None]	19.3337ms	10.1524ms	98.4988 Ops/s	99.7397 Ops/s	$\color{#d91a1a}-1.24\%$
test_reinforce_speed[reduce-overhead-backward]	1.5367ms	1.4718ms	679.4489 Ops/s	607.6939 Ops/s	$\textbf{\color{#35bf28}+11.81\%}$
test_iql_speed[False-None]	9.3829ms	8.9653ms	111.5416 Ops/s	108.2839 Ops/s	$\color{#35bf28}+3.01\%$
test_iql_speed[False-backward]	12.8812ms	12.4040ms	80.6193 Ops/s	77.2328 Ops/s	$\color{#35bf28}+4.38\%$
test_iql_speed[True-None]	2.3729ms	2.2077ms	452.9572 Ops/s	444.8013 Ops/s	$\color{#35bf28}+1.83\%$
test_iql_speed[True-backward]	5.0611ms	4.9802ms	200.7969 Ops/s	204.6997 Ops/s	$\color{#d91a1a}-1.91\%$
test_iql_speed[reduce-overhead-None]	19.7984ms	11.2025ms	89.2660 Ops/s	91.1987 Ops/s	$\color{#d91a1a}-2.12\%$
test_iql_speed[reduce-overhead-backward]	1.9336ms	1.8618ms	537.1273 Ops/s	474.3810 Ops/s	$\textbf{\color{#35bf28}+13.23\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	7.6837ms	6.2659ms	159.5944 Ops/s	157.5444 Ops/s	$\color{#35bf28}+1.30\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6035ms	0.3476ms	2.8773 KOps/s	3.7421 KOps/s	$\textbf{\color{#d91a1a}-23.11\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5725ms	0.3240ms	3.0866 KOps/s	4.0745 KOps/s	$\textbf{\color{#d91a1a}-24.24\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.2004ms	6.0011ms	166.6372 Ops/s	166.9480 Ops/s	$\color{#d91a1a}-0.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.0121ms	0.3015ms	3.3165 KOps/s	3.8626 KOps/s	$\textbf{\color{#d91a1a}-14.14\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4995ms	0.2746ms	3.6419 KOps/s	4.1761 KOps/s	$\textbf{\color{#d91a1a}-12.79\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.3716ms	1.2027ms	831.4580 Ops/s	707.3176 Ops/s	$\textbf{\color{#35bf28}+17.55\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.3416ms	1.1177ms	894.6618 Ops/s	881.0332 Ops/s	$\color{#35bf28}+1.55\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.2502ms	6.1636ms	162.2418 Ops/s	161.3252 Ops/s	$\color{#35bf28}+0.57\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.9608ms	0.4006ms	2.4965 KOps/s	2.3654 KOps/s	$\textbf{\color{#35bf28}+5.54\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7411ms	0.3798ms	2.6333 KOps/s	2.1833 KOps/s	$\textbf{\color{#35bf28}+20.61\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.2141ms	6.1020ms	163.8801 Ops/s	163.9392 Ops/s	$\color{#d91a1a}-0.04\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.8757ms	0.3497ms	2.8592 KOps/s	3.7572 KOps/s	$\textbf{\color{#d91a1a}-23.90\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6062ms	0.3346ms	2.9885 KOps/s	3.3947 KOps/s	$\textbf{\color{#d91a1a}-11.97\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.2344ms	6.0052ms	166.5230 Ops/s	165.3764 Ops/s	$\color{#35bf28}+0.69\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.7475ms	0.2557ms	3.9114 KOps/s	3.3167 KOps/s	$\textbf{\color{#35bf28}+17.93\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4584ms	0.2363ms	4.2316 KOps/s	3.3486 KOps/s	$\textbf{\color{#35bf28}+26.37\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.3801ms	6.1875ms	161.6158 Ops/s	161.4053 Ops/s	$\color{#35bf28}+0.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0927ms	0.4187ms	2.3881 KOps/s	2.3099 KOps/s	$\color{#35bf28}+3.39\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.5977ms	0.3753ms	2.6644 KOps/s	2.2423 KOps/s	$\textbf{\color{#35bf28}+18.82\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	6.9930ms	5.4702ms	182.8080 Ops/s	185.0332 Ops/s	$\color{#d91a1a}-1.20\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	9.9512ms	2.0415ms	489.8392 Ops/s	436.0808 Ops/s	$\textbf{\color{#35bf28}+12.33\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	6.5391ms	1.1766ms	849.9122 Ops/s	837.0755 Ops/s	$\color{#35bf28}+1.53\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	7.1193ms	5.6028ms	178.4827 Ops/s	184.0005 Ops/s	$\color{#d91a1a}-3.00\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	10.5670ms	2.0662ms	483.9815 Ops/s	432.9920 Ops/s	$\textbf{\color{#35bf28}+11.78\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	3.3466ms	1.1391ms	877.8820 Ops/s	839.9219 Ops/s	$\color{#35bf28}+4.52\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.5033s	15.7196ms	63.6147 Ops/s	31.8767 Ops/s	$\textbf{\color{#35bf28}+99.56\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	8.5118ms	2.1480ms	465.5399 Ops/s	428.9956 Ops/s	$\textbf{\color{#35bf28}+8.52\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	8.5969ms	1.3412ms	745.6115 Ops/s	788.2692 Ops/s	$\textbf{\color{#d91a1a}-5.41\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	13.1923ms	12.9336ms	77.3177 Ops/s	75.5740 Ops/s	$\color{#35bf28}+2.31\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	19.8805ms	17.0070ms	58.7994 Ops/s	60.1117 Ops/s	$\color{#d91a1a}-2.18\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	17.6984ms	17.4198ms	57.4060 Ops/s	55.8912 Ops/s	$\color{#35bf28}+2.71\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	19.1075ms	17.1291ms	58.3804 Ops/s	60.5009 Ops/s	$\color{#d91a1a}-3.50\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	18.0565ms	17.4010ms	57.4680 Ops/s	55.9624 Ops/s	$\color{#35bf28}+2.69\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	19.4971ms	18.3438ms	54.5142 Ops/s	55.2891 Ops/s	$\color{#d91a1a}-1.40\%$

[pytorch-bot]

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki