Xj zUddlmZddlZddlmZddlmZdeefdZdeefdZ eeedzZ ee d<ee Z ee d <ejgZe dd e d edeeejejfee e fffd ZdejdefdZdeedejdefdZdS)) TypeAliasN)Tensor)no_gradreturncFdddtjgS)z:Return the device type list that supports foreach kernels.cudaxpumtiatorch_C_get_privateuse1_backend_nameHC:\Projects\DSCons\.venv\Lib\site-packages\torch\utils\_foreach_utils.py&_get_foreach_kernels_supported_devicesrs E658#I#I#K#K LLrcLddddddtjgS)zEReturn the device type list that supports fused kernels in optimizer.mpsrr hpucpur r rrr$_get_fused_kernels_supported_devicesr s1     ..00 rTensorListListIndicesFtensorlistlist with_indicescBtj||SN)r r "_group_tensors_by_device_and_dtype)rrs rrr*s 8 6 6~| T TTrdevicecr|jtdgzvotj S)Nr)typerr jit is_scripting)rs r_device_has_foreach_supportr$2s8 >@@E7JK ) &&(( (rtensorscRt|otd|DS)Nc3JK|]}|dupt|tvVdSr)r!_foreach_supported_types).0ts r z'_has_foreach_support..:sH77=>T 8T!WW 88777777r)r$all)r%rs r_has_foreach_supportr-9s? &v . . 377BI77744r)F)typingrr rtorch.autograd.grad_moderliststrrrr__annotations__intrr(booldicttuplerdtyperr$r-rrrr8s ,,,,,,MS MMMM d3i    !ftm!45 555#Y!L> UU"UU % ek) *E.'2I,J JKUUU U $v, r