Q/j& UddlmZmZmZmZddlZddlmZddlmZddl m Z dee fdZ dee fdZ eeeeZe ed <eeZe ed <ej gZe dd ed edeeej(ej*feeefffd Zdej(defdZdeedej(defdZy))ListDictTupleOptionalN)Tensor)no_grad) TypeAliasreturncDddtjjgS)z:Return the device type list that supports foreach kernels.cudaxputorch_C_get_privateuse1_backend_name]/root/repos/pocs/video-evals/.venv/lib/python3.12/site-packages/torch/utils/_foreach_utils.py&_get_foreach_kernels_supported_devicesrs E588AAC DDrcHddddtjjgS)zEReturn the device type list that supports fused kernels in optimizer.mpsr r cpurrrr$_get_fused_kernels_supported_devicesr s 65%)O)O)Q RRrTensorListListIndicestensorlistlist with_indicescBtjj||SN)rr"_group_tensors_by_device_and_dtype)rrs rr r s 88 6 6~| TTrdevicecx|jtdgzvxrtjj S)Nr)typerrjit is_scripting)r!s r_device_has_foreach_supportr&'s4 ;;ACugM N oW\W`W`WmWmWoSoortensorsc@t|xrtd|DS)Nc3JK|]}|duxst|tvywr)r#_foreach_supported_types).0ts r z'_has_foreach_support..,s'6ylmqDy7gDGOgDg7g6ys!#)r&all)r'r!s r_has_foreach_supportr/+s &v . y36yqx6y3yyr)F)typingrrrrrrtorch.autograd.grad_modertyping_extensionsr strrrr__annotations__intrr*boolr!dtyper r&r/rrrr8s.. ,'ES ESd3iS!hv&6!78 8#Y!LL> U"UU % ekk) *E.'2I,J JKU U p ppz$v,z zzr