Q/jw>ddlmZmZmZmZmZmZmZmZm Z ddl m Z ddl Z ddl mZmZgdZe deded efd Zded efd Zed eeeZe dde j2dee ee j6fded ee j2d ffdZe ddedee ee j6fded eefdZddZ ddeed fdeeeefdee ee j6fded eeed feeeefd fff dZddede ee j6fded efdZy)) AnyDictListOptionaloverloadSequenceTupleTypeVarUnion) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)categoryobjreturnct|SN)_is_namedtuplers c/root/repos/pocs/video-evals/.venv/lib/python3.12/site-packages/torch/nn/parallel/scatter_gather.py is_namedtupler s # cZt|txrt|dxr t|dS)N_asdict_fields) isinstancetuplehasattrrs rrrs+ 3V73 #:VwsI?VrT.inputs target_gpusdimcyrr#r$r%s rrr  rcyrr'r(s rrr)r)rc>fd |}d|S#dwxYw)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. ct|tjrtjd|St |r,t t|Dcgc]}t||c}St|tr)t|dkDrtt t|St|tr7t|dkDr)t t|Dcgc] }t|c}St|trKt|dkDr=t t|jDcgc]}t||c}SDcgc]}|c}Scc}wcc}wcc}wcc}w)Nr)rtorchTensorrapplyrzipmaptyper lenlistdictitems)rargsi_r% scatter_mapr$s rr:zscatter..scatter_map8s c5<< (==dC= = # 14c+s6K1LMIDIt$M M c5 !c#hlSc234 4 c4 SX\%(#k3*?%@ADGA A c4 SX\*-s; /L*MNQIDIaLN N()))NBN)sEE+E  E%Nr')r#r$r%resr:s `` @rrr2s* *$&! J kwargsc |r t|||ng}|r t|||ng}t|t|kr7|jdtt|t|z DnMt|t|kr6|jdtt|t|z Dt |t |fS)z+Scatter with support for kwargs dictionary.c3 K|]}dyw)r'Nr'.0r9s r z!scatter_kwargs..[ B  c3 K|]}iywrr'r@s rrBz!scatter_kwargs.._rCrD)rr3extendranger )r#r=r$r%scattered_inputsscattered_kwargss rrrQs=Cwv{C8fd |}d|S#dwxYw)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. cdttjrtjgSytt r:t fdDs tdtfdDStr*tjttStttS)Nrc3LK|]}tt|k(ywr)r3)rAdouts rrBz-gather..gather_map..}s;as3x3q6);s!$z+All dicts must have the same number of keysc 3^K|]}|Dcgc]}|| c}f!ycc}wwrr')rAkrO gather_maprJs rrBz-gather..gather_map..s-S!a7,CaQqT,C!DES,Cs - ( -) rr-r.r r/r5all ValueErrorr2r_maker1r0)rJrPr%rSrKs`@rrSzgather..gather_mapvsaj c5<< (<< s=W= = ; c4 ;7;; !NOO49SsSS S # 9??3z3=#AB BtCyZg788rNr')rJrKr%r;rSs `` @rrres*" 9 ! J r<).)r) typingrrrrrrr r r typing_extensionsr r-torch.nn.parallel._functionsr r__all__ FutureWarningboolrrr5r4r r"r.intdevicerstrrrr'rrr`sWWW( 8 2 I st   CtU#  LL%U\\ 123  5<<     %U\\ 123  !W  F < #s(O< T#s(^ $<%U\\ 123< <  5c?E$sCx.#"56 67 <(%C%c5<<.?(@%s%SV%r