Q/jQ=.UdZddlZddlZddlmZddlmZmZmZm Z m Z m Z m Z ddl Z ddlZ ddl mZddlmZmZddlmZdd lmZmZd aej4Zej8Zgae e egdfe efe d <e!e jDd d Z#e eee$dfZ%ea&dZ'e e jDjPe d<de)fdZ*e*rCe jDjVZ+e jDjXZ-e jDj\Z/nedZ+de$de$fdZ-de$de$fdZ/edde$fdZ0de)fdZ1dZ2dZ3dZ4dZ5dZ6GddZ7Gd dZGd!d"eZ8de%ddfd#Z9d9de e%defd$Z:edd9de e%deeeffd%Z;d9de e%de+fd&ZGd)d*Z?d+e d,de?fd-Z@d.ZAd+efd/ZBd9de e%defd0ZCd9de%ddfd1ZDde jde jDjPfd2ZE d:d3e$de e$ee jfddfd4ZFd:de e$ee jfde$fd5ZGdd6lHmIZImJZJmKZKmLZLmMZMmNZNmOZOmPZPmQZQdd7lRmSZSmTZTmUZUmVZVmWZWmXZXmYZYmZZZm[Z[gd8Z\y);z This package introduces support for the XPU backend, specifically tailored for Intel GPU optimization. This package is lazily initialized, so you can always import it, and use :func:`is_available()` to determine if your system supports XPU. N) lru_cache)AnyCallableDictListOptionalTupleUniondevice) _dummy_type_LazySeedTracker)_get_device_index)EventStreamF _queued_calls_xpu_isInBadForkcyNFrU/root/repos/pocs/video-evals/.venv/lib/python3.12/site-packages/torch/xpu/__init__.pyrsrrdefault_generatorsreturnc6tjjS)z(Return true if compile with XPU support.)torch_C_has_xpurrr _is_compiledr!#s 88  r_XpuDevicePropertiesr ctdNz(PyTorch was compiled without XPU supportNotImplementedErrorr s r_exchange_devicer'0!"LMMrctdr$r%r s r_maybe_exchange_devicer*3r(r)maxsizecTtsytjjS)z*Return the number of XPU device available.r)r!rr_xpu_getDeviceCountrrr device_countr.7s > 88 ' ' ))rctdkDS)z7Return a bool indicating if XPU is currently available.r)r.rrr is_availabler0?s >A rcy)zKReturn a bool indicating if the current XPU device supports dtype bfloat16.Trrrris_bf16_supportedr2Es rc(txr t S)z8Return whether PyTorch's XPU state has been initialized.) _initialized_is_in_bad_forkrrris_initializedr6Js  1 111rc ftr|y|jddr)tj|t j y|jddr)tj |t j ytj|t j fy)Nseed_allFseed) r6get_lazy_seed_trackerqueue_seed_all traceback format_stack queue_seedrappend)callablekwargss r _lazy_callrCOs{  ::j% (  - -h 8N8N8P Q ZZ &  ) )(I4J4J4L M  (I,B,B,D!E Frcty)zInitialize PyTorch's XPU state. This is a Python API about lazy initialization that avoids initializing XPU until the first time it is accessed. Does nothing if the XPU state is already initialized. N) _lazy_initrrrinitrF]s Lrc tsttdryt5tr dddyt r t dt s tdtjjdt_ tjD]}|stj| tD] \}} | t'tddadddy#t $r1}dt#|ddj%|}t!||d}~wwxYw#t'tdwxYw#1swYyxYw)Nis_initializingzuCannot re-initialize XPU in forked subprocess. To use XPU with multiprocessing, you must use the 'spawn' start methodz#Torch not compiled with XPU enabledTz5XPU call failed lazily at initialization with error: z' XPU call was originally invoked at: )r6hasattr_tls_initialization_lockr5 RuntimeErrorr!AssertionErrorrr _xpu_initrHr; get_callsrr@ Exceptionstrjoindelattrr4)calls queued_callorig_tracebackemsgs rrErEfsL74):; #    ##  I ~ !FG G  $'113 ,E$$U+ , -/< 0+ ^0M 0 D+ , G##6!0OPSTUPVxXBBD''.BYAZ\$C.a/ 0 D+ ,E##sS EA,E$E< D+ C.D+E. D(7,D##D((D++D==EE c2eZdZdefdZdZdededefdZy) _DeviceGuardindexc ||_d|_yN)idxprev_idx)selfr\s r__init__z_DeviceGuard.__init__s rc`tjj|j|_yNrxpur'r`rarbs r __enter__z_DeviceGuard.__enter__ 22488< rtypevaluer=c`tjj|j|_yrrrgr*rar`rbrkrlr=s r__exit__z_DeviceGuard.__exit__9933DMMBrN)__name__ __module__ __qualname__intrcrirrprrrr[r[s-c=Srr[c6eZdZdZdefdZdZdededefdZy) r zContext-manager that changes the selected device. Args: device (torch.device or int or str): device index to select. It's a no-op if this argument is a negative integer or ``None``. c6t|d|_d|_y)NToptionalr_)rr`ra)rbr s rrczdevice.__init__s$Vd; rc`tjj|j|_yrerfrhs rrizdevice.__enter__rjrrkrlr=c`tjj|j|_yrrnros rrpzdevice.__exit__rqrN)rrrsrt__doc__rrcrirprrrr r s2s=Src"eZdZdZfdZxZS) device_ofaContext-manager that changes the current device to that of given object. You can use both tensors and storages as arguments. If a given object is not allocated on a XPU, this is a no-op. Args: obj (Tensor or Storage): object allocated on the selected device. c`|jr|jnd}t| |yr^)is_xpu get_devicesuperrc)rbobjr` __class__s rrczdevice_of.__init__s$"%**cnn" r)rrrsrtr|rc __classcell__)rs@rr~r~srr~cxtt|}|dk\r tjj |yy)zSet the current device. Args: device (torch.device or int or str): selected device. This function is a no-op if this argument is negative. rN)rErrr_xpu_setDevicer s r set_devicers1L v &F { 'rc,t|jS)aGet the name of a device. Args: device (torch.device or int or str, optional): device for which to return the name. This function is a no-op if this argument is a negative integer. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Returns: str: the name of the device )get_device_propertiesnamer s rget_device_namers ! ( - --rct|}t|Dcic]!}|jdr|t||#c}Scc}w)aGet the xpu capability of a device. Args: device (torch.device or int or str, optional): device for which to return the device capability. This function is a no-op if this argument is a negative integer. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Returns: Dict[str, Any]: the xpu capability dictionary of the device __)rdir startswithgetattr)r propsprops rget_device_capabilityrsG "& )E/25z '+QUAVgeT""  s AActt|d}|dks |tk\r tdt |S)zGet the properties of a device. Args: device (torch.device or int or str): device for which to return the properties of the device. Returns: _XpuDeviceProperties: the properties of the device TrxrzInvalid device index)rErr.rN_get_device_propertiesr s rrrs<L v 5F zV|~-344 !& ))rcRttjjS)z0Return the index of a currently selected device.)rErr_xpu_getDevicerrrcurrent_devicersL 88 " " $$rct|trtj|}|St|trtjd|}|S)zReturn the torch.device type object from the passed in device. Args: device (torch.device or int or str): selected device. rg) isinstancerRrr rur s r _get_devicersD &#f% M FC eV, MrcNeZdZUdZeded<dedfdZdZdeded efd Z y ) StreamContextaContext-manager that selects a given stream. All XPU kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.xpu.Stream cur_streamstreamc\||_tdd|_|jd|_yy)NTr_)rrr`)rbrs rrczStreamContext.__init__!s- $T40 88 DH rc|j}||jdk(rytjj d|_|j j |j k7rLt |j 5tjj |j |_dddtjj|y#1swY)xYwr^) rr`rrgcurrent_streamsrc_prev_streamr dst_prev_stream set_stream)rbrs rrizStreamContext.__enter__'s[[  R $yy77=    & &**;*; ; ))* S',yy'?'? @Q@Q'R$ S Z( S Ss ;/CCrkrlr=c*|j}||jdk(ry|jj|jk7r)tj j |jtj j |jyr^)rr`rr rrgrr)rbrkrlr=rs rrpzStreamContext.__exit__3sj[[  R     & &**;*; ; II !5!5 6 T112rN) rrrsrtr|r__annotations__rcrirrprrrrrsF +,,x(:; )3S333rrrrct|S)zWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. )rrs rrr>s   rcHtjj|||y)aset stream specified by the stream id, device index and device type Args: stream_id (int): not visible to the user, used to assigned to the specific stream. device_index (int): selected device index. device_type (int): selected device type.  stream_id device_index device_typeN)rr_xpu_setStreamrs r_set_stream_by_idrGs$ HH!rcv|ytt|j|j|jy)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. Nr)rErrrrrs rrrUs4~L""((&&rcttjjt |d}t |d|d|dS)aRReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Trxrrr)rErr_xpu_getCurrentStreamrr)r streamdatas rrrhsJL//&40J Q-jmTU rcntt|d}tjj |S)a*Wait for all kernels in all streams on a XPU device to complete. Args: device (torch.device or int, optional): device for which to synchronize. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Trx)rErrr_xpu_synchronizer s r synchronizerzs*L v 5F 88 $ $V ,,rcl|j}| t}tjj|S)zuReturn the XPU Generator object for the given device. Args: device (torch.device): selected device. )r\rrrgr)r r`s r_get_generatorrs/ ,,C { 99 ' ' ,,roffsetc@t|fd}t|y)a$Set the random number generator state offset of the specified GPU. Args: offset (int): The desired offset device (torch.device or int, optional): The device to set the RNG state. Default: ``'xpu'`` (i.e., ``torch.device('xpu')``, the current XPU device). c>t}|jyre)r set_offset)default_generator final_devicers rcbz!_set_rng_state_offset..cbs*<8$$V,rN)rrC)rr rrs` @r_set_rng_state_offsetrsv&L-rNrcbtt|}t|}|jS)aLReturn the random number generator state offset of the specified GPU. Args: device (torch.device or int, optional): The device to return the RNG state offset of. Default: ``'xpu'`` (i.e., ``torch.device('xpu')``, the current XPU device). .. warning:: This function eagerly initializes XPU. )rErr get_offset)r rrs r_get_rng_state_offsetrs-Lv&L&|4  ' ' ))r) empty_cachemax_memory_allocatedmax_memory_reservedmemory_allocatedmemory_reserved memory_statsmemory_stats_as_nested_dictreset_accumulated_memory_statsreset_peak_memory_stats) get_rng_stateget_rng_state_all initial_seed manual_seedmanual_seed_allr9r8 set_rng_stateset_rng_state_all)(rrrrrrr r~r.rrrrrr get_streamrFrr0r2r6rrrrrrrrrrr9r8rrrrrstreamsrre)rg)]r| threadingr= functoolsrtypingrrrrrr r rtorch._Cr _device torch._utilsr r_utilsrrrrr4localrKLockrLrrRrrrr5ru _device_tr;r Generatorboolr!r"_xpu_exchangeDevicer'_xpu_maybeExchangeDevicer*r.r0r2r6rCrFrEr[r~rrrrrrrrrrrrrrrmemoryrrrrrrrrrrandomrrrrrr9r8rr__all__rrrrsXDDD #6%" y%y~~'t (2t8 d3i '(%(($6 F '3T) * %'02E%((,,-2d > 8888xx33"XX>>''=>NNNNsNsN 1*c**d  2 G'T  (   (y (T ( .HY/ .3 . 4(9"5c3h&*(9"5*AU*"%% c3 45 %,, '3'3T!8./!M! v&8I.&$ - -T - -5<< -EHH,>,> -:? sC56 & *%S%,,(>"? *C *"      ) r