P/j!F( ddlZddlmZmZmZmZmZmZmZm Z ddl Z ddl m Z ddlmZddlmZddlmZmZmZddlmZmZgdZe dedfZhdZe j8j:j<Zd ed ed ed e d ef dZ!de jDde de jFd e jDfdZ$ dCdede d efdZ%d edeedfdeedfd efdZ&de'dedeeded ed e d efdZ(de'dedeeded ed e de d efdZ)de'dedeeded ed e d efd Z*eejVe dDdedeeded ed ef d!Z,eejZe dDdedeeded ed ef d"Z.eej^e dDdedeeded ed ef d#Z0eejbe dDdedeeded ed ef d$Z2eejfe dDdedeeded ed ef d%Z4eejje dDdedeeded ed ef d&Z6Gd'd(eZ7ded)eedeed e7fd*Z8d+eed efd,Z9d-e'ded)eedfdeedfd ed e d efd.Z:eejve dEded/eedeed ed ef d0Z<eejze dEded/eedeed ed ef d1Z>eej~e dEded/eedeed ed ef d2Z@eeje dEded/eedeed ed ef d3ZBGd4d5eZCd6e'ded/eedeed eCf d7ZDeeje dEded/eedeed ed ef d8ZFeeje dEded/eedeed ed ef d9ZHeeje dFded/eedeed ed ef d:ZJeeje dFded/eedeed ed ef d;ZLeeje dFded/eedeed ed ef d<ZNeeje dFded/eedeed ed ef d=ZPeeje dFded/eedeed ed ef d>ZReeje dFded/eedeed ed ef d?ZTdeed ed eefd@ZUeejdGdedeed efdAZWeejdGdedeed efdBZYy)HN)IterableListLiteral NamedTupleOptionalSequenceTupleUnion)register_decomposition)DimsType ShapeTypeTensorLikeType)_maybe_convert_to_dtype out_wrapper)fftfft2fftnhffthfft2hfftnrfftrfft2rfftnifftifft2ifftnihfftihfft2ihfftnirfftirfft2irfftnfftshift ifftshift)forwardbackwardortho>Nr'r%r&xnorm signal_numelr%returnctjtvfddk(r|dtj|z zS| xr duxsdk(xs |xrdk(}|r|d|z zS|S)z3Apply normalization to the un-normalized FFT resultcdS)NzInvalid normalization mode: )r)sR/root/repos/pocs/video-evals/.venv/lib/python3.12/site-packages/torch/_refs/fft.pyz_apply_norm...s1MdV/Tr'Nr&r%)torch_check _NORM_VALUESmathsqrt)r(r)r*r% normalizes ` r/ _apply_normr9*s LL%'TU wA ,//00E$$,"D$*2D%DI%&/1L !5A5r1dtyperequire_complexdevicecfjrSjstjtjtj g}|j dv}|r|jtjtj|vfd|rtjS)z@Helper to promote a dtype to one supported by the FFT primitives)cudametacdS)NzUnsupported dtype r.r:sr/r0z#_promote_type_fft..Is3EeW1Mr1) is_complexis_floating_pointr3get_default_dtypefloat32float64typeappendfloat16r4utilscorresponding_complex_dtype)r:r;r< allowed_typesmaybe_support_halfs` r/_promote_type_fftrN9s    " "'')]]EMM2M(88U]]+ LL-')MN11%8 Lr1tc`|j}t|||j}t||S)zEHelper to promote a tensor to a dtype supported by the FFT primitives)r:rNr<r)rOr;cur_typenew_types r/_maybe_promote_tensor_fftrSQs,wwH ?AHHEH "1h //r1dims.sizesct|t|k(sJd}|j}dgt|zdz}tt|D]k}||dk(r |||||kr*d}t|d||zz dz }|||||z ||<|||||kDsS|j||d||}m|rt j ||S|S)z Fixes the shape of x such that x.size(dims[i]) == sizes[i], either by zero-padding, or by slicing x starting from 0. FrTr2)lenshaperangenarrowr3constant_pad_nd)r(rTrU must_copyx_sizes pad_amountipad_idxs r/_resize_fft_inputrcZs t9E "" "IggGs7|#a'J 3t9  / 8r>  47 eAh &I*oDG 3a7G"'(WT!W-="=Jw  47 eAh &a!U1X.A /4=5 J /C!Cr1 func_nameinputndimcxt|d}tj|j|df}||nd|j|dz zt j dk\fd|t||dzdzf}|rt j|}tj|| }t||| S) zBCommon code for performing any complex to real FFT (irfft or hfft)Tr;F wrap_scalarrWr2cddSNzInvalid number of data points (z ) specifiedr. last_dim_sizesr/r0z_fft_c2r..1- Lr1)rTrUrgror)r*r%) rSrJcanonicalize_dimndimrZr3r4rcconjprimsfft_c2rr9) rdrerfrgr)r%rToutputros @r/_fft_c2rryts &eT BE  " "5::s F HDAAS1AA1E,FM LLL  }!%d=A;MPQ;Q:ST 5! ]]5d- HF vD}g VVr1onesidedc tjjj fdt t j j|df}||nj| tj dk\ fd|t||ftj||}t|| |}|r|Stj|S)zBCommon code for performing any real to complex FFT (rfft or ihfft)c&djS)Nz0 expects a floating point input tensor, but got rArdresr/r0z_fft_r2c..s9+Mekk][r1Frjr2cddSrmr.dim_sizesr/r0z_fft_r2c..!@ +Vr1rgrz)r3r4r:rBrSrJrsrtrZrcrvfft_r2cr9ru) rdrerfrgr)r%rzrTretrs `` @r/_fft_r2crs LL KK " ""[ &e ,E  " "5::s F HDMqu{{3'7H LLA V }!%t4 --4( ;C c47 3C3.uzz#.r1cttjjjfdt j j |df}||nj|tjdk\fd|t||ftj||}t|||S)zCCommon code for performing any complex to complex FFT (fft or ifft)c&djSNz) expects a complex input tensor, but got rAr}sr/r0z_fft_c2c..s9+Fu{{mTr1Frjr2cddSrmr.rsr/r0z_fft_c2c..rr1rgr%) r3r4r:rBrJrsrtrZrcrvfft_c2cr9) rdrerfrgr)r%rTrrs `` @r/_fft_c2crs LL T  " "5::s F HDMqu{{3'7H LLA V }!%t4 --4 9C sD(G 44r1c t|jjrtd||||dStd||||ddS)NrTr%Fr%rzr:rBrrrerfrgr)s r/rrs= {{uadDAAuadD5QQr1c t|jjrtd||||dStd||||ddS)NrFrrrrs r/rrs= {{q#tUCCq#tUUSSr1c &td||||ddS)NrTrrrs r/rrs FE1c4 MMr1c$td||||dS)Nr Frryrs r/r r s GUAsD% @@r1c$td||||dS)NrTrrrs r/rrs FE1c4 >>r1c &td||||ddS)NrFTrrrs r/rrs GUAsD%$ OOr1c6eZdZUeedfed<eedfed<y) _ShapeAndDims.rZrTN__name__ __module__ __qualname__r int__annotations__r.r1r/rrs c? S/r1rrZc|j|j|`t|ts|f}t j |d}t jtt|t|k(d|t|ts|f}t j|duxst|t|k(dt|t jkfd|ttz }tfdt|D}n6| tt}t}ntfdD}|D]t jd kDfd  t|| S) zTConvert the shape and dim arguments into a canonical form where neither are optionalNFrjcy)NzFFT dims must be uniquer.r.r1r/r0z6_canonicalize_fft_shape_and_dim_args..!r1cy)Nz=When given, dim and shape arguments must have the same lengthr.r.r1r/r0z6_canonicalize_fft_shape_and_dim_args..+rr1cdddS)NzGot shape with z" values but input tensor only has z dimensions.r.) input_dimtransform_ndimsr/r0z6_canonicalize_fft_shape_and_dim_args..1son%56!{,0r1c3<K|]\}}|dk7r|n|yw)rXNr.).0sd input_sizess r/ z7_canonicalize_fft_shape_and_dim_args..:s) 17!QbAk!n , c3(K|] }| ywNr.)rrrs r/rz7_canonicalize_fft_shape_and_dim_args..Cs;Q+a.;srcddSrmr.)rfsr/r0z6_canonicalize_fft_shape_and_dim_args..Fs&EaS $Tr1)rZrT)rtrZ isinstancerrJcanonicalize_dimsr3r4rYsettupler[zipr) rerZrgret_dims ret_shaperrrfrs @@@@r/$_canonicalize_fft_shape_and_dim_argsrsp I++K #x(&C**9cuM  H #h- /1R  %*HE  4K 13s8s5z1 S U i ' 0  ;U9~#=yIJH ;>uh;O   y)*+& ;(;; V QUTUV yx 88r1xsc"d}|D]}||z} |S)zCompute product of a listr2r.)rprodr(s r/_prodrKs$ D    Kr1 function_namectjjjfdt ||}t j |||}t||t||S)zECommon code for n-dimensional complex to complex FFTs (fftn or ifftn)c&djSrrA)rresr/r0z_fftn_c2c..^s=/";;-!r1rrr) r3r4r:rBrcrvrr9r)rrerZrgr)r%r(rxs`` r/ _fftn_c2crSsZ LL  ! %e,A ]]1#w 7F vDuU|W UUr1rc^t|||\}}t|d}td||||dS)NTrirrrrSrrerrgr)rZr(s r/rrfs78q#FLUC!%>A VQsD$ ??r1c^t|||\}}t|d}td||||dS)NTrirFrrrs r/rrss78q#FLUC!%>A WaT5 AAr1ctjjj fdt ||\}}t dt ||tj|d}t||t|dS)Nc"djS)Nz2rfftn expects a real-valued input tensor, but got rAresr/r0zrfftn..sDU[[MRr1FriTrrr) r3r4r:rBrrSrcrvrr9r)rerrgr)rZouts` r/rrsy LL KK " ""R6eQDJE3 %eU CE eS% 0E --3 6C sE%L$ OOr1c*tjjj fdt ||\}}tjt |dkDdt dt||tj|ddd}t |d k(r't|||dd }tj|Stj|}tj||ddd }t||t|d S) Nc"djS)Nz3ihfftn expects a real-valued input tensor, but got rArsr/r0zihfftn..sEekk]Sr1rcy)Nz'ihfftn must transform at least one axisr.r.r1r/r0zihfftn..rr1FrirXTrr2rrr)r3r4r:rBrrYrSrcrvrr9ru conj_physicalrr)rerrgr)rZtmps` r/rrs LL KK " ""S6eQDJE3 LLUa!RS %eU CE eS% 0E --3rs8d ;C 3x1}#DuQxOzz#   c "C --Sb5 9C sE%L% PPr1c@eZdZUeedfed<eedfed<eed<y)_CanonicalizeC2rReturn.rZrgroNrr.r1r/rrs$ c? sCxr1rfnamecRt|||\}}tjt|dkDfd||ddk(rd|j|ddz zn|dtjdk\fdt |}dzdz|d<t t||S)zCanonicalize shape and dim arguments for n-dimensional c2r transforms, as well as calculating the last_dim_size which is shape[dim[-1]] for the outputrcdS)Nz! must transform at least one axisr.)rsr/r0z:_canonicalize_fft_c2r_shape_and_dim_args..sE72S)Tr1rXrWr2cddSrmr.rnsr/r0z:_canonicalize_fft_c2r_shape_and_dim_args..rpr1)rZrgro)rr3r4rYrZlistrr)rrerrgrZ shape_listros` @r/(_canonicalize_fft_c2r_shape_and_dim_argsrs8q#FLUC LLUa!TUyAbERKU[[R1A56 b  LLL eJ"a'!+JrN !JS  r1ctd|||\}}}t|d}t|||}tj|||t |t fd|DdS)Nr"Trirqc3<K|]}j|ywr)rZ)rrrs r/rzirfftn..s'B ! 'BrFr)rrSrcrvrwr9r)rerrgr)rZrors @r/r"r"sj!I%C!E3  &eT BE eS% 0E --3m DC sD%'Bc'B"BE RRr1c dtd|||\}}}t|d}t|||}t|dkDrt j ||dddn|}t ||t|ddd}t j|}t j||dd|}t |||dS) NrTrir2rXrrrq) rrSrcrYrvrr9rrrw)rerrgr)rZrorrs r/rrs!I3!E3  &eT BE eS% 0E>A#hl%--3s8T :PUC c4uSbz!2D AC   c "C --RS GC sD- >>r1cHtjj||||SN)rrgr))r3rrrerrgr)s r/rrs 99>>%1#D> 99r1cHtjj||||Sr)r3rrrs r/rr 99??5A3T? ::r1cHtjj||||Sr)r3rrrs r/rr rr1cHtjj||||Sr)r3rr"rs r/r!r!" 99  EQCd  ;;r1cHtjj||||Sr)r3rrrs r/rr#rr1cHtjj||||Sr)r3rrrs r/rr.rr1c~|tt|jSt|ts|gSt|S)zIConvert Optional[DimsType] to a simple list, defaulting to all dimensions)rr[rtrr)rgr(s r/_default_alldimsr9s5 {E!&&M"" X &u Cyr1ct||}|Dcgc]}|j|dz}}tj|||Scc}w)NrWrrZr3rollrergrTrshifts r/r#r#CsF C 'D*. /QU[[^q /E / ::eUD )) 0sAct||}|Dcgc]}|j|dzdz}}tj|||Scc}w)Nr2rWrrs r/r$r$JsK C 'D04 51ekk!nq Q & 5E 5 ::eUD )) 6sA)F)NrXN)NNN)N)rXNr)Zr6typingrrrrrrr r r3 torch._prims_primsrvtorch._prims_common _prims_commonrJ torch._decompr r r rtorch._prims_common.wrappersrr__all__NormTyper5_opsopsatenrboolr9r:r<rNrSrcstrryrrfft_fftrfft_ifftrfft_rfftr fft_irfftr fft_hfftr fft_ihfftrrrrrfft_fftnr fft_ifftnr fft_rfftnr fft_ihfftnrrr fft_irfftnr" fft_hfftnrfft_fft2r fft_ifft2r fft_rfft2r fft_irfft2r! fft_hfft2r fft_ihfft2rr fft_fftshiftr# fft_ifftshiftr$r.r1r/rs/  XXX #0CCM 2 w=>> ?5  zz~~ 6 6% 658 6CG 6 6 ;;)-7<|| [[20500(,00DD"38_D5:38_DD4WW W}W W  W  WW6// /}/ /  /  ///:55 5}5 5  5  554 %  R  R} R  R  R  R& R &  T  T} T  T  T  T' T &  N N}N N  N  N'N'  A A}A A  A  A(A &  ? ?}? ?  ?  ?'?'  P P}P P  P  P(PJ 59 59"*9"559