biyddlmZmZmZddlZddlmZddlmcmZ ddl m Z m Z ddl mZddlmZddlmZdd lmZdd lmZdd lmZmZdd lmZd dlmZmZGddej>Z Gddej>Z! d%de"de#de#de#de"de"dee#fdZ$Gddej>Z%Gddej>Z&Gdd ej>Z'Gd!d"ej>Z(Gd#d$ee eZ)y)&)OptionalTupleUnionN) ConfigMixinregister_to_config)FromOriginalModelMixin)apply_forward_hook)get_activation)SanaMultiscaleLinearAttention) ModelMixin)RMSNormget_normalization) GLUMBConv) DecoderOutput EncoderOutputc reZdZ d dededededdf fd Zdejdejfd ZxZ S) ResBlock in_channels out_channels norm_typeact_fnreturnNct|||_| t|nt j |_t j||ddd|_t j||dddd|_ t|||_ y)NrrF)bias) super__init__rr nnIdentity nonlinearityConv2dconv1conv2rnorm)selfrrrr __class__s g/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/models/autoencoders/autoencoder_dc.pyrzResBlock.__init__"sq "6<6HN62bkkmYY{KAqA YY{L!QN %i> hidden_statesc"|}|j|}|j|}|j|}|jdk(r6|j |j ddj dd}||zS|j |}||zS)Nrms_normr)r$r"r%rr&movedim)r'r+residuals r)forwardzResBlock.forward2s  =1 ))-8  =1 >>Z ' IIm&;&;Ar&BCKKBPQRMx''!IIm4Mx''r*) batch_normrelu6) __name__ __module__ __qualname__intstrrtorchTensorr1 __classcell__r(s@r)rr!s[ & ??? ?  ?  ? (U\\ (ell (r*rc eZdZ d dedededeedfdeddf fd Zd ejdejfd Z xZ S) EfficientViTBlockrmultattention_head_dimqkv_multiscales.rrNc vt|t||||||d|_t ||d|_y)NT)rrr?r@r kernel_sizesresidual_connectionr-)rrr)rrr attnrconv_out)r'rr?r@rArr(s r)rzEfficientViTBlock.__init__BsH 1#$1( $  "#$   r*xcJ|j|}|j|}|S)N)rErF)r'rGs r)r1zEfficientViTBlock.forward\s" IIaL MM! r*)? r2) r4r5r6r7floatrr8rr9r:r1r;r<s@r)r>r>Ass"$+/%      sCx      4%,,r*r> block_typerrr@rrqkv_mutliscalescv|dk(rt||||}|S|dk(rt||||}|Std|d)Nrr>)r@rrAzBlock with block_type=z is not supported.)rr> ValueError)rNrrr@rrrOblocks r) get_blockrSbsbZlIvF L * *! ,>)et  L2zm3EFGGr*c neZdZd dededededdf fd Zdejdejfd ZxZ S) DCDownBlock2drr downsampleshortcutrNc(t|||_d|_|rdnd|_||jdzz|z|_||_|jdz}|r||zdk(sJ||z}tj||d|jd|_ y)Nr rrr kernel_sizestridepadding) rrrVfactorr[ group_sizerWr r#conv)r'rrrVrW out_ratior(s r)rzDCDownBlock2d.__init__zs $ %a1 % Q6,F  KKN )+q0 00'94LII  ;;   r*r+cJ|j|}|jr tj||j}|j rWtj||j}|j dd|jf}|jd}||z}|S|}|SNrr.r dim) r_rVFpixel_unshuffler]rW unflattenr^meanr'r+rGys r)r1zDCDownBlock2d.forwards IIm $ ??!!!T[[1A ==!!-=A ADOO45A1 AEMMr*)FT) r4r5r6r7boolrr9r:r1r;r<s@r)rUrUysH C s  `d pt , U\\ ell r*rUc xeZdZ d dedededededdf fd Zd ejdejfd Z xZ S) DCUpBlock2drr interpolaterWinterpolation_moderNct|||_||_||_d|_||j dzz|z|_|j dz}|s||z}tj||ddd|_ y)Nr rr) rrrnrorWr]repeatsr r#r_)r'rrrnrWror`r(s r)rzDCUpBlock2d.__init__sy &"4   #dkk1n4 C KKN ')3LIIk<AqA r*r+c|jr>tj||j|j}|j |}n1|j |}tj ||j}|j r_|j|jd|jd|jz}tj ||j}||z}|S|}|S)N) scale_factormoderrd output_size) rnrer]ror_ pixel_shufflerWrepeat_interleaverqshaperis r)r1zDCUpBlock2d.forwards    m$++DLcLcdA ! A -(A4;;/A ==// !Q^QdQdefQgjnjvjvQv/wA4;;/AEMMr*)FTnearest) r4r5r6r7rkr8rr9r:r1r;r<s@r)rmrmso ""+ BBB B  B  B B.U\\ellr*rmceZdZ ddedededeeeefdeedeedeeedfdfd ed effd Zd e jd e jfdZ xZ S)Encoderrlatent_channelsr@rNblock_out_channelslayers_per_blockrA.downsample_block_type out_shortcutc .t|t|} t|tr|f| z}|ddkDr0t j ||ddkDr|dn|dddd|_n't||ddkDr|dn|d|dk(d|_g} tt||D]\} \} }g}t|D]+}t|| | | |dd ||  }|j|-| | dz kr.|dkDr)t| || dz|dk(d }|j|| jt j|t j| |_t j |d |ddd|_| |_| r|d |z|_yy) NrrrrYrfF)rrrVrWr-silur@rrrOTr.)rrlen isinstancer8r r#conv_inrU enumerateziprangerSappend Sequential ModuleList down_blocksrFrout_shortcut_average_group_size)r'rr}r@rNr~rrArr num_blocksri out_channel num_layersdown_block_list_rRdownsample_blockr(s r)rzEncoder.__init__s +, j# &$3J A  "99)9!)!j1n#0 +!3AE!:48II! $  &&'78   r}}o> ?1 @4==5 "4R"8/1aQRS ( 3Eb3I_3\D 0 r*r+rc |j|}|jD] }||} |jrF|jdd|jf}|j d}|j ||z}|S|j |}|Srb)rrrrgrrhrF)r'r+ down_blockrGs r)r1zEncoder.forwards ]3 ** 6J&}5M 6   ''B0T0T+UVA1 A MM-81)elementwise_affinerF)rrrrr8r r#rrin_shortcut_repeatsreversedlistrrrmrrrSinsertrr up_blocksrnorm_outr conv_actrF)r'rr}r@rNr~rrArrrrrrrrrr up_block_listupsample_blockrrRchannelsr(s r)rzDecoder.__init__!s! +, j# &$3J i %" z1I fc "Y+Fyy2DR2H!QPQR & '9"'='PD $ ,4T)CHZ\lDm:n5o,p ? (A( ZM:>!j1n!,&q1u- 3} D! " $$^4:& ,!qM'9'l!!9$3A$6$$U+ ,   Q } = >1 ?4y1,X>X")B)ddFdFd&(@(aDDaDa%&*&A&ATEcEc&c#%)%?%?4CaCa%a"r*cd|_y)z Disable tiled AE decoding. If `enable_tiling` was previously enabled, this method will go back to computing decoding in one step. FN)rr's r)disable_tilingzAutoencoderDC.disable_tilings  r*cd|_y)z Enable sliced AE decoding. When this option is enabled, the AE will split the input tensor in slices to compute decoding in several steps. This is useful to save some memory and allow larger batch sizes. TNrrs r)enable_slicingzAutoencoderDC.enable_slicing"s  r*cd|_y)z Disable sliced AE decoding. If `enable_slicing` was previously enabled, this method will go back to computing decoding in one step. FNrrs r)disable_slicingzAutoencoderDC.disable_slicing)s !r*rGc|j\}}}}|jr4||jkDs||jkDr|j |ddS|j |}|SNF return_dictr)ryrrr tiled_encoder)r'rG batch_size num_channelsheightwidthencodeds r)_encodezAutoencoderDC._encode0b23''/ L&% ??(B(B BftOjOjFj$$QE$:1= =,,q/r*rc|jrU|jddkDrC|jdDcgc]}|j|}}t j |}n|j|}|s|fSt |Scc}w)a Encode a batch of images into latents. Args: x (`torch.Tensor`): Input batch of images. return_dict (`bool`, defaults to `True`): Whether to return a [`~models.vae.EncoderOutput`] instead of a plain tuple. Returns: The latent representations of the encoded videos. If `return_dict` is True, a [`~models.vae.EncoderOutput`] is returned, otherwise a plain `tuple` is returned. rrlatent)rrysplitrr9catr)r'rGrx_sliceencoded_slicesrs r)encodezAutoencoderDC.encode:sv    QCD771:Ndll73NNNii/Gll1oG: G,,OsBzc|j\}}}}|jr4||jkDs||jkDr|j |ddS|j |}|Sr)ryrrr tiled_decoder)r'rrrrrdecodeds r)_decodezAutoencoderDC._decodeRrr*c*|jra|jddkDrM|jdDcgc]}|j|j}}t j |}n|j|}|s|fSt|Scc}w)a Decode a batch of images. Args: z (`torch.Tensor`): Input batch of latent vectors. return_dict (`bool`, defaults to `True`): Whether to return a [`~models.vae.DecoderOutput`] instead of a plain tuple. Returns: [`~models.vae.DecoderOutput`] or `tuple`: If return_dict is True, a [`~models.vae.DecoderOutput`] is returned, otherwise a plain `tuple` is returned. rrsample)rsizerrrr9rr)r'rrz_slicedecoded_slicesrs r)decodezAutoencoderDC.decode\s}   q A JK''RS*Uwdll73::UNUii/Gll1oG: G,,Vs"Bab blend_extentct|jd|jd|}t|D]A}|dddd| |zddfd||z z z|dddd|ddf||z zz|dddd|ddf<C|S)Nr rminryr)r'rrrrjs r)blend_vzAutoencoderDC.blend_vus1771:qwwqz<@ |$ xAa\MA$5q89Q\AQ=QRUVWXZ[]^`aWaUbfgjvfvUwwAaAqjM xr*ct|jd|jd|}t|D]A}|dddddd| |zfd||z z z|dddddd|f||z zz|dddddd|f<C|S)Nrrr)r'rrrrGs r)blend_hzAutoencoderDC.blend_h{s1771:qwwqz<@ |$ xAaA }q'889Q\AQ=QRUVWXZ[]^`aWaUbfgjvfvUwwAaAqjM xr*c |j\}}}}||jz}||jz}|j|jz} |j|jz} |j|jz} |j |jz} | | z } | | z }g}t d|jd|jD]6}g}t d|jd|j D]}|dddd|||jz|||jzf}|jd|jzdk7s|jd|jzdk7rl|j|jdz |jz}|j|jdz |jz}tj|d|d|f}|j|}|j||j|9g}t|D]\}}g}t|D]d\}}|dkDr|j||dz ||| }|dkDr|j||dz ||}|j|ddddd| d| ff|jtj|dtj|dddddd|d|f}|s|fSt!|S)Nrr rrrcr)ryrrrrrrrepadrrrrrr9rr)r'rGrrrrr latent_height latent_widthrrtile_latent_stride_heighttile_latent_stride_width blend_height blend_widthrowsrrowjtilepad_hpad_w result_rows result_rowrs r)rzAutoencoderDC.tiled_encodes23''/ L&%$"@"@@  > >> !%!\>\ \$($B$BdFdFd$d!#'#@#@DDbDb#b -0II +.FF q!''!*d&D&DE AC1aggaj$*G*GH !Aq1t'B'B#BBADLfLfHfDffgJJqMD$B$BBaGzz!}t'E'EEJ!;;djjmKtOmOmmE!;;djjmKtOmOmmE555!U'; e4q5<<QU AlKDq5<<AE D+FD!!$q!-G.G-GIbJbIb'b"cd e   uyy; < =))KQ/1n}nm|m0ST: G,,r*c  |j\}}}}|j|jz}|j|jz}|j|jz} |j |jz} |j|jz } |j|j z } g} t d|| D]`}g}t d|| D];}|dddd|||z|||zf}|j|}|j|=| j|bg}t| D]\}}g}t|D]x\}}|dkDr|j| |dz ||| }|dkDr|j||dz || }|j|ddddd|jd|j fz|jtj|dtj|d}|s|fSt|S)Nrrrrcr r)ryrrrrrrrrrrrr9rr)r'rrrrrrrrr r r r rrrrrrrrs r)rzAutoencoderDC.tiled_decodes'23''/ L&%!%!\>\ \$($B$BdFdFd$d!#'#@#@DDbDb#b 22T5S5SS 0043P3PP q&";< AC1e%=> $Aq1'=#==q1G\C\?\\],,t, 7# $ KK    o =FAsJ$S> q4q5<<QU AlKDq5<<AE D+FD!!$q!-Mt/M/M-MOnQUQnQnOn'n"op q   uyy; < =))KQ/: G,,r*rc||j|dd}|j|dd}|s|fSt|S)NFrrr)rrr)r'rrrrs r)r1zAutoencoderDC.forwardsF++f%+8;++g5+9!<: G,,r*)rrJrJrrrr)r r r rrr)rrrrrrrrrwrfr-rTTrrI)NNNN)rN)T)!r4r5r6__doc__ _supports_gradient_checkpointingrr7rr8rrkrMrrrrrrr9r:rr rrrrrrrrrr1r;r<s@r)rr}s/b(-$!"$6@6@6V6V/A/A?]?]#2%65?28%)$(#) #)GbGbGb Gb #3c ?3 Gb #3c ?3 Gb%*#s(OGb%*#s(OGb#(*Gb#(*Gb"'uS#X';!<Gb"'uS#X';!<Gb!Gb #Gb"#uSz/2Gb sE#J/!Gb"##Gb$"%Gb&!'Gb()Gb* +GbGbV15/35948 b ( b (}b$,E? b #+5/ b  b@  !%,,- -4-5X]^c^j^jXkIkCl--.%,,- -4-5X]^c^j^jXkIkCl--0%,,cell %,,cell .-ell.-.-.-`'-ell'-'-}^c^j^jOjIk'-R-ell---r*r)r)*typingrrrr9torch.nnr torch.nn.functional functionalreconfiguration_utilsrrloadersr utils.accelerate_utilsr activationsr attention_processorr modeling_utilsr normalizationrrtransformers.sana_transformerrvaerrModulerr>r8r7rSrUrmr|rrrr*r)r(s *) B-8(?'65-(ryy(@ P#%     3Z.$BII$N'"))'TSbiiSlZbiiZzb-J -Cb-r*