bi PddlZddlmZmZddlmZmZddlZddlm cm Z ddl m Z ddlmZmZmZddlmZmZe eZd ZeGd d ZGd d eZ ddejj4dededeeddf dZdej<dedededej<f dZ y)N)asdict dataclass)ListOptional) get_logger)"_ALL_TRANSFORMER_BLOCK_IDENTIFIERS_ATTENTION_CLASSES_get_submodule_from_fqn) HookRegistry ModelHooksmoothed_energy_guidance_hookcdeZdZUdZeeed<dZeed<dZ eeed<dZ e de d dfd Z y) SmoothedEnergyGuidanceConfiga} Configuration for skipping internal transformer blocks when executing a transformer model. Args: indices (`List[int]`): The indices of the layer to skip. This is typically the first layer in the transformer block. fqn (`str`, defaults to `"auto"`): The fully qualified name identifying the stack of transformer blocks. Typically, this is `transformer_blocks`, `single_transformer_blocks`, `blocks`, `layers`, or `temporal_transformer_blocks`. For automatic detection, set this to `"auto"`. "auto" only works on DiT models. For UNet models, you must provide the correct fqn. _query_proj_identifiers (`List[str]`, defaults to `None`): The identifiers for the query projection layers. Typically, these are `to_q`, `query`, or `q_proj`. If `None`, `to_q` is used by default. indicesautofqnN_query_proj_identifiersct|SN)r)selfs i/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/hooks/smoothed_energy_guidance_utils.pyto_dictz$SmoothedEnergyGuidanceConfig.to_dict6s d|datareturnctdi|S)N)r)rs r from_dictz&SmoothedEnergyGuidanceConfig.from_dict9s+3d33r)__name__ __module__ __qualname____doc__rint__annotations__rstrrr staticmethoddictr rrrrr sT #YC)-T#Y-44!?44rrceZdZd dededdffd Zdej jdejdejfdZ xZ S) SmoothedEnergyGuidanceHook blur_sigmablur_threshold_infrNc>t|||_||_yr)super__init__r,r-)rr,r- __class__s rr0z#SmoothedEnergyGuidanceHook.__init__?s $"4rmoduleoutputctjd|jzdztjd|jzdzz }t|||j|j}|S)Nr r)mathceilr,_gaussian_blur_2dr-)rr2r3 kernel_sizesmoothed_outputs r post_forwardz'SmoothedEnergyGuidanceHook.post_forwardDs\iiDOO 34q8499QEX;Y\];]] +FKRVRiRijr)g?g3333@) r!r"r#floatr0torchnnModuleTensorr; __classcell__)r1s@rr+r+>sH555E5W[5 588??ELLU\\rr+r2configr,namerc *|xst}|jdk(r+tD]}t||s||_n t d|j dg|_t ||j}d}t|D]\}}||jvrd}|jD]\} } t| tr | jr#|j D]}t| |d} | $t| tjj s7t"j%d|jd|d| d|t'j(| } t+|} | j-| ||s&t d|jd |jd y) NrzCould not find a suitable identifier for the transformer blocks automatically. Please provide a valid `fqn` (fully qualified name) that identifies a stack of transformer blocks.to_qFTz-Registering smoothed energy guidance hook on .zDCould not find any transformer blocks matching the provided indices z and fully qualified name 'z4'. Please check the indices and fqn for correctness.)_SMOOTHED_ENERGY_GUIDANCE_HOOKrr hasattr ValueErrorrr enumerater named_modules isinstancer is_cross_attentiongetattrr=r>Linearloggerdebugr check_if_exists_or_initializer+ register_hook)r2rBr,rC identifiertransformer_blocks blocks_foundiblocksubmodule_name submodule query_projregistryhooks r$_apply_smoothed_energy_guidance_hookr^Ks  11D zzV< Jvz*'   ^  %%-*0&0DL0135 FNN "  ).)<)<)> 3 %NIi);< @\@\$<< 3 $Y DA %Z EHHOO-T CFJJk RiiE q112?;;u%<<D 18D!G3DE??9a1BHNNSTDUV!#[A%5{a7GXYIYZeeKyA hh{HYG $))h)E A%%j)=NOK%%aA.K&1&7&7&9E!   "# Lrr)!r6 dataclassesrrtypingrrr=torch.nn.functionalr> functionalryutilsr_commonr r r hooksr rr!rPrGrr+r?r<r'r^r@r%r8rrrrs )! dd* H !@ 44 4:  mq- HHOO- %A- OT- \deh\i-  - b+U\\++E+`e+jojvjv+r