bigddlZddlZddlmZddlmZmZmZddlm Z m Z m Z m Z m Z mZmZddlZddlmZmZddlmZmZer ej.eZGdd eZeGd d ZeGd d ZeGddZeGddZdZdZ ddZ!ddZ"ddZ#ddZ$ddZ% ddZ&y)N) OrderedDict) dataclassfieldfields)AnyDictListLiteralOptionalTypeUnion) ConfigMixin FrozenDict)is_torch_availableloggingceZdZdZdZy)InsertableDictct|j}|Dcgc]\}}||k7s ||f}}}|j|||f|j|j ||Scc}}wN)listitemsinsertclearupdate)selfkeyvalueindexrkvs m/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/modular_pipelines/modular_pipeline_utils.pyrzInsertableDict.insert"slTZZ\"%*6DAqQ#X!Q66  US%L)  E 7s A-A-c |syg}t|jD]\}\}}t|trd|jd|j d}n1d|j jd|j j d}|j|dt|d|dd d j|zd zS) NzInsertableDict()zz$>#?qAYAY@ZZ\] LLA3c$s)Bxj: ; <& U(;;fDDN)r+r* __qualname__rr2r3r"rr!s  Er3rceZdZUdZdZeeed<dZee ed<dZ eeed<dZ ee ed<e dddi Zeeeeefed <e d ddi Zeeed <e dddi Zeeed <e dddi Zeeed<dZeded<dZdZedededefdZedeefdZedefdZededeeeeffdZddeee eeeffdefdZ defdZ!y) ComponentSpecaSpecification for a pipeline component. A component can be created in two ways: 1. From scratch using __init__ with a config dict 2. using `from_pretrained` Attributes: name: Name of the component type_hint: Type of the component (e.g. UNet2DConditionModel) description: Optional description of the component config: Optional config dict for __init__ creation repo: Optional repo path for from_pretrained creation subfolder: Optional subfolder in repo variant: Optional variant in repo revision: Optional revision in repo default_creation_method: Preferred creation method - "from_config" or "from_pretrained" Nname type_hint descriptionconfigloadingT)defaultmetadatarepo subfoldervariantrevisionfrom_pretrained) from_configrDdefault_creation_methodcZt|j|j|jfS)z=Make ComponentSpec hashable, using load_id as the hash value.)hashr8load_idrFrs r"__hash__zComponentSpec.__hash__es"TYY d.J.JKLLr3ct|tsy|j|jk(xr4|j|jk(xr|j|jk(S)z8Compare ComponentSpec objects based on name and load_id.F)r(r7r8rIrF)rothers r"__eq__zComponentSpec.__eq__isT%/ II # N  - N,,0M0MM r3 componentreturnc<t|dr|jdk7rd}nt|tjj r t dt|tr$t|dstjdd}n&t d|d|jjd |j}t|tr|dk(r |j}nd }t|dr+|jdk7r|j|j}ni}|d ||||d |S) aCreate a ComponentSpec from a Component. Currently supports: - Components created with `ComponentSpec.load()` method - Components that are ConfigMixin subclasses but not nn.Modules (e.g. schedulers, guiders) Args: name: Name of the component component: Component object to create spec from Returns: ComponentSpec object Raises: ValueError: If component is not supported (e.g. nn.Module without load_id, non-ConfigMixin) _diffusers_load_idnullrDzeCannot create ComponentSpec from a nn.Module that was not created with `ComponentSpec.load()` method.z\Component was not created using `ComponentSpec`, defaulting to `from_config` creation methodrEz!Cannot create ComponentSpec from (z). Currently ComponentSpec.from_component() only supports: - components created with `ComponentSpec.load()` method - components that are a subclass of ConfigMixin but not a nn.Module (e.g. guider, scheduler).N)r8r9r;rFr5)hasattrrRr(torchnnModule ValueErrorrloggerwarningr,r+r;decode_load_id)clsr8rOrFr9r; load_specs r"from_componentzComponentSpec.from_componentss2( 92 3 8T8TX^8^&7 #)UXX__5 {I{3y*>?NNv+8'!7vQy?R?R?[?[>\]uv '' i -2I]2Z%%FF 92 3 8T8TX^8^**9+G+GHII 6Sj nw  r3ct|Dcgc]+}|jjdds |j-c}Scc}w)ux Return the names of all loading‐related fields (i.e. those whose field.metadata["loading"] is True). r<F)rr>getr8)r]fs r"loading_fieldszComponentSpec.loading_fieldss1 !'s P1qzz~~i/OPPPs !AAc|jdk(ry|jDcgc]}t||}}|Dcgc]}|dn| }}djd|DScc}wcc}w)z Unique identifier for this spec's pretrained load, composed of repo|subfolder|variant|revision (no empty segments). rErS|c3&K|] }|s| ywrr5).0ps r" z(ComponentSpec.load_id..s.aA.s)rFrcgetattrr/)rr partsrhs r"rIzComponentSpec.load_idsr  ' '= 8+/+>+>+@Aaq!AA5:;19!+;;xx.5...B;s A# A(rIc|j}|Dcic]}|d}}|dk(r|S|jd}t|D]#\}}|t|ks|dk(rdn||||<%|Scc}w)a{ Decode a load_id string back into a dictionary of loading fields and values. Args: load_id: The load_id string to decode, format: "repo|subfolder|variant|revision" where None values are represented as "null" Returns: Dict mapping loading field names to their values. e.g. { "repo": "path/to/repo", "subfolder": "subfolder", "variant": "variant", "revision": "revision" } If a segment value is "null", it's replaced with None. Returns None if load_id is "null" (indicating component not created with `load` method). NrSre)rcsplitr'len)r]rIrcrbresultrkr0parts r"r\zComponentSpec.decode_load_ids"++-#12a!T'22 f M c"!' MGAt3~&&48FND~a() M  3s A,c ^|jt|jts td|xs|jxsi}t |jt r|jj|fi|}ntj|jjj}i}|jD]\}}||vs |||<|jD]\}}||vs |||<|jdi|}d|_ t|dr|j|_|S)z/Create component using from_config with config.z?`type_hint` is required when using from_config creation method.rSr;r5)r9r(r)rYr; issubclassrrEinspect signature__init__ parametersrrRrU)rr;kwargsrOsignature_params init_kwargsr r!s r"createzComponentSpec.creates >> !DNND)I^_ _,4;;," dnnk 22226DVDI&001H1HITT K  '1((%&KN '  '1((%&KN ''55I'- $ 9h '#**DKr3c |jDcic]}||vs||j|}}|jDcic]}||j|t||!}}|jdd}| t d|j . ddlm}|j|fi||}|j|_n |j j|fi||}||_ |jD]\} } t|| | |j|_|Scc}wcc}w#t$r }t d|jd|d}~wwxYw#t$r }t d|jd|d}~wwxYw) z%Load component using from_pretrained.r?Nz`repo` info is required when using `load` method (you can directly set it in `repo` field of the ComponentSpec or pass it as an argument)r) AutoModelzUnable to load z without `type_hint`: z using load method: )rcpoprarjrYr9 diffusersr|rD Exceptionr8r,r?rsetattrrIrR) rrwrpassed_loading_kwargs load_kwargsr?r|rOer r!s r"loadzComponentSpec.loadsBFATATAV h#Z]agZgfjjo!5 h hZ^ZmZmZopSVs155c74;MNNp pvt, <\  >> ! Y/5I55dTkTVT '00DN W:DNN::4Y;YRXY  %%' DAq D!Q  '+|| $=!ip Y ?499+=STUSV!WXX Y W ?499+=QRSQT!UVV Ws@ D#D#$D(D-E- E6EE F"E==Fr)"r+r*r4__doc__r8r str__annotations__r9r r:r;rrr?r r rArBrCrFr rKrN classmethodrr_rcpropertyrIrr\rzrr5r3r"r7r7Fs$D(3- $Ix~$!%K#%#'FHZ ',1$)UYIZ,[D(5d3i( )[$R9d:KLIx}L"49d:KLGXc]L#DIt;LMHhsmMIZW%EFZM 9 #9 #9 #9 9 vQtCyQQ  / / /ST#x}2D-EJXeJS#X,F&GH^a8""r3r7c:eZdZUdZeed<eed<dZeeed<y) ConfigSpecz5Specification for a pipeline configuration parameter.r8r=Nr:) r+r*r4rrrrr:r r5r3r"rr)s? I L!%K#%r3rcleZdZUdZdZeed<dZeed<dZ eed<dZ e ed<dZ eed <dZ eed <d Zy) InputParamz%Specification for an input parameter.Nr8r9r=Frequiredr@r: kwargs_typec^d|jd|jrdndd|jdS)N<: roptionalz , default=>)r8rr=rJs r"r2zInputParam.__repr__Bs3499+Rdmm LJW[WcWcVddeffr3)r+r*r4rr8rrr9rr=rboolr:rr2r5r3r"rr7sG/D#IsGSHdKKgr3rcLeZdZUdZeed<dZeed<dZeed<dZ eed<dZ y) OutputParamz&Specification for an output parameter.r8Nr9r@r:rcd|jdt|jdr|jjdSt |jdS)Nrrr+r)r8rUr9r+rrJs r"r2zOutputParam.__repr__OsT {"PZ8[T^^44uuv w adeiesesatuuv w r3) r+r*r4rrrr9rr:rr2r5r3r"rrFs-0 IIsKK r3rc|Dcgc]}|js|}}|Dcgc]}|jr|}}djd|D}djd|D}|}|r |r|d|n|}|Scc}wcc}w)a Format input parameters into a string representation, with required params first followed by optional ones. Args: inputs: List of input parameters with 'required' and 'name' attributes, and 'default' for optional params Returns: str: Formatted string of input parameters Example: >>> inputs = [ ... InputParam(name="prompt", required=True), ... InputParam(name="image", required=True), ... InputParam(name="guidance_scale", required=False, default=7.5), ... InputParam(name="num_inference_steps", required=False, default=50) ... ] >>> format_inputs_short(inputs) 'prompt, image, guidance_scale=7.5, num_inference_steps=50' r%c34K|]}|jywr)r8rgparams r"riz&format_inputs_short..hsEEUZZEsc3RK|]}|jd|j!yw)=N)r8r=rs r"riz&format_inputs_short..is#Z |1U]]O<Zs%')rr/)inputsrrequired_inputsoptional_inputs required_str optional_str inputs_strs r"format_inputs_shortrUs +1CENNuCOC*0GuGOG99E_EEL99Z/ZZLJ8D |2l^4, DGsA:A:A?A?cg}|D]u}|j|vr |jd|jd1|j|jd|jz}n |j}|j|w|Dchc]}|j}}g}g}|D]G} | j|vr|j| j-|j| jIg} |r#| jddj||r#| jddj||r#| jddj|| rdj| Sd Scc}w) aI Formats intermediate inputs and outputs of a block into a string representation. Args: intermediate_inputs: List of intermediate input parameters required_intermediate_inputs: List of required intermediate input names intermediate_outputs: List of intermediate output parameters Returns: str: Formatted string like: Intermediates: - inputs: Required(latents), dtype - modified: latents # variables that appear in both inputs and outputs - outputs: images # new outputs only z Required(r&z*_z - inputs: r%z - modified: z - outputs:  z (none))r8r-rr/) intermediate_inputsrequired_intermediate_inputsintermediate_outputs input_partsinpinp_name inputs_setmodified_partsnew_output_partsoutros r"format_intermediates_shortrrs_"K") 883 3   388*A6 7xxCOO$?#//188   x ()'::s#((:J:N#. 88z !  ! !#(( +  # #CHH - . F tyy'=&>?@ (>)B(CDE  2B(C'DEF &499V 8L8%;sE,c|syd|z}d|dzz}d|dzz}g}d}d} |j||d|D]} | jtk7r|| jnd} | j| jd| jn | j} || d | d } t | d r/| j s#| d z } | j| d | jz } | dz } | jr5tjdd| j}| |||}| d||z } |j| dj|S)aFormat a list of InputParam or OutputParam objects into a readable string representation. Args: params: List of InputParam or OutputParam objects to format header: Header text to use (e.g. "Args" or "Returns") indent_level: Number of spaces to indent each parameter line (default: 4) max_line_length: Maximum length for each line before wrapping (default: 115) Returns: A formatted string representing all parameters r@ c,t|dra|jturO|jDcgc]%}t|dr |jn t |'}}ddj |dSt|dr |jSt |Scc}w)N __origin__r+zUnion[r%])rUrr __args__r+rr/)r9ttypess r" get_type_strz#format_params..get_type_strs 9l + 0D0D0MOXOaOab!71j#9QZZs1vEbEbDIIe,-Q/ /%,Y %Cy!!WYWcs*Bcj|j}g}g}d}|D]c}t||rdndz}|r7||z|kDr/|jdj||g}t|}N|j|||z }e|r |jdj|d|j|S)zFWrap text while preserving markdown links and maintaining indentation.rrr)rmrnr-r/) textindent max_lengthwordslines current_linecurrent_lengthword word_lengths r" wrap_textz format_params..wrap_texts   .Dd)Lqa@K >^+ ==,>%--!AAIT    66={EL]L]^D$T;HL 2k]<.9 9I *++. ;;' ((r3ct|d||S)aFormat a list of InputParam objects into a readable string representation. Args: input_params: List of InputParam objects to format indent_level: Number of spaces to indent each parameter line (default: 4) max_line_length: Maximum length for each line before wrapping (default: 115) Returns: A formatted string representing all input parameters Inputsr) input_paramsrrs r"format_input_paramsrs x OOr3ct|d||S)aFormat a list of OutputParam objects into a readable string representation. Args: output_params: List of OutputParam objects to format indent_level: Number of spaces to indent each parameter line (default: 4) max_line_length: Maximum length for each line before wrapping (default: 115) Returns: A formatted string representing all output parameters Outputsr) output_paramsrrs r"format_output_paramsrs  < QQr3c|syd|z}d|dzz}g}|j|d|r|jdt|D]\}}t|jdr|jjnt |j} ||j d| d} |jr| d|jz } g} |jD]'} t|| } | | j| d | )| r| d d j| d z } |j| |s|t|d z ks|jd dj|S)aFormat a list of ComponentSpec objects into a readable string representation. Args: components: List of ComponentSpec objects to format indent_level: Number of spaces to indent each component line (default: 4) max_line_length: Maximum length for each line before wrapping (default: 115) add_empty_lines: Whether to add empty lines between components (default: True) Returns: A formatted string representing all components r@rrz Components:r+rz`)rrz [r%rrr) r-r'rUr9r+rr8r:rcrjr/rn) componentsrradd_empty_linesrcomponent_indentformatted_componentsr0rO type_namecomponent_descloading_field_values field_name field_values r"format_componentsrs  $KlQ./;-{ ;<##B'"*-, 9-4I4G4G,TI   ( (Z]^g^q^qZr --inn-=S 2N  9#8#8"9: :N "#224 KJ!)Z8K&$++zl!K=,IJ K 499-A#B"C1E EN##N3 q3z?Q#66 ' ' +3,6 99) **r3c|syd|z}d|dzz}g}|j|d|r|jdt|D]x\}}||jd|jd} |jr| d|jz } |j| |sV|t |dz ksh|jdzd j |S) aFormat a list of ConfigSpec objects into a readable string representation. Args: configs: List of ConfigSpec objects to format indent_level: Number of spaces to indent each config line (default: 4) max_line_length: Maximum length for each line before wrapping (default: 115) add_empty_lines: Whether to add empty lines between configs (default: True) Returns: A formatted string representing all configs r@rrzConfigs:z (default: r&rrr)r-r'r8r=r:rnr/) configsrrrr config_indentformatted_configsr0r; config_descs r"format_configsrEs  $K.s D Dsrr)r)striprmr/rnrrrr) routputsr: class_nameexpected_componentsexpected_configsoutput desc_lines aligned_desccomponents_str configs_strs r"make_doc_stringrks0FF:,d++ &&(..t4 yy D DD ,''s#67!;*+>QO.6))C 01A5$%5AF +&& !&q99F fF "7;;F Mr3)Argsrs)rr)rrT)r@NNN)'rsr collectionsr dataclassesrrrtypingrrr r r r r rVconfiguration_utilsrrutilsrr get_loggerr+rZrr7rrrrrrrrrrrr5r3r"r s #00BBB 9/   H %E[EJ __ _D && &  g g  g       :/9dK)\ P R4+n#(R 5r3