bij" ddlZddlZddlmZddlmZmZddlZddl m Z ddl m Z ddl mZmZmZmZerddlZej(eZej.ej0ej2ej4ej6ej8ej:ej<ej>ej@ejBejDd Z#Gd d Z$y) N)Path)OptionalUnion)hf_hub_download)validate_hf_hub_args)ONNX_EXTERNAL_WEIGHTS_NAMEONNX_WEIGHTS_NAMEis_onnx_availablelogging) z tensor(bool)z tensor(int8)z tensor(uint8)z tensor(int16)ztensor(uint16)z tensor(int32)ztensor(uint32)z tensor(int64)ztensor(uint64)ztensor(float16)z tensor(float)ztensor(double)cbeZdZddZdZeddeeeffdZ ddeeefde efdZ deee jffd Zee dd eeefd e eeedfd e eedfd ede ede ede ede dfdZee dd eeefd ed e ede efdZy)OnnxRuntimeModelNc tjd||_|jdd|_|jdt |_y)NzL`diffusers.OnnxRuntimeModel` is experimental and might change in the future.model_save_dirlatest_model_name)loggerinfomodelgetrr r)selfrkwargss Y/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/pipelines/onnx_utils.py__init__zOnnxRuntimeModel.__init__5s? bc $jj)94@!',?AR!Sc |jDcic]\}}|tj|}}}|jj d|Scc}}wN)itemsnparrayrrun)rrkvinputss r__call__zOnnxRuntimeModel.__call__;sE-3\\^>. ) LL?>*::]^ _  NT2 n77rmodel_idtokenrevisionforce_download cache_dirr/r)zort.SessionOptionsc  ||nt} tjj|rOtj t || j||| jd} t || d<nit|| ||||} t | j| d<t | j| d<tj | ||| jd} |dd| i| S)aA Load a model from a directory or the HF Hub. Arguments: model_id (`str` or `Path`): Directory from which to load token (`str` or `bool`): Is needed to load models from a private or gated repository revision (`str`): Revision is the specific model version to use. It can be a branch name, a tag name, or a commit id cache_dir (`Union[str, Path]`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force the (re-)download of the model weights and configuration files, overriding the cached versions if they exist. file_name(`str`): Overwrites the default model file name from `"model.onnx"` to `file_name`. This allows you to load different model files from the same repository or directory. provider(`str`): The ONNX runtime provider, e.g. `CPUExecutionProvider` or `CUDAExecutionProvider`. kwargs (`Dict`, *optional*): kwargs will be passed to the model during initialization r*)r/r)r*r)repo_idfilenamerErFrHrGrr) r r?r%isdirrr0ras_posixpoprparentname) clsrDrErFrGrHr2r/r)rr9rmodel_cache_paths r_from_pretrainedz!OnnxRuntimeModel._from_pretrainedsL(1'<)BS 77== "$//X/88:!)!',>!? 0E (,H~F# $ / (!#-   (,,<'='D'DF# $*./?*@*E*EF& '$// !)!',>!? 0E ))&))rc d}tt|jddk(r|jd\}}|jd|||||d|S)N@r)rDrFrHrGrErL)lenstrsplitrT)rRrDrGrErH model_kwargsrFs rfrom_pretrainedz OnnxRuntimeModel.from_pretrainedsk s8}""3' (A -!)!4 Hh#s## )     rr)NNN)NNFNNNN)TNN)__name__ __module__ __qualname__rr$ staticmethodrrXrr0rr<r?PathLikerC classmethodrboolrTr[rLrrrr4sT , sDy)  .uS$Y/?HUXM>8c2;;./8,37/3$#'#'"&7;A*T "A*dCo./A*5d+, A*  A* C= A*C=A*3-A*34A*A*F $##'  T "  }  C=   rr)%r?r5pathlibrtypingrrnumpyrhuggingface_hubrhuggingface_hub.utilsrutilsr r r r onnxruntimer- get_loggerr\rbool_int8uint8int16uint16int32uint32int64uint64float16float32float64ORT_TO_NP_TYPErrLrrrxs$ "+6]]   H %HHGGXXXXiiXXiiXXiizzZZjj  r r r