bi_ddlZddlZddlZddlZddlZddlZddlmZddlm Z m Z m Z m Z ddl mZddlmZmZmZmZmZmZmZmZddlmZmZddlmZddlmZmZm Z m!Z!m"Z"dd l#m$Z$dd l%m&Z&d d l'm(Z(d dl)m*Z*m+Z+m,Z,m-Z-d dl.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6d dl7m8Z8e8e9Z:ee;jxdz Z=ej|Z?d:de e e@dfde@fdZA d;de@de e@deBdeBde e@de@de e@de e@de e eCde eBdefd ZDd:d!ed"e e@e e@fdefd#ZEd:d$e e@d%e e@fd&ZFd:d'e@d(e e@de@fd)ZGe"ddddddddddd* d+e e@efd'e@d,e e@d-e e@d.eBd/e e d0eBde e@de e e e@fd1e e@d%e e@d2e e e@effd3ZH dN)Path)DictListOptionalUnion)uuid4) DDUFEntry ModelCard ModelCardData create_repohf_hub_download model_infosnapshot_download upload_folder)HF_HUB_DISABLE_TELEMETRYHF_HUB_OFFLINE)REGEX_COMMIT_HASH)EntryNotFoundErrorRepositoryNotFoundErrorRevisionNotFoundErroris_jinja_availablevalidate_hf_hub_args)version) HTTPError) __version__)DEPRECATED_REVISION_ARGSHUGGINGFACE_CO_RESOLVE_ENDPOINTSAFETENSORS_WEIGHTS_NAME WEIGHTS_NAME)ENV_VARS_TRUE_VALUES _flax_version _jax_version_onnxruntime_version_torch_versionis_flax_availableis_onnx_availableis_torch_available) get_loggerzmodel_card_template.md user_agentreturncFdtdtjjddt}t st r|dzStr |dtz }tr|dtz }|dtz }tr |d tz }tjj!d d j#t$vr|d z }t'|t(r.|d d j+d|j-Dzz }|St'|t.r|d |zz }|S)zF Formats a user-agent string with basic info about a request. z diffusers/z ; python/rz ; session_id/z; telemetry/offz; torch/z; jax/z; flax/z; onnxruntime/DIFFUSERS_IS_CIz ; is_ci/truez; c30K|]\}}|d|yw)/N).0kvs T/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/utils/hub_utils.py z"http_user_agent..]sIda!AaSzIs)rsysrsplit SESSION_IDrrr)r&r'r$r#r(r%osenvirongetupperr" isinstancedictjoinitemsstr)r+uas r6http_user_agentrEKs k])CKK,=,=,?,B+C=Q[P\ ]B>%%% ()) |n%%  '' 3455 zz~~',2248LL n*d# dTYYIj6F6F6HIIII I J $ dZ IFrepo_id_or_pathtoken is_pipeline from_trainingmodel_description base_modelpromptlicensewidget inferencec Jts td tj||} | S#tt f$rc|r.tj t|d| |||t|} Y| St} |rdnd} |d| d }tj | | } Y| SwxYw) a Loads or creates a model card. Args: repo_id_or_path (`str`): The repo id (e.g., "runwayml/stable-diffusion-v1-5") or local path where to look for the model card. token (`str`, *optional*): Authentication token. Will default to the stored token. See https://huggingface.co/settings/token for more details. is_pipeline (`bool`): Boolean to indicate if we're adding tag to a [`DiffusionPipeline`]. from_training: (`bool`): Boolean flag to denote if the model card is being created from a training script. model_description (`str`, *optional*): Model description to add to the model card. Helpful when using `load_or_create_model_card` from a training script. base_model (`str`): Base model identifier (e.g., "stabilityai/stable-diffusion-xl-base-1.0"). Useful for DreamBooth-like training. prompt (`str`, *optional*): Prompt used for training. Useful for DreamBooth-like training. license: (`str`, *optional*): License of the output artifact. Helpful when using `load_or_create_model_card` from a training script. widget (`List[dict]`, *optional*): Widget to accompany a gallery template. inference: (`bool`, optional): Whether to turn on inference widget. Helpful when using `load_or_create_model_card` from a training script. zModelcard rendering is based on Jinja templates. Please make sure to have `jinja` installed before using `load_or_create_model_card`. To install it, please run `pip install Jinja2`.rH diffusers)rN library_namerPrLinstance_promptrO) card_data template_pathrKpipelinemodelu+This is the model card of a 🧨 diffusers zS that has been pushed on the Hub. This model card has been automatically generated.)rK) r ValueErrorr loadrr from_templater MODEL_CARD_TEMPLATE_PATH) rGrHrIrJrKrLrMrNrOrP model_cardrV components r6load_or_create_model_cardr`csF   ?  a^^O5A . -  7 8a "00'#!,')$*! 7"3 J&  &I&1 wI (&QR[Q\]p%q!"00N_`J -as0;HDHrF weights_namevariantcl|1|jd}|dd|gz|ddz}dj|}|S)N.)r9rA)rprqsplitss r6 _add_variantrvsI##C(y(6"#;6xx' rF) subfolder cache_dirforce_downloadproxieslocal_files_onlyrHr+revisionrh dduf_entriespretrained_model_name_or_pathrwrxryrzr{r|r}c t|}| rM| td|dk(r|ndj||g} | | vr| Std|d| j dt j j|r|St j j|rt j jt j j||r"t j j||} | S|at j jt j j|||r#t j j|||} | Std|d|d| tvr|tk(s |tk(rtjtjtjtjdk\rS t!|t#|| |||||||| xs| } t%j&d | d |d | d | d| d| d t(| S t!|||||||||| xs| } | S#t%j&d| d |d | d| d|dt#|| d|d|dt#|| dt(YjxYw#t*$r} t|d| d} ~ wt,$r} t| d|d| d} ~ wt.$r} t|d|d| d} ~ wt0$r} td|d| | d} ~ wt$r} tdt2d |d!|d"| d} ~ wt$r} td#|d$|d%|| d} ~ wwxYw)&NzDDUF file only allow for 1 level of directory (e.g transformer/model1/model.safetentors is not allowed). Please check the DDUF structurer/r1zError no file named z found in archive rsz found in directory z0.22.0) filenamerxryrzr{rHr+rwr|zLoading the variant z from z via `revision='zG'` is deprecated. Loading instead from `revision='main'` with `variant=z)`. Loading model variants via `revision='z9'` will be removed in diffusers v1. Please use `variant='z '` instead.zYou are loading the variant z^'`. This behavior is deprecated and will be removed in diffusers v1. One should use `variant='z%'` instead. However, it appears that z currently does not have a z file in the 'main' branch of z. The Diffusers team and community would be very grateful if you could open an issue: https://github.com/huggingface/diffusers/issues/new with the title 'z is missing z0' so that the correct variant file can be added.z is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models' If this is a private repository, make sure to pass a token having permission to this repo with `token` or log in with `hf auth login`.z is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/z' for available revisions.& does not appear to have a file named z:There was a specific connection error when trying to load z: We couldn't connect to 'zM' to load this model, couldn't find it in the cached files and it looks like z8 is not the path to a directory containing a file named z or Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/diffusers/installation#offline-mode'.zCan't load the model for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z=' is the correct path to a directory containing a file named )rCrZrAEnvironmentErrorkeysr;pathisfileisdirrr!r rparser base_versionr rvwarningswarn FutureWarningrrrrr)r~rprwrxryrzr{rHr+r|rhr} model_filees r6_get_model_filers %((E$F!  2  -2 8,GH   % "%9,GYZfZkZkZmYnno#pq q 5 6,, 4 5 77>>"'',,'DlS T&C\RJ   "rww~~ GGLL6 < P( &CYP\]J "&|n4HIfHgghi  0 0-AY1Y gmmK8EEF'--X`Jaa ,1),A'#1#%5)'%4   *8*F;X:YYijrist{|D{EEnownxxqrzq{{FG!"! 2 (-%#-!1%#!0[ J '  28*FC`Baaqrzq{|Z[cZddIJgIhhCDPQ]_gDhCiiGHeGffC D a C b b n o { | H J R o S n T T D E !(' "012dd   % "*++H*IIce   " "011WXdWeefg  "LMjLkknopnqr  "*+J*KL::W9XY66B^Dff     ",-J,KL))F(GH++7.:    sbAI)JA J MJ-- M9K  MK)) M5L ML-- M9MMc X| r|| vrCtd|d|dtjj|std|d|d| r't j | |j } n8t|d5} t j | j} dddtt dj} | d} t| dj| d<| dj| d<tjj||}tjj!|s| r| D cgc]"} tjj|| $}} |D]J| r| vs t#|d d tjj%r;t#|d d || fS| }|-|Dcgc]"}tjj||$}}d d g}|sFt'||| }| D]3t)fd|j*D}|r$t-|d d  t/||||||||| }| tjj||}| D cgc]"} tjj|| $}} |D]2}tjj|r#t-|d|d || fS#1swYFxYwcc} wcc}w#t0$r}t-dt2d|d|d}~wwxYwcc} w)a For a given model: - download and cache all the shards of a sharded checkpoint if `pretrained_model_name_or_path` is a model ID on the Hub - returns the list of paths to all the shards, as well as some metadata. For the description of each arg, see [`PreTrainedModel.from_pretrained`]. `index_filename` is the full path to the index (downloaded and cached if `pretrained_model_name_or_path` is a model ID on the Hub). zCan't find a checkpoint index (z) in rsrN weight_mapmetadataall_checkpoint_keysrz5 which is required according to the checkpoint index.z*.jsonz*.md)r|rHc3:K|]}|jvywN) rfilename)r3r4 shard_files r6r7z._get_checkpoint_shard_files..s$b1Z1;;%>$bs)rxrzr{rHr|allow_patternsignore_patternsr+rz ' to load z?. You should try again after checking your internet connection.z does not have a file named )rZr;rrjsonloads read_textopenreadsortedsetvalueslistrcopyrArFileNotFoundErrorexistsranysiblingsrrrr)r~index_filenamerxrzr{rHr+r|rwr}indexforiginal_shard_filenamessharded_metadata shards_pathshard_filenamesrprmodel_files_infoshard_file_present cached_folderrcached_filenames cached_filers @r6_get_checkpoint_shard_filesrTs,  ->~>NeTqSrrstu uww~~n->~>NeTqSrrstu u <7AACD .# & )!JJqvvx(E ) &c% *=*D*D*F&GHZ(.253F3K3K3M.N*+%*<%8%=%=%?\"'',,LM"'',,y!4MM(O %&Ch^cd2 J!$$bHXHaHa$b!b %&"m#I*VBB ) )-)+!    GGLL BMAYY1 ]A6YY' ww~~k*" /!=k]JA  - --Y ) )[&NB &'F&GzRoQpq> >   Zs6$K('K5'K: 6K?'L'(K2? L$LL$folder filenamesc4|r |r td|sUg}tj|D];\}}}|D]0}|jtjj |2=d}t jd|d|dtfd|DS)Nz1Both `filenames` and `folder` cannot be provided.z\d{5}-of-\d{5}z.*-z\.z \.[a-z]+$c3DK|]}j|duywr)rn)r3rvariant_file_res r6r7z8_check_legacy_sharding_variant_format..s!G$$Q't3Gs ) rZr;walkrdrbasenamerkcompiler)rrrq_filesfiletransformers_index_formatrs @r6%_check_legacy_sharding_variant_formatrsVLMM  776? 9KAq% 9  !1!1$!78 9 9!2jjC(A'B"WIY!WXO GYG GGrFceZdZdZ ddeeejfdedeedeede deef d Z ddedeed ee deede d e d eedeed efdZ y)PushToHubMixinzR A Mixin to push a model, scheduler, or pipeline to the Hugging Face Hub. N working_dirrepo_idrHcommit_message create_prrwc|Od|jjvrd}n4d|jjvrd}nd|jj}tjd|d|dt |||||| S) zB Uploads all files in `working_dir` to `repo_id`. Modelz Upload model SchedulerzUpload schedulerzUpload zUploading the files of z to rs)r folder_pathrHrr path_in_repo) __class____name__loggerinfor)selfrrrHrrrws r6_upload_folderzPushToHubMixin._upload_folders  !$..111!/ 7 77!3#*4>>+B+B*C!D -k]$wiqIJ#)"   rFprivatesafe_serializationrqr,c t|||dj}|st||} t| } d|i} d|jj vr| j d|itj5} |j| fi| |s/ jtjj| d|j| |||||cd d d S#1swYy xYw) uy Upload model, scheduler, or pipeline files to the 🤗 Hugging Face Hub. Parameters: repo_id (`str`): The name of the repository you want to push your model, scheduler, or pipeline files to. It should contain your organization name when pushing to an organization. `repo_id` can also be a path to a local directory. commit_message (`str`, *optional*): Message to commit while pushing. Default to `"Upload {object}"`. private (`bool`, *optional*): Whether to make the repo private. If `None` (default), the repo will be public unless the organization's default is private. This value is ignored if the repo already exists. token (`str`, *optional*): The token to use as HTTP bearer authorization for remote files. The token generated when running `hf auth login` (stored in `~/.huggingface`). create_pr (`bool`, *optional*, defaults to `False`): Whether or not to create a PR with the uploaded files or directly commit. safe_serialization (`bool`, *optional*, defaults to `True`): Whether or not to convert the model weights to the `safetensors` format. variant (`str`, *optional*): If specified, weights are saved in the format `pytorch_model..bin`. Examples: ```python from diffusers import UNet2DConditionModel unet = UNet2DConditionModel.from_pretrained("stabilityai/stable-diffusion-2", subfolder="unet") # Push the `unet` to your namespace with the name "my-finetuned-unet". unet.push_to_hub("my-finetuned-unet") # Push the `unet` to an organization with the name "my-finetuned-unet". unet.push_to_hub("your-org/my-finetuned-unet") ``` T)rrHexist_okrRrrrqz README.md)rHrrrwN)r rr`rfrrupdatetempfileTemporaryDirectorysave_pretrainedsaver;rrAr) rrrrrHrrrqrwr^ save_kwargstmpdirs r6 push_to_hubzPushToHubMixin.push_to_hubs`gwedS[[27%HJ,Z8J,-?@ dnn55 5    73 4  ( ( * f D  7; 7 V[ AB&&-## '   s 7ACC%)NNFN)NNNFTNN) r __module__ __qualname____doc__rrCr;PathLikerboolrrr2rFr6rrs $(,#' 3 +,  }  !    C= B)-"&##'!%#'JJ! J$ J } J  J!J#JC=J JrFrr) NNFFNNNNNN)NNFNNNr/N)NNN)Lrr;rkr8rrpathlibrtypingrrrruuidrhuggingface_hubr r r r r rrrhuggingface_hub.constantsrrhuggingface_hub.file_downloadrhuggingface_hub.utilsrrrrr packagingrrequestsrr/r constantsrrr r! import_utilsr"r#r$r%r&r'r(r)loggingr*rr__file__parentr]hexr:rCrErr@r`rfrorvrrrrr2rFr6rs7" ..   O;     H >003KK W[[ dCo 6#2 '+ !#' $CC C=CC C  } C  C SMCc]C T$Z C~CCL I U3S >5J V_  Ix} I8C= IsXc]c $# ""-1"!%37@#(d#3@@} @ } @  @d^@@ C=@tSy)*@sm@#@4Y/0@@L   37l.4Y/0l.^ H# Hc Hdg HmmrF