biedUddlmZddlZddlZddlmZddlmZmZm Z m Z m Z m Z m Z ddlmZddlmZmZmZmZmZmZmZddlmZdd lmZeeeeeed Zd ed <Gd dZGddeZGddeZ GddeZ!GddeZ"GddeZ#GddeZ$GddeZ%y)) annotationsN)Optional) AutoModelAutoModelForCausalLMAutoModelForQuestionAnsweringAutoModelForSeq2SeqLM"AutoModelForSequenceClassificationAutoModelForTokenClassification AutoTokenizer) PeftConfig) PeftModelPeftModelForCausalLMPeftModelForFeatureExtractionPeftModelForQuestionAnsweringPeftModelForSeq2SeqLM"PeftModelForSequenceClassificationPeftModelForTokenClassification)TOKENIZER_CONFIG_NAME)check_file_exists_on_hf_hub)SEQ_CLS SEQ_2_SEQ_LM CAUSAL_LM TOKEN_CLS QUESTION_ANSFEATURE_EXTRACTIONzdict[str, type[PeftModel]] MODEL_TYPE_TO_PEFT_MODEL_MAPPINGcDeZdZdZdZdZe d ddZy)_BaseAutoPeftModelNct|jjd|jjd|jjd)Nz+ is designed to be instantiated using the `z5.from_pretrained(pretrained_model_name_or_path)` or `z.from_config(config)` methods.)EnvironmentError __class____name__)selfargskwargss D/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/peft/auto.py__init__z_BaseAutoPeftModel.__init__;sR~~&&'(..1123''((F H  c tj|fd|i|}|j}|j} t |dd} |j |j } n|j | t d| \t| } |jj| jk7rt d| jd|jjd| Ft |dd9t |dd} | d }| d }tj|}t ||} n t d  j|fd| i|}d }tjjtjj|t rd }nJ|j#dd}||j#dd}t%|t ||j#dd|}|rt'|drvt)j||j#dd }|j+j,j.d}t1||kDr|j3t1||jj||f|||d|S)a A wrapper around all the preprocessing steps a user needs to perform in order to load a PEFT model. The kwargs are passed along to `PeftConfig` that automatically takes care of filtering the kwargs of the Hub methods and the config object init. revision task_typeNzCannot use `AutoPeftModel` with a task type, please use a specific class for your task type. (e.g. `AutoPeftModelForCausalLM` for `task_type='CAUSAL_LM'`)zExpected target PEFT class: z, but you have asked for: zE make sure that you are loading the correct model for your task type. auto_mappingbase_model_classparent_libraryzxCannot infer the auto class from the config, please make sure that you are loading the correct model for your task type.FTtokenuse_auth_token repo_type)repo_idfilenamer+r2r0get_input_embeddingstrust_remote_code)r6r) adapter_name is_trainableconfig)r from_pretrainedbase_model_name_or_pathr+getattr _target_class ValueErrorr_target_peft_classr# importlib import_moduleospathexistsjoinrgetrhasattrr r5weightshapelenresize_token_embeddings)clspretrained_model_name_or_pathr7r8r9r+r& peft_configbase_model_pathbase_model_revisionr, target_classexpected_target_classr-r.parent_library_namer/ base_modeltokenizer_existsr0 tokenizerembedding_sizes r'r:z"_BaseAutoPeftModel.from_pretrainedCs!001NlYalekl %==)22Kd;    (,,L    &9+@m   $DY$O !%%..2G2P2PP 23H3Q3Q2RRlmpnDnDnMnMmN[\ 7;#M#Y";EL+,>? "./?"@ &445HIN">3CDLK 2\11/jL_jcij   77>>"'',,'DF[\ ]# JJw-E} #3T::5.! **[$7     4J K%55-L_afAgI(<<>EEKKANN9~.223y>B5s%%55  ) &%     r))defaultFNN)r7strr8boolr9zOptional[PeftConfig]r+z Optional[str])r# __module__ __qualname__r=r?r( classmethodr:r)r'rr7sbM &"'+"& Q Q  Q % Q  Q Q r)rceZdZdZeZy) AutoPeftModelN)r#r[r\r=rr?r^r)r'r`r`s M"r)r`ceZdZeZeZy)AutoPeftModelForCausalLMN)r#r[r\rr=rr?r^r)r'rbrbs (M-r)rbceZdZeZeZy)AutoPeftModelForSeq2SeqLMN)r#r[r\rr=rr?r^r)r'rdrds )M.r)rdceZdZeZeZy)&AutoPeftModelForSequenceClassificationN)r#r[r\r r=rr?r^r)r'rfrfs 6M;r)rfceZdZeZeZy)#AutoPeftModelForTokenClassificationN)r#r[r\r r=rr?r^r)r'rhrhs 3M8r)rhceZdZeZeZy)!AutoPeftModelForQuestionAnsweringN)r#r[r\rr=rr?r^r)r'rjrjs 1M6r)rjceZdZeZeZy)!AutoPeftModelForFeatureExtractionN)r#r[r\rr=rr?r^r)r'rlrls M6r)rl)& __future__rr@rBtypingr transformersrrrrr r r r9r peft_modelrrrrrrrutils.constantsr utils.otherrr__annotations__rr`rbrdrfrhrjrlr^r)r'rts# 342)%017 @ "<^ ^ B#&# .1. / 2/ <-?< 9*<9 7(:7 7(:7r)