biEvddlmZddlZddlmZmZmZmZmZm Z ddl m Z m Z ddl mZdZd e fd efd Zd Zd Zy))PathN)is_hpu_availableis_mlu_availableis_musa_availableis_npu_availableis_sdaa_availableis_xpu_available) ClusterConfigdefault_json_config_file)SubcommandHelpFormatterzFCreate a default config file for Accelerate with only a few flags set.no save_locationc*t|}|jjdd|jrt d|dy|j }|dvrt d|d|d }tr8tjj}||d <d|d <|d kDrd |d<nd|d<tr;tjj}||d <d|d <|d kDrd|d<n}d|d<nvtr;tjj}||d <d|d <|d kDrd|d<n8d|d<n1tr9tj j}||d <d|d <|d kDrd|d<nd|d<ntj"j%r9tj"j}||d <d|d <|d kDrd|d<nd|d<nt'r9tj(j} | |d <d|d <| d kDrd|d<nZd|d<nTt+r9tj,j} | |d <d|d <| d kDrd|d<nd|d<nd} d|d <d |d <d|d<d|d<d|d<t/di|}|j1||S)a Creates and saves a basic cluster config to be used on a local machine with potentially multiple GPUs. Will also set CPU if it is a CPU-only machine. Args: mixed_precision (`str`, *optional*, defaults to "no"): Mixed Precision to use. Should be one of "no", "fp16", or "bf16" save_location (`str`, *optional*, defaults to `default_json_config_file`): Optional custom save location. Should be passed to `--config_file` when using `accelerate launch`. Default location is inside the huggingface cache folder (`~/.cache/huggingface`) but can be overridden by setting the `HF_HOME` environmental variable, followed by `accelerate/default_config.yaml`. T)parentsexist_okz Configuration already exists at zZ, will not override. Run `accelerate config` manually or pass a different `save_location`.F)rfp16bf16fp8zL`mixed_precision` should be one of 'no', 'fp16', 'bf16', or 'fp8'. Received LOCAL_MACHINE)compute_environmentmixed_precision num_processesuse_cpur MULTI_MLUdistributed_typeNO MULTI_SDAA MULTI_MUSA MULTI_HPU MULTI_GPU MULTI_XPU MULTI_NPUrdebugenable_cpu_affinity)rparentmkdirexistsprintlower ValueErrorrtorchmlu device_countr sdaarmusarhpucuda is_availabler xpurnpur to_json_file) rrpathconfignum_mlus num_sdaas num_musasnum_hpusnum_gpusnum_xpusnum_npuss ]/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/accelerate/commands/config/default.pywrite_basic_configrC$s  DKKdT2 {{} .}o>X Y %++-O;;Z[jZk l   /*F99))+"*!y a<)4F% &)-F% &JJ++- "+!y q=)5F% &)-F% &  JJ++- "+!y q=)5F% &)-F% &  99))+"*!y a<)4F% &)-F% &  "::**,"*!y a<)4F% &)-F% &  99))+"*!y a<)4F% &)-F% &  99))+"*!y a<)4F% &)-F% & y"#%)!"F7O$)F !  $V $F  Kc|jd|tt}|jdtdd|jdgdt d d |j t |S) Ndefault)rhelpformatter_classz --config_fileaTThe path to use to store the config file. Will default to a file named default_config.yaml in the cache location, which is the content of the environment `HF_HOME` suffixed with 'accelerate', or if you don't have such an environment variable, your cache directory ('~/.cache' or the content of `XDG_CACHE_HOME`) suffixed with 'huggingface'.r)rFrGdestz--mixed_precision)rrrzWhether or not to use mixed precision training. Choose between FP16 and BF16 (bfloat16) training. BF16 training is only supported on Nvidia Ampere GPUs and PyTorch 1.10 or later.r)choicestyperGrF)func) add_parser descriptionr add_argumentr str set_defaultsdefault_config_command)parserrs rBdefault_command_parserrTs   y' ]t  uF ( "   & [ 34 MrDcft|j|j}|rtd|yy)Nz"accelerate configuration saved at )rCrrr+)args config_files rBrRrRs2$T%9%94;M;MNK 2;-@ArD)pathlibrr.utilsrrrrr r config_argsr r config_utilsrrNrPrCrTrRr'rDrBr\sJ" A1W (,BZ^C^B6BrD