bidZddlZddlmZmZmZddlmZmZddl m Z ddl m Z m Z mZmZmZmZddlmZdd lmZeee eed Ze e e eed ZGd d Zy) z Adapted from https://github.com/huggingface/transformers/blob/c409cd81777fb27aadc043ed3d8339dbc020fb3b/src/transformers/quantizers/auto.py N)DictOptionalUnion)BnB4BitDiffusersQuantizerBnB8BitDiffusersQuantizer) GGUFQuantizer)BitsAndBytesConfigGGUFQuantizationConfigQuantizationConfigMixinQuantizationMethod QuantoConfig TorchAoConfig)QuantoQuantizer)TorchAoHfQuantizer)bitsandbytes_4bitbitsandbytes_8bitggufquantotorchaoceZdZdZedefdZedeeeffdZ edZ edee efde efdZ y ) DiffusersAutoQuantizerz The auto diffusers quantizer class that takes care of automatically instantiating to the correct `DiffusersQuantizer` given the `QuantizationConfig`. quantization_config_dictc |jdd}|jdds|jddr*|jddrdnd}tj|z}n | td|tj vr,td|d t tj t|}|j|S) N quant_method load_in_8bitF load_in_4bit_4bit_8bitzThe model's quantization config from the arguments has no `quant_method` attribute. Make sure that the model has been correctly quantizedUnknown quantization type, got  - supported types are: ) getr BITS_AND_BYTES ValueError AUTO_QUANTIZATION_CONFIG_MAPPINGkeyslistAUTO_QUANTIZER_MAPPING from_dict)clsrrsuffix target_clss T/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/quantizers/auto.pyr)z DiffusersAutoQuantizer.from_dict;s/33NDI # ' ' >BZB^B^_motBu 8 < <^U SWY`F-<>>(9e4KT4Q.R990 4 4#"4)@#@A#(00G'H##r.r)rFr?typingrrr bitsandbytesrrrr r/r r r r rrrrrrr(r%rrHr.r-rKsk ((N$'32 ! ,+ " $ Z#Z#r.