bi lddlmZddlmZmZej eZerddlm Z dde fdZ y)N)is_accelerate_availablelogging)init_empty_weightsmodules_to_not_convertc( ddlmm}m m m m dtf fd fd|||}tfd|jD}|s,tj|jjd|r|||S)Nr)QLinearfreezeqfloat8qint2qint4qint8dtypecd|S)N)float8int8int4int2)rr r r rs \/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/diffusers/quantizers/quanto/utils.py_get_weight_typez5_replace_with_quanto_layers.._get_weight_types!5%OPUVVc :t|j}|s|S|jD]\}} |||||vrt|tj s0t 5|j|j|jdu|jj|j}||j|<t||j|_|j|j!dddd|S#1swYxYw)N) in_features out_featuresbiasrweightsF)listchildrennamed_children isinstancennLinearrrrrweightr weights_dtype_modulestype source_clsrequires_grad_) modelquantization_configr has_childrennamemoduleqlinearr r_replace_layerss rr0z4_replace_with_quanto_layers.._replace_layerssENN,- L!002 ?LD& F$79O P--&")),') ?%$*$6$6%+%8%8#[[4$mm11 01D1R1R S G,3ENN4(6:6lENN4(3NN4(77> ? ? ?&  ? ?s )BDD c3<K|]\}}t|yw)N)r!).0_replaced_moduler s r z._replace_with_quanto_layers...sqEWQJ@qsz does not appear to have any `nn.Linear` modules. Quantization will not be applied. Please check your model architecture, or submit an issue on Github if you think this is a bug. https://github.com/huggingface/diffusers/issues/new)optimum.quantor r r r r rstrany named_modulesloggerwarning __class____name__) r*r+r pre_quantizedr has_been_replacedr rr0r r r rs @@@@@@@r_replace_with_quanto_layersr@ sLLWWW4 E#68N OEq[`[n[n[pqq ''()C C u Lr)F) torch.nnr"utilsrr get_loggerr=r: acceleraterrr@rrrrEs55   H %-0TX0r