bi4@ddlmZmZddlmZeGddeZy)) dataclassfield)OnlineDPOConfigcNeZdZUdZedddiZeeed<fdZ xZ S) NashMDConfiga Configuration class for the [`NashMDTrainer`]. Subclass of [`OnlineDPOConfig`] we can use all its arguments and add the following: Parameters: mixture_coef (`float` or `list[float]`, *optional*, defaults to `0.5`): Logit mixture coefficient for the model and reference model. If a list of floats is provided then the mixture coefficient is selected for each new epoch and the last coefficient is used for the rest of the epochs. cdgS)Ng?r U/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/trl/trainer/nash_md_config.pyzNashMDConfig.#sr helpzLogit mixture coefficient for the model and reference model. If a list of floats is provided then the mixture coefficient is selected for each new epoch and the last coefficient is used for the rest of the epochs.)default_factorymetadata mixture_coefct|t|jdr.t |jdk(r|jd|_yyy)N__len__r)super __post_init__hasattrrlen)self __class__s r rzNashMDConfig.__post_init__+sL  4$$i 0S9J9J5Kq5P $ 1 1! 4D 6Q 0r ) __name__ __module__ __qualname____doc__rrlistfloat__annotations__r __classcell__)rs@r rrs9 !&% " !L$u+55r rN) dataclassesrrtrl.trainer.online_dpo_configrrr r r r$s()9 5?5 5r