bi ddlZddlZddlZddlmZddlmZddlmZm Z e rddl Z erddl Z ejdede dedfd Zd edefd Zy) N) Generator)Trainer)is_mlflow_availableis_wandb_availabletrainernamereturn)NNNc#(Ktj}dtj}||z }d|jjd||i}d|jj vr;t j+|jjrt j|d|jj vrTtjC|jjr,tj||jjyyyyw)aB A context manager function for profiling a block of code. Results are logged to Weights & Biases or MLflow depending on the trainer's configuration. Args: trainer (`~transformers.Trainer`): Trainer object. name (`str`): Name of the block to be profiled. Used as a key in the logged dictionary. Example: ```python from transformers import Trainer from trl.extras.profiling import profiling_context class MyTrainer(Trainer): def some_method(self): A = np.random.rand(1000, 1000) B = np.random.rand(1000, 1000) with profiling_context(self, "matrix_multiplication"): # Code to profile: simulate a computationally expensive operation result = A @ B # Matrix multiplication ``` Nzprofiling/Time taken: .wandbmlflow)step)time perf_counter __class____name__args report_tor run acceleratoris_main_processlogr log_metricsstate global_step)rr start_timeend_timedurationprofiling_metricss O/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/trl/extras/profiling.pyprofiling_contextr!s6""$J   "H*$H1'2C2C2L2L1MQtfUW_`',,(((UYY-BwGZGZGjGj #$7<<)))fjj.DI\I\IlIl,7==3L3LMJm.D)sDDfunccBtjfd}|S)aV Decorator to profile a function and log execution time using [`extras.profiling.profiling_context`]. Args: func (`callable`): Function to be profiled. Example: ```python from transformers import Trainer from trl.extras.profiling import profiling_decorator class MyTrainer(Trainer): @profiling_decorator def some_method(self): A = np.random.rand(1000, 1000) B = np.random.rand(1000, 1000) # Code to profile: simulate a computationally expensive operation result = A @ B ``` ctt|j5|g|i|cdddS#1swYyxYw)N)r!r)selfrkwargsr"s r wrapperz$profiling_decorator..wrapper_s8 tT]] 3 /.t.v. / / /s .7) functoolswraps)r"r's` r profiling_decoratorr*Gs'0__T// N) contextlibr(rcollections.abcr transformersrtransformers.integrationsrrr r contextmanagerstrr!callabler*r+r r4s{ % M $Nw$Nc$Ni@P6Q$N$NNh8r+