ukiQxdZddlmZddlZddlmZmZddlmZm Z ddl Z ddl m Z ddl m Z ddlmZdd lmZddlZe dd Ze dd Zd Ze j*d d ddZe j*d d ddZe j*d dddZddZddZy)zColocated Python top-level API.) annotationsN)Anyoverload)CallableSequence)api_util)util) make_callable) wrap_classcyNdevices_or_meshs `/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/jax/experimental/colocated_python/api.pycolocated_cpu_devicesrcyr rrs rrr%rrct|tjjr t |St|t s t |} t |S#ttf$rt|cYSwxYw)aFinds devices or a mesh that has CPU devices colocated with the given devices or mesh. An accelerator device often accompanies a CPU device that is on the same host. Furthermore, when a single host has multiple accelerator devices, there can be multiple CPU devices, each of which is associated with one of the accelerator devices with a 1:1 correspondence. This function finds the colocated CPU devices for the given devices or mesh. When the input is a mesh, the returned value is another mesh that has the same shape as the input mesh but has colocated CPU devices. If an input device is already a CPU device, it is returned as-is. It preserves ordering. The output CPU device at index i is associated with the input accelerator device at index i. Args: devices_or_mesh: A tuple of devices or a mesh. Returns: A tuple of devices or a mesh that has the colocated CPU devices. ) isinstancejaxshardingMesh_colocated_cpu_mesh_cachedtuple_colocated_cpu_devices_cached ValueErrorAttributeError5_colocated_cpu_devices_cached_fallback_to_cpu_backendrs rrr,sk,!2!23 %o 66 OU +O,O ( 99 n % @ s AA43A4iF)max_sizetrace_context_in_keyc tjt}|djj D]0}|j dk(s||j j|2|s tdg}|D]a}||j }|std|dt|dkDrtd|dt|d ||j|dc|S) NrcpuzNo CPU devices foundzDevice z has no colocated devicesz$Ambiguous colocated devices; device z has z colocated devices: f) collections defaultdictlistclient_get_all_devices device_kind colocation_idappendrlen)devicescpu_devices_by_colocation_iddevicermatchess rrrOs"-!8!8!> !!224Hf U""6#7#78??GH & + ,, -f*6+?+?@G  (AB CC W   09'l^0  ;   , - rc|djdk(r:|djjDcgc]}|jdk(r|}}ntjd}t tjDcic]\}}|j |}}}|dtt|t|}|Dcgc]}|||j c}Scc}wcc}}wcc}w)Nrr$)backend) r+r)r*rr/ enumerateidminr.)r/dcpu_backend_devicesir1device_index_mapavailable_devicess rr r hs  QZu$'.aj&7&7&H&H&J6mmu466 ++e44=ckkm4LMyq&fiilMMKC(;$)meshflat_cpu_devicess rrrsd +51B1B+CD   hh ((9 oo  rcht|tj|tj|S)a1Executes the given Python function on the same devices as the arguments. The returned colocated Python callable lets the user run a serializable Python function on the same devices as the arguments, potentially on remote hosts. Python callable implements `specialize` and `__call__` methods. See their docstrings for details and https://docs.jax.dev/en/latest/notebooks/colocated-python.html for examples. Args: fun: An original function to wrap as an I/O callable. Returns: Colocated Python callable with no initial specialization. )r rfun_sourceinfo fun_signature)funs rcolocated_pythonrKs.  8 " "3 ')?)?)D rc@t|tj|S)aCreates a wrapper class that executes the given Python class methods on the same devices as the arguments. The wrapper class exposes the returned type's methods, and can be instantiated on JAX. An actual object will be instantiated on the host of the devices of the arguments' when a method of the wrapper instance is called for the first time. The actual object will persist while the wrapper object is alive, and will be destroyed asynchronously when the wrapper object is destroyed. Note that if the wrapper object is destroyed immediately without any method call, actual objects will not be created. Args: cls: The class to wrap as a colocated Python object. Returns: Wrapper class. )r rrH)clss rcolocated_python_classrNs& C005 66r)rSequence[jax.Device]returnrO)rjax.sharding.MeshrPrQ)r/ztuple[jax.Device, ...]rPrO)rErQrPrQ)rJzCallable[..., Any])rM type[object]rPrR)__doc__ __future__rr&typingrrcollections.abcrrrjax._srcrr &jax.experimental.colocated_python.funcr %jax.experimental.colocated_python.objr numpyr@rcacherr rrKrNrrrr\s&" . @< )   &  F T6 #70 T6 #7, T6 7 *7r