uki 0dZddlmZddlZddlZddlmZmZddlZddl Z ddl Z ddl m Z  ddl Z ddlZddlmZddlmZddlmZdd lmZddlZej4ZGd d e j6ZeZd Zd Z ddZ ejBjDjGdd dZ$ d!dZ%e d"dZ& d#dZ'e d$dZ(dZ)e d%dZ*d&dZ+e d'dZ, d(dZ-d)dZ.d*dZ/ d+dZ0 d,dZ1 d-dZ2y#e$rdZ Y wxYw).z)Colocated Python serialization utilities.) annotationsN)CallableSequence)Any)api) tree_util) xla_bridge) xla_clientceZdZdZdZy)_CommonObjectStateaTracks repeated objects within a single `_serialize()` or `_deserialize()`. It is common for `_serialize(x)` to be called with `x` being a nested container or capturing other objects in a closure, with many references pointing to only a few unique objects. The logic below (`_make_reduce_func_with_common_obj`) avoids duplicating object serialization by reducing a reference handle instead of the full object when an equal object is repeatedly seen. c d|_d|_yN)common_obj_index common_obj)selfs j/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/jax/experimental/colocated_python/serialization.py__init__z_CommonObjectState.__init__4s48D)-DON)__name__ __module__ __qualname____doc__rrrr r )s -rr ctjJ||}ttj|k(s%Jd|dttjdtjj||S)zUnreduces a new common object.z Expected z common objects, but got z_. This can happen if serialization and deserialization of objects happened in different orders.)_common_obj_staterlenappend) common_obj_id unreduce_func unreduce_argsobjs r*_wrapped_unreduce_func_with_new_common_objr"Bs  % % 11 1}%#  ) ) *m ;-! ** + ,-FF ; %%c* *rcLtjJtj|S)z4Unreduces a common object that has already appeared.)rr)rs r/_wrapped_unreduce_func_with_existing_common_objr$Ps%  % % 11 1  % %m 44rcBtjfd}|S)z:Wraps a reduce function to serialize a common object once.ctjJtjj|}|B|\}}ttj}|tj|<t|||ffSt |ffSr)rrgetrr"r$)r!runreduced_funcunreduced_args reduce_funcs rwrapped_reduce_funcz>_make_reduce_func_with_common_obj..wrapped_reduce_func[s  - - 99 9%66::3?M'23'7$nn+<<=m0=((- 7 :999=}>N NNr) functoolswraps)r*r+s` r!_make_reduce_func_with_common_objr.Vs*  ??; O  O r)max_sizec Ri}tjdjjD]Z}|jdk(s|j |vr+t d|j d||j d||||j <\|r|StjjD]o}|jD]Z}|jdk(s|j |vr+t d|j d||j d||||j <\q|S)z4Returns a map from a device id to a matching device.rcpuzMultiple CPU devices with id z found: z and ) xb local_devicesclient_get_all_devices device_kindid ValueErrorbackendsvalues)cpu_device_mapdbackends r_get_cpu_device_mapr>ks@+-.    a ' ' 8 8 :a}}  +ADD62qtt$%U1# /  nQTT %%'!g  % % '! %  44> !-addV4 &'uQC1   !qtt!! rcJ|j|}|td|d|S)z.Returns a CPU device with the given device ID.zInvalid device ID z,. Device list must contain only CPU devices.)r'r8)r; device_idr<s r_lookup_cpu_devicerAs>#!Y  YK(   (rctjdtg|j}t||j |j ffS)Nc|jSr)r7)r<s rz_reduce_mesh..s 144r)otypes)np vectorizeintdevices_unreduce_mesh axis_names axis_types)meshmesh_device_idss r _reduce_meshrOs;?BLL>t||L/ /4??DOOL LLrct}tjtjt ||}t jj|||Sr) r>rFrGr,partialrAjaxshardingMesh)rNrKrLr; mesh_devicess rrJrJsR'(.*N;,   <Z @@rct|jtjjsJdt |j}t ||j|jffS)NzOnly Mesh is supported) isinstancerMrRrSrTrO_unreduce_named_shardingspec memory_kind)rS reduced_meshs r_reduce_named_shardingr\sY HMM3<<#4#4 5O7OO 5hmm,, !HMM8#7#7$9 99rcH|d|d}tj|||S)NrrZ)rR NamedSharding)r[rYrZrMs rrXrXs+ a,q/ *$  4; ??rcP|Dcgc]}|j}}t|ffScc}wr)r7_unreduce_device_list) device_listr< device_idss r_reduce_device_listres-*****  --+s#ct}tjtjt ||}t t|Sr)r>rFrGr,rQrA DeviceListtuple)rdr;rIs rrbrbs?&(. OBLL**+=~N O ' E'N ##rcnt|jjj|jffSr) _unreduce_single_device_sharding device_setpopr7rZ)rSs r_reduce_single_device_shardingrms7 *"", rcpt}t||}tjj ||S)Nr_)r>rArRrSSingleDeviceSharding)r@rZr;devices rrjrjs2'(. ni 8&  * *6{ * KKrct tdGddtj}tjJdit_ t j 5}||j||jcddddt_S#1swYnxYw dt_y#dt_wxYw)aSerializes callables and input/output spec objects. DO NOT USE THIS FUNCTION EXCEPT FOR THE INTERNAL IMPLEMENTATION OF colocated_python. This module contains utility functions used internally for implementiong `colocated_python` when it ships callables and input/output specs through IFRT. The pickled data is produced and consumed in an ephermeral fashion without any persistence, and it does not expect any version compatibility (which cloudpickle does not guarantee). Furthermore, serialization and deserialization is expected to be done on machine(s) that are controlled by a single tenant, which allows unpickling done during deserialization to be trusted. Raises: ModuleNotFoundError: If cloudpickle is not available. NNo module named "cloudpickle"ceZdZejej jeiej je ie e iej jeiej j"ZeZy)"_serialize.._CustomPicklerN)rrr collectionsChainMaprRrSrTrOr`r\rgrerorm cloudpickle CloudPicklerdispatch_tabledispatchrrr_CustomPicklerrtsk)[))   L)  # #%;< ()  * *,JK  // NHrr{z'_serialize() expects no recursive calls) rwModuleNotFoundErrorPicklerrrioBytesIOdumpgetvalue)r!r{files r _serializers$ = >>{**  + + 31/1 3')$. T$ ]]_*.& *.&&s$B7"'B B7B'#B77 Cct tdtjJdgt_ tj|dt_S#dt_wxYw)zDeserializes callables and input/output spec objects. DO NOT USE THIS FUNCTION EXCEPT FOR THE INTERNAL IMPLEMENTATION OF colocated_python. See serialize() for details. Raises: ModuleNotFoundError: If cloudpickle is not available. Nrrz)_deserialize() expects no recursive calls)rwr|rrloads) serializeds r _deserializersa = >>  % % -313 -!#(   Z (#' 4 s A A"c4tjjt|d}tjj |tjj }t jdtjj|S)z(Makes output specs for serialized specs.xr)shapedtyperS) rRrSrTrhr` PartitionSpecrShapeDtypeStructrFdtypes StringDType)rIrMreplicated_shardings r _make_specs_for_serialized_specsrso   5>6 2$ 22 CLL & & (   bii++-8K rcvttjds tdt ||f}t j |jd}tj|tjj}|j}tjjt|d}tjj|tjj!}|D cgc]} tj"|| } } tj$| |dScc} w)zSerializes the output specs into a jax.Array of string type. DO NOT USE THIS FUNCTION EXCEPT FOR THE INTERNAL IMPLEMENTATION OF colocated_python. See serialize() for details. rzSerializing Colocated Python requires StringDType. Please use numpy to 2.0.0 or later, or explicitly provide an output spec function.ascii)rrr)arraysrSr)hasattrrFr TypeErrorrbase64 b64encodedecodearrayraddressable_device_listrRrSrTrhr`r device_put$make_array_from_single_device_arrays) specs_treedef specs_leavesrIs_bytess_str s_np_arrayaddressable_devicesrMrrp out_arrayss r_serialize_specsr(s  M *     |4 5'   7 # * *7 3%xxRYY%:%:%<=*  77   5!45v >$ 22 CLL & & ( 8K-3cnnZ(* 1 1 "  s?D6c|jdj}tj|j j d}t |S)zDeserializes the specs from the serialized specs. DO NOT USE THIS FUNCTION EXCEPT FOR THE INTERNAL IMPLEMENTATION OF colocated_python. See serialize() for details. rr)addressable_shardsdatar b64decodeitemencoder)serialized_specs data_arrayrs r_deserialize_specsrQsG 2215::*   *//+227; <$ d r)r* Callable[[Any], tuple[Any, Any]]returnr)rdict[int, jax.Device])r;rr@rHrz jax.Device)rMjax.sharding.Meshrz,tuple[Callable[..., jax.sharding.Mesh], Any])rNz np.ndarrayrKrrLrrr)rSzjax.sharding.NamedShardingrz5tuple[Callable[..., jax.sharding.NamedSharding], Any])rcrgrz%tuple[Callable[..., DeviceList], Any])rdz Sequence[int]rrg)rS!jax.sharding.SingleDeviceShardingrzrArOrJr\rXrerbrmrjrrrrrrrrrs)0" .  %) ]] --,'(  5 1%*d#$D  )  69    #M M1M#MAA-0A>AAA#9(9:9#9@ #..*.#.$#/A#LL!+L&L'.T(*    &&&2&& &R  A k +sD33D>=D>