uki<dZddlmZddlmZddlZddlZddlmZddlm Z ddl m Z ddl m Z dd lmZdd lmZmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZmZm Z ejBdZ"de"_#ddZ$e"jJdZ&e"jNdZ(dZ)dZ*dZ+e)ejXe"<e*ejZe"<e+ej\e"<ej^e"ej`e&d d ddZ1 d d!dZ2y)"aJAX primitives related to sparse operations. This is experimental work to explore sparse support in JAX. The primitives defined here are deliberately low-level: each primitive implements a common sparse operation (sparse to dense, dense to sparse, sparse matrix/vector product, sparse matrix/matrix product) for two common sparse representations (CSR and COO). These routines have reference implementations defined via XLA scatter/gather operations that will work on any backend, although they are not particularly performant. On GPU runtimes built against CUDA 11.0/ROCm 5.0 or newer, each operation is computed efficiently via cusparse/hipsparse. Further down are some examples of potential high-level wrappers for sparse objects. (API should be considered unstable and subject to change). ) annotations)partialN) tree_util) JAXSparse)BCOO)BCSR)COO)CSRCSC) _coo_extract)mlir)core)dtypes)ad)batching)Array DTypeLikeShapetodenseFc\tj|\}}tj|d|iS)zIConvert input to a dense matrix. If input is already dense, pass through.tree)r tree_flatten todense_pbind)arrbufsrs V/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/jax/experimental/sparse/api.pyrr=s*%%c**$  )D ))crtj||}t|tr|j S|SN)rtree_unflatten isinstancerrrrrs r _todense_implr$Bs.  t,#$S)4=#=rctj||}t|tjr|Stj|j |j tj|jS)N) weak_type) rr!r"r ShapedArrayshapedtyperis_weakly_typeddatar#s r_todense_abstract_evalr,GsX  t,#T%%& J  #))SYY&:P:PQTQYQY:Z [[rct|dtjrJtd|ddDsJt j |d|i}t j |dg|ddd|i}||fS)Nrc3PK|]}t|tj ywr )r"rZero).0ts r z_todense_jvp..Ps :Z277 # :s$&r)r"rr/allrr)primalstangentsr primals_out tangents_outs r _todense_jvpr9Nst  RWW -- - :Xab\ : :: :3d3+ EgabkEE, l ""rctj|dsJtd|ddDrJt}t j ||gt |z}ddlm}m }ddl m }ddl m }||ur|fSt||r|\} } || || fSt||r|\} } } || | || | fSt|tr|\} } } t!| | || | fSt#dt%|)Nrc3FK|]}tj|ywr )ris_undefined_primal)r0bufs rr2z%_todense_transpose..WsA'',As!r3)rr) _bcoo_extract) bcsr_extractztodense_transpose for )rr<anyobjectrr!lenjax.experimental.sparserrjax.experimental.sparse.bcoor>jax.experimental.sparse.bcsrr?r"r r NotImplementedErrortype)ctrrstandinobjrrr>r?_indicesindptrrowcols r_todense_transposerPUs  Q (( ( AQRA AA A H'  y3t9'<=#087G^ 5L#tJAw " %w ..#tAw  ,gv ==#sKAsC S" %sC //  6tCykB CCrcVtjtt|||dfS)N)rr)jaxvmaprr$) batched_args batch_dimsrs r_todense_batching_rulerVls' @'-d3Z @, OQR RRr)multiple_resultsc tttttd}||vr(t d|dt |j||}|j|f||d|S)a~Create an empty sparse array. Args: shape: sequence of integers giving the array shape. dtype: (optional) dtype of the array. index_dtype: (optional) dtype of the index arrays. format: string specifying the matrix format (e.g. ['bcoo']). **kwds: additional keywords passed to the format-specific _empty constructor. Returns: mat: empty sparse matrix. )bcsrbcoocoocsrcsczsparse_format=z not recognized; must be one of )r) index_dtype) rrr r r ValueErrorlistkeys_empty)r(r)r^ sparse_formatkwdsformatsclss remptyrgvsr4C L''! ~m%67''+GLLN';&<> ?? # E HK H4 HHrc Jttttd}||}t j t j|}t j t j|}t j t j|}||}|jd|||||d|S)aCreate 2D sparse identity matrix. Args: N: int. Number of rows in the output. M: int, optional. Number of columns in the output. If None, defaults to `N`. k: int, optional. Index of the diagonal: 0 (the default) refers to the main diagonal, a positive value refers to an upper diagonal, and a negative value to a lower diagonal. dtype: data-type, optional. Data-type of the returned array. index_dtype: (optional) dtype of the index arrays. format: string specifying the matrix format (e.g. ['bcoo']). **kwds: additional keywords passed to the format-specific _empty constructor. Returns: I: two-dimensional sparse matrix with ones along the k-th diagonal. )rZr[r\r])MNkr)r^) rr r r rconcrete_or_erroroperatorindex_eye) rjrirkr)r^rcrdrerfs reyerqs$#c# >'Y A X^^Q/! X^^Q/! X^^Q/! #  NAau+ N NNr)rzJAXSparse | Arrayreturnr)Nint32rZ) r(rr)DTypeLike | Noner^rrcstrrrr)NrNrsrZ)rjintriz int | Nonerkrvr)rtr^rrcrurrr)3__doc__ __future__r functoolsrrnrRrjax.experimental.sparse._baserrDrrErjax.experimental.sparse.coor jax.experimental.sparse.csrr r jax.experimental.sparse.utilr jax.interpretersr jax._srcrrjax._src.interpretersrrjax._src.typingrrr PrimitiverrWrdef_implr$def_abstract_evalr,r9rPrVprimitive_jvpsprimitive_transposesprimitive_batchersregister_lowering lower_funrgrqrlrrrsK$# 3--+05!$*33 DNN9 % " *  >> \\ #D.S ,)%7 ")?I&y.$..E#+,PW%II2;I*MQ?EOO9<OR[Or