WhdZddlmZddlmZddlZddlZddlmZddlm Z ddl m Z ddl m Z dd lmZdd lmZmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZmZm Z ej!dZ"de"_#d1dZ$e"j%dZ&e"j'dZ(dZ)dZ*dZ+e)ej,e"<e*ej-e"<e+ej.e"<ej/e"ej0e&d d2d3d*Z1 d4d5d0Z2dS)6aJAX primitives related to sparse operations. This is experimental work to explore sparse support in JAX. The primitives defined here are deliberately low-level: each primitive implements a common sparse operation (sparse to dense, dense to sparse, sparse matrix/vector product, sparse matrix/matrix product) for two common sparse representations (CSR and COO). These routines have reference implementations defined via XLA scatter/gather operations that will work on any backend, although they are not particularly performant. On GPU runtimes built against CUDA 11.0/ROCm 5.0 or newer, each operation is computed efficiently via cusparse/hipsparse. Further down are some examples of potential high-level wrappers for sparse objects. (API should be considered unstable and subject to change). ) annotations)partialN) tree_util) JAXSparse)BCOO)BCSR)COO)CSRCSC) _coo_extract)mlir)core)dtypes)ad)batching)Array DTypeLikeShapetodenseFarrJAXSparse | ArrayreturnrcRtj|\}}tj|d|iS)zIConvert input to a dense matrix. If input is already dense, pass through.tree)r tree_flatten todense_pbind)rbufsrs a/var/www/html/movieo_spanner_bot/venv/lib/python3.11/site-packages/jax/experimental/sparse/api.pyrr=s+%c***$  )D ) ))ctj||}t|tr|n|SN)rtree_unflatten isinstancerrrrrs r _todense_implr&Bs5 t,,#$S)44 =#=r ctj||}t|tjr|Stj|j|jtj|j S)N) weak_type) rr#r$r ShapedArrayshapedtyperis_weakly_typeddatar%s r_todense_abstract_evalr.GsY t,,#T%&& J #)SY&:PQTQY:Z:Z [ [ [[r ct|dtjrJtd|ddDsJt j|d|i}t j|dg|ddRd|i}||fS)Nrc3JK|]}t|tjVdSr")r$rZero).0ts r z_todense_jvp..Ps. : :Z27 # # : : : : : :r r)r$rr1allrr)primalstangentsr primals_out tangents_outs r _todense_jvpr;Ns  RW - --- - : :Xabb\ : : : : ::: :3d33+ EgabbkEEEEE, l ""r cLtj|dsJtd|ddDrJt}t j||gt |z}ddlm}m }ddl m }ddl m }||ur|fSt||r|\} } || || fSt||r|\} } } || | || | fSt|tr|\} } } t!| | || | fSt#dt%|)Nrc3>K|]}tj|VdSr")ris_undefined_primal)r2bufs rr4z%_todense_transpose..Ws-AA',,AAAAAAr r5)rr) _bcoo_extract) bcsr_extractztodense_transpose for )rr>anyobjectrr#lenjax.experimental.sparserrjax.experimental.sparse.bcoor@jax.experimental.sparse.bcsrrAr$r r NotImplementedErrortype)ctrrstandinobjrrr@rA_indicesindptrrowcols r_todense_transposerRUs} Q ( ((( ( AAQRRAAA A AAA A HH' y3t99'<==#00000000888888777777G^^ 5L#t DJAw =" % %w ..#tDAw < , ,gv ==#sDKAsC S" % %sC // BtCyyBB C CCr c^tjtt|||dfS)N)rr)jaxvmaprr&) batched_args batch_dimsrs r_todense_batching_rulerXls. @'-d333Z @ @, OQR RRr )multiple_resultsint32bcoor*rr+DTypeLike | None index_dtyper sparse_formatstrrc tttttd}||vr4t d|dt |||}|j|f||d|S)a~Create an empty sparse array. Args: shape: sequence of integers giving the array shape. dtype: (optional) dtype of the array. index_dtype: (optional) dtype of the index arrays. format: string specifying the matrix format (e.g. ['bcoo']). **kwds: additional keywords passed to the format-specific _empty constructor. Returns: mat: empty sparse matrix. )bcsrr[coocsrcsczsparse_format=z not recognized; must be one of )r+r]) rrr r r ValueErrorlistkeys_empty)r*r+r]r^kwdsformatsclss remptyrlvs4C L L''!! >m>>'+GLLNN';';>> ? ?? # E HK H H4 H HHr NintM int | Nonekc 0ttttd}||}t jt j|}t jt j|}t jt j|}||}|jd|||||d|S)aCreate 2D sparse identity matrix. Args: N: int. Number of rows in the output. M: int, optional. Number of columns in the output. If None, defaults to `N`. k: int, optional. Index of the diagonal: 0 (the default) refers to the main diagonal, a positive value refers to an upper diagonal, and a negative value to a lower diagonal. dtype: data-type, optional. Data-type of the returned array. index_dtype: (optional) dtype of the index arrays. format: string specifying the matrix format (e.g. ['bcoo']). **kwds: additional keywords passed to the format-specific _empty constructor. Returns: I: two-dimensional sparse matrix with ones along the k-th diagonal. )r[rbrcrdN)rormrqr+r]) rr r r rconcrete_or_erroroperatorindex_eye) rmrorqr+r]r^rirjrks reyerxs$#c# > >'Y A X^Q//! X^Q//! X^Q//! #  NAau+ N N N NNr )rrrr)NrZr[) r*rr+r\r]rr^r_rr)NrNrZr[)rmrnrorprqrnr+r\r]rr^r_rr)3__doc__ __future__r functoolsrrurTrjax.experimental.sparse._baserrFrrGrjax.experimental.sparse.coor jax.experimental.sparse.csrr r jax.experimental.sparse.utilr jax.interpretersr jax._srcrrjax._src.interpretersrrjax._src.typingrrr PrimitiverrYrdef_implr&def_abstract_evalr.r;rRrXprimitive_jvpsprimitive_transposesprimitive_batchersregister_lowering lower_funrlrxrsr rrs$#""""" 333333------------++++++00000000555555!!!!!!$$$$$$******3333333333 DN9 % % " ****  >>> \\\ ###DDD.SSS ,)%7 ")?I&y.$.E#+#+#+,,,PW%IIIII*MQ?EOOOOOOOr