$ShH*UdZddlmZddlZddlZddlZddlmZddlm Z ddl m Z m Z ddl mZddlmZddlmZmZdd lmZdd lmZdd lmZmZdd lmZmZdd lm Z m!Z!gdZ"edeZ#de$d<edeZ%de$d<GddZ&ej'e(5ddl)m&Z&dddn #1swxYwY d9dddd:d!Z*e*Z+d;d(Z,dd3Z/d?d8Z0dS)@zIntegration with JAX.) annotationsN) itemgetter) FunctionType)AnyCallable) TypeAlias)Arraylax)dtypes) ArrayLike) tree_flattentree_unflatten) PyTreeSpec PyTreeTypeVar)safe_ziptotal_order_sorted) ArrayLikeTree ArrayTree tree_ravelrrrcReZdZUdZded<ded<ded<dd ZddZddZddZdS)HashablePartialz1A hashable version of :class:`functools.partial`.rfuncztuple[Any, ...]argszdict[str, Any]kwargsFunctionType | HashablePartialrreturnNonecHt|std|dt|tr-|j|_|j|z|_i|j||_dSt|tr||_||_||_dStd|d)z.Construct a :class:`HashablePartial` instance.zExpected a callable, got .zExpected a function, got N)callable TypeError isinstancerrrrr)selfrrrs ]/var/www/html/movieo_spanner_bot/venv/lib/python3.11/site-packages/optree/integrations/jax.py__init__zHashablePartial.__init__Gs~~ CAAAABB B dO , , C DI D(DI3T[3F3DKKK l + + CDIDI DKKKAAAABB Botherobjectboolct|tuo7|jj|jjko|j|jf|j|jfkSN)typerr__code__rr)r#r's r$__eq__zHashablePartial.__eq__WsM KK? * G "ej&99 GDK(UZ,FF r&intc t|jj|jt t |jtdfS)Nr)key) hashrr-rtuplerritemsr)r#s r$__hash__zHashablePartial.__hash__^sS " ():):)<)<*Q--PPPQQ    r&cFi|j|}|jg|j|Ri|Sr+)rrr)r#rrs r$__call__zHashablePartial.__call__gs:*DK*6*ty5$)5d555f555r&N)rrrrrrrr)r'r(rr))rr/)rrrrrr) __name__ __module__ __qualname____doc____annotations__r%r.r5r7r&r$rr@s;;CCCC         666666r&r)rF) none_is_leaf namespaceis_leafCallable[[Any], bool] | Nonetreer?r)r@strr*tuple[Array, Callable[[Array], ArrayTree]]ct||||\}}t|\}}|tt||fS)a/ Ravel (flatten) a pytree of arrays down to a 1D array. >>> tree = { ... 'layer1': { ... 'weight': jnp.arange(0, 6, dtype=jnp.float32).reshape((2, 3)), ... 'bias': jnp.arange(6, 8, dtype=jnp.float32).reshape((2,)), ... }, ... 'layer2': { ... 'weight': jnp.arange(8, 10, dtype=jnp.float32).reshape((1, 2)), ... 'bias': jnp.arange(10, 11, dtype=jnp.float32).reshape((1,)), ... }, ... } >>> tree # doctest: +IGNORE_WHITESPACE { 'layer1': { 'weight': Array([[0., 1., 2.], [3., 4., 5.]], dtype=float32), 'bias': Array([6., 7.], dtype=float32) }, 'layer2': { 'weight': Array([[8., 9.]], dtype=float32), 'bias': Array([10.], dtype=float32) } } >>> flat, unravel_func = tree_ravel(tree) >>> flat Array([ 6., 7., 0., 1., 2., 3., 4., 5., 10., 8., 9.], dtype=float32) >>> unravel_func(flat) # doctest: +IGNORE_WHITESPACE { 'layer1': { 'weight': Array([[0., 1., 2.], [3., 4., 5.]], dtype=float32), 'bias': Array([6., 7.], dtype=float32) }, 'layer2': { 'weight': Array([[8., 9.]], dtype=float32), 'bias': Array([10.], dtype=float32) } } Args: tree (pytree): a pytree of arrays and scalars to ravel. is_leaf (callable, optional): An optionally specified function that will be called at each flattening step. It should return a boolean, with :data:`True` stopping the traversal and the whole subtree being treated as a leaf, and :data:`False` indicating the flattening should traverse the current object. none_is_leaf (bool, optional): Whether to treat :data:`None` as a leaf. If :data:`False`, :data:`None` is a non-leaf node with arity 0. Thus :data:`None` is contained in the treespec rather than in the leaves list and :data:`None` will be remain in the result pytree. (default: :data:`False`) namespace (str, optional): The registry namespace used for custom pytree node types. (default: :const:`''`, i.e., the global namespace) Returns: A pair ``(array, unravel_func)`` where the first element is a 1D array representing the flattened and concatenated leaf values, with ``dtype`` determined by promoting the ``dtype``\s of leaf values, and the second element is a callable for unflattening a 1D array of the same length back to a pytree of the same structure as the input ``tree``. If the input pytree is empty (i.e. has no leaves) then as a convention a 1D empty array of the default dtype is returned in the first component of the output. )rAr?r@)r _ravel_leavesr _tree_unravel)rCrAr?r@leavestreespecflat unravel_flats r$rrqsUJ$ ! FH 'v..D, ,GG GGr&rJrrL"Callable[[Array], list[ArrayLike]]rKr c4t|||Sr+)r)rJrLrKs r$rHrHs (LL$6$6 7 77r&rIlist[ArrayLike]0tuple[Array, Callable[[Array], list[ArrayLike]]]cH|stjdtfStd|D}t j|td|D}td|D}tt j|}tfd|Dr6tj d|D}|tt||fStj fd|D}|tt|||fS)Nrc3>K|]}tj|VdSr+)r dtype.0leafs r$ z _ravel_leaves..s,>>t T**>>>>>>r&c3>K|]}tj|VdSr+)jnpsizerTs r$rWz _ravel_leaves..s*44T#(4..444444r&c3>K|]}tj|VdSr+)rYshaperTs r$rWz _ravel_leaves..s*66t39T??666666r&c3$K|] }|kV dSr+r=)rUdtto_dtypes r$rWz _ravel_leaves..s' 0 0b2> 0 0 0 0 0 0r&c6g|]}tj|Sr=)rYravelrTs r$ z!_ravel_leaves..s "F"F"Ft39T??"F"F"Fr&c^g|])}tjtj|*Sr=)rYrar convert_element_type)rUrVr_s r$rbz!_ravel_leaves..s0PPP3+D(;; < <PPPr&) rYzeros_unravel_emptyr3r result_type itertools accumulateall concatenater_unravel_leaves_single_dtype_unravel_leaves)rI from_dtypessizesshapesindicesraveledr_s @r$rGrGsG . ! n-->>v>>>>>K!;/H 44V444 4 4E 66v666 6 6FI(//00G 0 0 0 0K 0 0 000 /"F"Fv"F"F"FGG  8'6 J J  oPPPPPPPG &+xPP r&ctj|dkr(tdddtj|dgS)N)r0The unravel function expected an array of shape , got shape r)rYr\ ValueError)rKs r$rfrfsQ y$ ct c cQTQZ[_Q`Q` c c c    Ir&rqtuple[int, ...]rptuple[tuple[int, ...], ...] list[Array]c tj||dfkr/td|dfdtj|dtj||dd}dt ||DS)Nrtrurc>g|]\}}||Sr=)reshape)rUchunkr\s r$rbz0_unravel_leaves_single_dtype..s( N N N\UEEMM% N N Nr&)rYr\rvsplitr)rqrprKchunkss r$rlrls  y72;.(( , ~ , ,4 , , ,   YtWSbS\ * *F N NXff5M5M N N NNr&rntuple[jnp.dtype, ...]r_ jnp.dtypectj||dfkr/td|dfdtj|dtj|}||krtd|d|dtj||dd}t j5t jddt|||DcdddS#1swxYwYdS) Nr{rtrurz0The unravel function expected an array of dtype z , got dtype ignorecfg|].\}}}tj|||/Sr=)r rdr})rUr~r\rSs r$rbz#_unravel_leaves..sG   #ue  $U]]5%9%95 A A   r&) rYr\rvr rSrwarningscatch_warnings simplefilterr)rqrprnr_rK array_dtypers r$rmrm sl y72;.(( , ~ , ,4 , , ,   ,t$$Kh cx c cU` c c c   YtWSbS\ * *F  " "  h'''  '/ 'L'L                     s//C++C/2C/r+) rArBrCrr?r)r@rDrrE)rJrrLrMrKr rr)rIrOrrP)rKr rrO)rqrwrprxrKr rry) rqrwrprxrnrr_rrKr rry)1r; __future__r contextlibrhroperatorrtypesrtypingrrtyping_extensionsr jax.numpynumpyrYjaxr r jax._srcr jax.typingr optree.opsr r optree.typingrr optree.utilsrr__all__rr<rrsuppress ImportError jax._src.utilr ravel_pytreerHrGrfrlrmr=r&r$rs@#""""" '''''' 333333333333333355555555 7 6 6)=)DD DDDD$}[%88 8888)6)6)6)6)6)6)6)6XZ%%..------...............-1LH  LHLHLHLHLHLH^ 8888!!!!H O O O O       s%B88B<?B<