ukiwddlmZddlmZmZmZddlZddlZddlm Z m Z ddl Z ddl m Z ddlmZddlmZddlmZdd lmZdd lmZmZmZmZmZmZmZmZmZmZdd lmZ dd l!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(dd lm)Z)e)jTe+e"e,cZ,Z-e'e.cZ.Z/dFdZ0dGdZ1dHdZ2dIdZ3e jh dJdZ5e jh dJdZ6dZ7e jh dJdZ8dZ9e jhdZ:GddZ;ejxjzejxj|fZ?dKdZ@ejxjzejxjfZBejxj|ejxjfZD dLdZE dM dNdZFdZGe jdZI dOdZJd ZK dPd!ZLe j dQd"ZM dRd#ZNe jdSd$ZOe d%& dM dTd'ZPdUd(ZQd)ZReSZTd*d*d+d,ZU dVd-ZVe jhd.ZWd/ZXejxj|ZY dWd0ZZ dXd1Z[d2Z\dYd3Z]d4Z^dZd5Z_d6d6ejddd7 d[d8Zad\d9Zb d]d:Zce jd;Zed^d<Zf d_d=ZgGd>d?Zh d`d@ZidadAZjGdBdCekZl dbdDZmdcdEZny)d) annotations)CallableIterableSequenceN)partial lru_cache)Any)core)config)dtypes) AbstractRef) PyTreeDef tree_flattentree_unflattentreedef_childrentree_flatten_with_pathgenerate_key_pathsbroadcast_prefix prefix_errorsnone_leaf_registry'broadcast_flattened_prefix_with_treedef) linear_util)safe_map WrapKwArgsHashableHashableFunction Unhashablesafe_zipunzip2)traceback_utilctjd|d} tj|S#t$r&t t tj|cYSwxYw)z2Ensure x is either an index or a tuple of indices.N/expected a static index or sequence of indices.r concrete_or_erroroperatorindex TypeErrortuplemapxs L/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/jax/_src/api_util.py _ensure_indexr-*sP T1&WX!) >>!  ) X^^Q' (()s.,AActjd|d} tj|fS#t$r&t t tj|cYSwxYw)z Convert x to a tuple of indices.Nr"r#r*s r,_ensure_index_tupler/2sS T1&WX!) NN1   ) X^^Q' (()s/,AAcBt|tstd||S)Nzargument is not a string: ) isinstancestrr'r*s r, _ensure_strr3:s$ As  04 55 (cZt|tr|fSttt|S)z Convert x to a tuple of strings.)r1r2r(r)r3r*s r,_ensure_str_tupler6?s%3 4K [!$ %%r4crt||\}}||i|}t|\}}|j||SNrrstore)fr:in_tree args_flatpy_args py_kwargsansout_trees r, flatten_funrBFsC&gy9'9 7 i #s#-#x++h *r4ct||\}}||i|}t|\}}t|\} }|j|| f|Sr8)rrrr:) r;r:r<r=r>r?r@ paths_and_ansrApathss r, flatten_fun3rFOsW&gy9'9 7 i #237-m$*%++x *r4cz|\}}t|if\}}||k7rtd|d|||}t||SNz Expected z, got rr'rfunio_treer>in_tree_expectedrAargsr<r@s r,apply_flat_funrOYsX&H}--$   i 01yA BB T # # &&r4cft||}||}t|\}}|j||Sr8r9)r;r:r<r=r>r@rAs r,flatten_fun_nokwargsrQas8 7I .' 7 #s#-#x++h *r4cv|\}}t|\}}||k7rtd|d|||}t||SrHrIrJs r,apply_flat_fun_nokwargsrSjsT&Hw'-$   i 01yA BB T # # &&r4ct||}||}t|ttfrt |dk7rt dt |d||\}}t|\}} t|\} } |j| | f|| fS)NzNexpected function with aux output to return a two-element tuple, but got type z with value ) rr1listr(lenr'typerr:) r;r:r<r=r>pairr@auxans_flatans_treeaux_flataux_trees r,flatten_fun_nokwargs2r_rs 7I .' G$ D4- (CIN ++/:,l4(L MM (#s#C((H#C((H++x"# 8 r4c(eZdZdZdgZdZdZdZy)_HashableWithStrictTypeEqualityz|Box object used when comparing static arguments as a jit key. Requires exact type equality using `is` and value equality.valc||_yr8rbselfrbs r,__init__z(_HashableWithStrictTypeEquality.__init__ DHr4c,t|jSr8)hashrbrfs r,__hash__z(_HashableWithStrictTypeEquality.__hash__s >r4ct|jt|juxr|j|jk(Sr8)rXrbrfothers r,__eq__z&_HashableWithStrictTypeEquality.__eq__s/ >T%))_ , FUYY1FFr4N)__name__ __module__ __qualname____doc__ __slots__rgrlrpr4r,raras!Ag)Gr4rac 0d}|jjD]B}|jtvr|dz }|jtj j usBy|r3t| |kDst||k\rtd|d|d|dyy)z Validate that the argnums are sensible for a given function. For functions that accept a variable number of positions arguments (`f(..., *args)`) all positive argnums are considered valid. rNzJitted function has =z, but only accepts z positional arguments.) parametersvalueskind_POSITIONAL_ARGUMENTSinspect ParameterVAR_POSITIONALminmax ValueError)sigargnums argnums_name n_pos_argsparams r,_validate_argnumsrs*~~$$& e zz**Aoj w((77 7   3w<-*,G 0J +L>7)D))3 4JL MM1KWr4cd}t}t}|jjD]v\}}|jtvr|j |*|jt jjurd}S|jtvsf|j |x|t|zx}rtd|d|d|ryt||z x}rtd|d|dy)z Validate that the argnames are sensible for a given function. For functions that accept a variable keyword arguments (`f(..., **kwargs)`) all argnames are considered valid except those marked as position-only (`f(pos_only, /, ...)`). FTz%Jitted function has invalid argnames z in z. These are positional-onlyNz$. Function does not take these args.) setrzitemsr|_KEYWORD_ARGUMENTSaddr~r VAR_KEYWORD_INVALID_KEYWORD_ARGUMENTSr) rargnames argnames_name var_kwargs valid_kwargsinvalid_kwargs param_namerinvalid_argnamess r,_validate_argnamesrs*5, U.>>//1%j% zz''z" w((44 4j 1 1$%)3x=899 <=Mz"argnums_partial..0q470) r/_ensure_inboundsrW enumerate is_hashablerrXrqappendrarr(_argnums_partial)r; dyn_argnumsrNrequire_static_args_hashable fixed_argsrargdyn_argss ` r,argnums_partialrs#K0+ D ;?+!JD/>3 k 8   BBCJCyk |3D FG G7<=>1:$+fak)S/+J+ 0K0 0( ![% *; .s&N3z#&Ns)_prepend_static_argsr()r; static_argss r,prepend_static_argsrs a&N+&N!N OOr4c@td|D}||z}||i|S)Nc34K|]}|jywr8rdrs r,rz'_prepend_static_args..s5#cgg5s)r()r;rrNkwargsall_argss r,rrs,555+ 4 ( H  r4cg}|D]>}||k\r|r | |cxkr|ksntd|d|d|j||z@t|S)z?Ensure argnum is within bounds. Also resolves negative argnums.zPositional argument indices, e.g. for `static_argnums`, must have value greater than or equal to -len(args) and less than len(args), but got value z for len(args) == .)rrr() allow_invalidnum_argsrresultrs r,rrsu &  aH} 9 $H $  #/z < == MM!h,  vr4ct|ttfdttD}tfd|D}||fS)Nc3,K|] }|vs| ywr8rv)rrstatic_argnumss r,rz_split_args..sMAQn5LaMs c3(K|] }| ywr8rvrs r,rz_split_args.. rr)rrWr(range)rrNrrrs`` r, _split_argsrsK#M3t9nM.Ms4y!1MM+ 0K0 0( h ..r4c J|s||fSt|||\}}}g}t|D]e}|r|t|k\r||}t|s(t d|dt |d|j d|jt|gt||t||fS)zIVersion of ``argnums_partial`` that checks hashability of static_argnums.rrrr) rsortedrWrrrXrqrrarr() r;rrNrrrrr static_args r,argnums_partial_exceptr s  d7N*5dM++'.+x* . ! Eac$iaJ z "  @@As* *  nQZZL8I K LL 7 CD E ![% *; >)*+ --/2K4H4H4JK-So%f jj&S^^+,- sr4c|s|stt|Stt|}tt|}dx}x}}g}|t|krz|t|kr||||k(rt d|d|d|t|kr||||kr |dz }|dz }n|j |||z |dz }|t|krzt|S)aEShifts donate to account for static. >>> rebase_donate_argnums((3, 4), (0, 1)) (1, 2) Args: donate_argnums: An iterable of ints. static_argnums: An iterable of ints. Returns: A tuple of unique, sorted integer values based on donate_argnums with each element offset to account for static_argnums. rz`static_argnums` z and `donate_argnums` z cannot intersect.rx)r(rrrWrr)rrrjoouts r,rebase_donate_argnumsris  N ' ((#n-..#n-..-!-a! # C 3~ >!#4q8I#I *>*:;++9*::LN OO 3~ >!#4~a7H#H1fa1fa jj"Q&'1fa C  sr4c: t|y#t$rYywxYw)NTF)rjr')rs r,rrs#I   s  F)r tupled_argsc tj|\}} t|||}t ||jk(sJ|S#t$r~|rt |\}}|\}}d} |rM| d|dz } t |j dk(r( t|||f| d|dz } n#t$rYnwxYwt|d|d|d | dwxYw) Nz Note that za that are non-trivial pytrees should always be wrapped in a tuple representing the argument list.rxzE In particular, you're passing in a single argument which means that z/ might need to be wrapped in a singleton tuple.zS specification must be a tree prefix of the corresponding value, got specification z for value tree r) rflattenrrrrWr flatten_axesr) nametreedef axis_treerraxis_tree_leaves axis_treedefaxes_hints r,rrs8 $6#=#=i#H LC 2, 1D0 Tg(( (( ( +/ C $G,jgqli D TF#DEFd W    A % * tWyl 3 !!%'() *$    v??HkJ''.iq8 9>BC'Cs0 AAC  B# C # B/,C .B//C ct|\}}t|t||\}}|t|t||ffS)N)closure)r_flat_out_axesr(r)r;out_specleavesrout_axess r, flat_out_axesrsD!*/&'q%-9+!X Xf w/G H HHr4c||i|}t||} tt||d}|j ||S#t$r4t ||^} } | dj \} | dz } t| dwxYw)Nc |duSr8rvr*s r,z _flat_out_axes..s AIr4)is_leafz pmap out_axesz The full pytree is the output of the pmapped function. Ensure that the `out_axes` argument to `pmap` is a pytree prefix of the pmapped function's output.)rr(rrrrNr:) r_store_leaves_treedefrNrr@spec spec_flatermsgs r,rrs df# ' *$ $&tS:MNOI ,,y * $ $ $EA _  " "DC )*C S/t#$s A=A>ct|trtd|t|std|t j |rtd|y)Nz.staticmethod arguments are not supported, got zExpected a callable value, got z/Expected a function, got a generator function: )r1 staticmethodr'callabler~isgeneratorfunctionrKs r,check_callablersa\" DSEJ KK # 5cU; <<   % EcUK LL&r4cXyttfS|j}>Jttfdt |j DfSttfdt |j DfS)z?Infer missing argnums and argnames for a function with inspect.)rvrvc3\K|]#\}\}}|jtk(r|vr|%ywr8r|_POSITIONAL_OR_KEYWORD)rrrrrs r,rz-infer_argnums_and_argnames..s4a!U ::/ /AM ),c3\K|]#\}\}}|jtk(r|vr|%ywr8r)rrrrrs r,rz-infer_argnums_and_argnames..s4a!U ::/ /AL r)r/r6rzr(rr)rrrrzs `` r,infer_argnums_and_argnamesrs  _)  X1!'*G *H H ~~* _    *H()9)9);<G (  "'*G()9)9);<H ( r4ct|E|dn t|}|dn t|}|dn t|}|td|d|Jd}nTt|||\}}t|||\}}t ||dt ||dt ||dt ||dt ||t||}||||fS)aValidates and completes the argnum/argname specification for a jit. * fills in any missing pieces (e.g., names given numbers, or vice versa), * validates the argument names/numbers against the function signature, * validates that donated and static arguments don't intersect. * rebases the donated arguments so they index into the dynamic arguments, (after static arguments have been removed), in the order that parameters are passed into the compiled function. rvz"Getting the signature of function z8 failed. Pass donate_argnums instead of donate_argnames.rrrr)r/r6rrrr_assert_no_intersectionr)rK signaturerrrrs r,resolve_argnumsr#s"*1R7J8N+3b9J:O)1R7J8N" ;C5AII JJ  "" "O 'A>?'4#NO&@>?'4#NOi1ABy/3DEi1ABy/3DE/?;(H. ./ IIr4clt|jt|}|rtd|dy)NzEstatic_argnames and donate_argnames cannot intersect. Argument names z3 appear in both static_argnames and donate_argnames)r intersectionr)rrrs r,r!r!2sD O))#o*>?# O %B D EE r4cFt|trd}tj|j|i|}|j |j r=|j Dcgc] }||vs| }}|rtddj||jScc}w)zResolve input arguments to positional following a function's signature. This will raise a TypeError if any keyword-only arguments were passed by the caller. cyr8rv)rNrs r,r z resolve_kwargs..Bsr4zDThe following keyword arguments could not be resolved to positions: z, ) r1rr~r"bindapply_defaultsrr'joinrN)rKrNrbar passed_kwargss r,resolve_kwargsr-:s W &C"w""D3F3"YY " 91Q&[Q9M9  P YY} % & (  . :s # B-Bc tj|S#t$r"tjt|dcYSwxYw)Ndtype)r result_typergetattrr*s r,_dtyper2Os?3   a  3   ga1 223s(AAc|Sr8rv)rKtags r,api_hookr5Xs *r4rv)rrresult_paths_thunk sourceinfor"ct|dd} | | S| t|}| t|}t|||||} t j ||| |S)aConstruct core.DebugInfo for a function given example args and kwargs. `args` and `kwargs` are example positional and keyword arguments, used with `inspect.Signature` to get the names of arguments. The arguments that are considered static for tracing purposes should be included, and designated using `static_argnums` and `static_argnames`. See docstring for linear_util.DebugInfo. __fun_debug_info__N)r1fun_sourceinfo fun_signature_non_static_arg_namesr DebugInfo) traced_forrKrNrrrr6r7r"r arg_namess r, debug_infor@\sh, )40#_ J$Jc"I#ItV^$35)  J ;M NNr4cX tj|S#ttf$rYywxYwr8)r~r"rr'rs r,r;r;~s/   S !! i  s ))ct|d|y)Nr9)setattr)wrapperdbgs r,save_wrapped_fun_debug_inforFs ''-r4z(?:)ct|tr|j}t|trtj|} |j j }|j j}|jd|d|S#t$rO} t|}n #YYd}~yxYwtj|x}r|jdcYd}~SYd}~yd}~wwxYw)Nz at :z rx)r1rfuncr~unwrap__code__ co_filenameco_firstlinenorqAttributeErrorr2 _fun_name_rematchgroup)rKfilenamelinenorfun_strms r,r:r:s3 ((C 3 s#||''H \\ ( (Fll^4z6( 33  Cg    w ''q' WWQZ  s6?B C BCB"C"*C CCc ttdt||}t|}t |Dcgc] \}}||vrn|} }}|j D cic]\} }| | |vrn|} } }d} | |j | i| } td|jj Dd}| jj Dcgc]\}}||vr ||k7r||f}}}td| j Dd}|Dcgc]\}}|| jvr|n|d|d|f!}}}||z} | Dd | fg}t| j Dcgc]\}}|us d |d|fc}}d }||z} tfd | DScc}}wcc}} wcc}}wcc}}w#ttf$rYwxYwcc}}w) aReturns the names of the non-static arguments. If the `fn_signature` is given then we get from it the names of the top-level arguments. In other cases, including when the `args` and `kwargs` do not match the signature, we use names like `args[0]`, `args[1]`, etc. TNc3tK|]0\}}|jtjjk(r|2ywr8)r|r~rr)rrps r,rz(_non_static_arg_names..s5F74VVw'8'8'D'DDFs68c3*K|] \}}||f ywr8rv)rrr+s r,rz(_non_static_arg_names..sGGD!tQiGsc |dSNrrvname_xs r,r z'_non_static_arg_names..s r4)rz['z']rNzkwargs['c |dSr[rvr\s r,r z'_non_static_arg_names..s q r4c3K|]7\}}t|D]$\}}|ur|tj|&9ywr8)rlu_clean_keystr_arg_names)rrr+pathlstatics r,rz(_non_static_arg_names..sXH403H4q22489:H:Hs=A)rrrWrrrr(rrz argumentsrrr'r() fn_signaturerNrrrstatic_argnums_static_argnames_rr+args_rkwargs_ ordered_argsr+ kwargs_namer positional sorted_kwargskeywordrds @r,r<r<s+ 8&$T3t9nE/)=Ft_ MTQQ/)6q 0 M% MCI<<> R41aQ!//Q 6 R' R37,0 <  e /w /b Fl.E.E.K.K.MFGKMk.0\\-?-?-AC'$6)dk.A1ICjCGw}}G":F8F,$F2% G 2 G 8G  G c$eZdZdgZdZdZdZy)_HashableByObjectIdrbc||_yr8rdres r,rgz_HashableByObjectId.__init__rhr4c,t|jSr8)idrbrks r,rlz_HashableByObjectId.__hash__s dhh<r4c2|j|juSr8rdrns r,rpz_HashableByObjectId.__eq__s 88uyy  r4N)rqrrrsrurgrlrprvr4r,rqrqsg)!r4rqctjjsJi}tt ||D]\}\}}t |t s|jttj||x}|k7sN|}t|rod|jd|jd|jd|j|j|ndd|j|j|ndd dd|d |dy) Nzconly one reference to a mutable array may be passed as an argument to a function, but when tracing  for z% the mutable array reference of type z appeared at both unknownz and rzat both flat index z and flat index )r mutable_array_checksvaluerrr1r setdefaultrtr get_referentr func_src_infor> str_shortr?) dbg_fn maybe_avalsrNrefsrar+dup_idxrEs r,check_no_aliased_ref_argsrs+  $ $ * ** *$Sd34 Fia!Q1k"OOBt'8'8';$>BRS//0{{}o=O%(]]%>3== !I NO#&==#r~safe_arg_namesrW)rEconstsrNcrrr+rs r,"_check_no_aliased_closed_over_refsrs  $ $ * ** *6<B!$--"2K@t((+,B$BoQda $  A 4'  ! !! $a 47 #++,E#..1AB%%&[[]O4$   D *1 - . 0 QQ=P  QQQBsADc*eZdZUded<ded<ddZy)InternalFloatingPointErrorr2rtyc ||_||_yr8)rr)rfrrs r,rgz#InternalFloatingPointError.__init__sDIDGr4N)rr2rr2)rqrrrs__annotations__rgrvr4r,rrs ) 'r4rcvtd ||i|}t|y#ttf$r}|dd}~wwxYw)NzdInvalid nan value encountered in the output of a jax.jit function. Calling the de-optimized version.)print_raise_no_nan_in_deoptimizedFloatingPointErrorZeroDivisionError)rrKrNrre2s r,maybe_recursive_nan_checkrsM 67$ TVA!# / 0 $s!838c6t|d}t|d)Na. Because jax_config.debug_nans.value and/or config.jax_debug_infs is set, the de-optimized function (i.e., the function as if the `jit` decorator were removed) was called in an attempt to get a more precise error message. However, the de-optimized function did not produce invalid values during its execution. This behavior can result from `jit` optimizations causing the invalid value to be produced. It may also arise from having nan/inf literals as inputs or outputs, like `jax.jit(lambda ...: jax.numpy.nan)(...)`. It may be possible to avoid the invalid value by removing the `jit` decorator, at the cost of losing optimizations. If you see this error, consider opening a bug report at https://github.com/jax-ml/jax.)r2r)rrs r,rrs& F8) )# 3T)r4)r+r returnzint | tuple[int, ...])r+r rtuple[int, ...])r+r2rr2)r+zstr | Iterable[str]rtuple[str, ...])r;rr:zlu.Storer<r)rinspect.Signaturerrrr2rNone)rrrrrr2rr)T)r; lu.WrappedFunrzint | Sequence[int]rNr)rrrintr Sequence[int]rr)r;rrrrNtuple[Any, ...]rr)rrrrrr)r;rrrrdict[str, Any])rr)rrrztuple[bool, ...])rr)r;rrr rztuple[lu.WrappedFun, Callable])rrrzint | Iterable[int] | Nonerstr | Iterable[str] | Nonerz'tuple[tuple[int, ...], tuple[str, ...]])rKrr"inspect.Signature | Nonerint | Sequence[int] | NonerrrrrrrzItuple[tuple[int, ...], tuple[str, ...], tuple[int, ...], tuple[str, ...]])rKrrr)r4r2)r>r2rKrrN Sequence[Any]rrrrr Sequence[str]r6z7Callable[[], tuple[str, ...]] | core.InitialResultPathsr7z str | Noner"rrcore.DebugInfo)rKrrr)rDrrErrr)rKrrr2) rfrrNrrrrrrrrr)rzCallable[[], core.DebugInfo]rr)rErrr)r ExceptionrKrrr)rr)o __future__rcollections.abcrrrr~r% functoolsrrretypingr jax._srcr r r jax._src.state.typesr jax._src.tree_utilrrrrrrrrrrrr` jax._src.utilrrrrrrrr register_exclusion__file__r) unsafe_mapr unsafe_zipr-r/r3r6transformation_with_aux2rBrFrOrQrSr_rarPOSITIONAL_ONLYPOSITIONAL_OR_KEYWORDr}rrr KEYWORD_ONLYrrrrtransformation2rrrrrrrrrrrSENTINELrrrrrrr#r!r-r2r5initial_result_pathsr@r;rFcompilerOr:r<rqrrrrrrrvr4r,rs#88( ,AAA'999#!!!(+CZCZ)) & "   "  ' "+  '   G G  ## )) M* ## "" ))   #P #P&5#PFI#P #PNBFG"G,P  ) / G!0GDHG0 #0 "*  D$2D*  4 $)98 F 838U DII #I#I  M!**@@  ')/ @2J 2J'2J/2J0 2J / 2J 0 2JO2JjE*3 %'%'RVRkRk!*.OO O O  O " O#OPOO(OOD .%3.8<.rzz:; ,0H -0H7E0H*70H,90H / 0Hf!!F48F" Q $  $*r4