ukiddlmZddlZddlZddlmZddlmZddlm Z ddlm Z ddlm Z ddlm Z dd lmZdd lmZdd lmZdd lmZe j*Ze j,Zed ej0fZeZej6Zej8Zd ej0dej0fdZde j<defdZ dejBfdZ"d e j0de#defdZ$d e jJde j0fdZ&d e j0defdZ'e j<de"e'e$e&ddZ(e jRe(dejBfdZ*d e j0de#defdZ+d e j0de j0fd Z,d e j0defd!Z-e j<d"e*e-e+e,d#d$Z.e jRe.d%edefd&Z/e/ej`Z1e/ejdZ3e/ejhZ5e/ejlZ7 d.d'ed(ej0d)ed*ed+ed,e8e jrd fdzdej0fd-Z:y)/)CallableN)numpy)random)blocked_sampler)dtypes)prng)typing) primitivesprng_random_bits) prng_seed.keyreturnctjtjjt j tj}d}tj|jtjrt|jdkDrd}nt|jdkDrd}|rtj||}n||}t!j"|dS)zEHelper function for converting non-Pallas PRNG keys into Pallas keys.)shapedtypeFrT pallas_tpuimpl) functoolspartialjaxrbits tpu_key_impl key_shapejnpuint32 issubdtyperrprng_keylenrvmapjax_api_random wrap_key_data)r generate_key vmapped_keypallas_key_datas X/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/jax/_src/pallas/mosaic/random.py to_pallas_keyr)'s"" jjoo\333::,+^^CIIv/ 399~k 399~k,chh|,S1O"3'O  % %oL IIrc*|tk(xs |tk(S)zAReturns True if the PRNGImpl is a Pallas-specific implementation.)rtpu_internal_stateful_implrs r(is_pallas_implr-;s   C)C!CCr*seedctjtjtj}||zj tj S)Nr)rzerosrrint32astyper)r. seed_datas r( _seed_funcr5@s6ii ..cii@) d  " "3:: ..r* bit_widthrcN|dk7r tdt|t|SN zBit width must be 32) ValueErrorr r rr6rs r( _random_bitsr<Ds'"_ + ,, C. %  r*dataczt|\}}||z}tj||gd\}}t||dS)N rr)unwrap_pallas_seedjax_prng apply_roundwrap_pallas_seed)rr=key0key1s r(_fold_inrFJsB!#&*$ $%%tTlB7,4 $< 88r*c~~td)NzDCannot split a Pallas key. Use fold_in instead to generate new keys.NotImplementedErrorrrs r(_splitrKQs 5L r*)rrpl)rr.split random_bitsfold_innametagcN~tjdtjS)Nr0)remptyr2)r.s r(_pl_stateful_seed_funcrVjs 2SYY ''r*c2~|dk(sJdt|Sr8r r;s r(_pl_stateful_random_bitsrXos" b000 %  r*c~~tNrH)rr=s r(_pl_stateful_fold_inr[ts 4r*c~~trZrHrJs r(_pl_stateful_splitr]xs 5r*rT_pallas_internal_stateful _pl_statefulsamplercfd}jr.new_samplers-%((1KLO ? 4T 4V 44r*c d|vS)Nzkey:rT)lines r(z(_make_stateful_sampler..s V4'r* )__doc__filterrNjoin)r`rf doc_liness` r(_make_stateful_samplerrosG5 __')>)>t)DFI))I.K r* sampler_fn global_key block_size tile_size total_size block_indexc ,t|t|k7r$tdt|dt|d|&t|}tdt|D}t j |||||}t j ||||fi|S)ajSamples a block of random values with invariance guarantees. ``sample_block`` allows the sampling of identical blocks of random values across kernels with different block shapes and iteration orders. Each call to `sample_block` returns a `block_size`-shaped array of random samples corresponding to the `block_index`. ``tile_size`` should be chosen such that it is a divisor to all block sizes one needs to be invariant to. The larger the ``tile_size``, the more efficient the sampling process will be and therefore the best choice is typically the greatest common divisor between all possible block sizes. Args: sampler_fn: A sampling function that consumes a key and returns random samples. global_key: The global key to use for sampling. block_size: The shape of an individual block. tile_size: The shape of a ``tile``, which is the smallest unit at which samples are generated. This should be selected to be a divisor of all block sizes one needs to be invariant to. total_size: The total size of the array to sample. block_index: The index denoting which block to generate keys for. Defaults to the program_id for each block axis. **kwargs: Additional arguments to pass to the sampler_fn. Returns: A ``block_size`` shaped array of samples for the current block corresponding to ``block_index``. z block_size (z) and tile_size (z) must have the same length.c3FK|]}tj|ywrZ)r program_id).0axiss r( zsample_block..s ?&*jD!?s!)r!r:tuplerangerblocked_fold_in sample_block) rprqrrrsrtrurdnum_axeskeyss r(rrsH _I& |C O#45Y((DF GG:H?.3Ho??K  ( (*j)[ B$  % %$ I 917 99r*rZ);collections.abcrrrrrrr#jax._srcrrrrAr jax._src.pallasr jax._src.pallas.mosaictpu_primitives!jax._src.pallas.mosaic.primitivesr r ShapeSampleFn SampleFnTypeArrayKeylessSampleFnTypeset_seedr@rCr)PRNGImplboolr-r2r5intr< PRNGKeyArrayrFrKr register_prngrVrXr[r]r,ror stateful_bitsuniformstateful_uniform bernoullistateful_bernoullinormalstateful_normalr| ArrayLikerrTr*r(rs% ($%&?>7 '' sCII~. #66!22JsyyJSYYJ(D**DtD /SYY/!fll!s!5! 9(''9v||9 U !x        |$(( !&,,!3!u! fll&,,FLL /X..  ' #12L5H.'~':':; ).*@*@A+N,D,DE()>)>?EI 09\09 YY09"09"09# 09 $F$4$4c$9:TA 09 "ii 09r*