bif7ddlZddlmZmZddlmZddlmZmZm Z m Z m Z m Z m Z ddlZddlZddlmZddlmZddlmZdd lmZmZdd lmZerddlZdd lmZd d l m!Z!Gdde Z"eGddZ#ddde$fdZ%ddde"fdZ&dejNde"fdZ( d$de)de e*e)e e+e)ffde)de dde,de e e)d fd!e d"ddfd#Z-y)%N) dataclassfield)Path) TYPE_CHECKINGAnyClassVarLiteralOptional TypedDictUnion)config)DownloadConfig) array_cast) is_local_pathxopen)string_to_dict VideoDecoder) FeatureTypec.eZdZUeeed<eeed<y)ExamplepathbytesN)__name__ __module__ __qualname__r str__annotations__rR/home/cdr/jupyterlab/.venv/lib/python3.12/site-packages/datasets/features/video.pyrrs 3- E?r"rc ZeZdZUdZdZeed<dZee ed<dZ e ded<d Z e ed <d Z eeed fed <dZe ded<eddZeeed<dZeeed<ej,ej.ej0dZeeed<edddZeed<dZdeeeeee jBdfdefdZ" d%deeefdee#eeeeffddfd Z$ded!e#ed!fffd"Z%d#eejLejNejPfdejNfd$Z)y)&Videou= Video [`Feature`] to read video data from a video file. Input: The Video feature accepts as input: - A `str`: Absolute path to the video file (i.e. random access is allowed). - A `pathlib.Path`: path to the video file (i.e. random access is allowed). - A `dict` with the keys: - `path`: String with relative path of the video file in a dataset repository. - `bytes`: Bytes of the video file. This is useful for parquet or webdataset files which embed video files. - A `torchcodec.decoders.VideoDecoder`: torchcodec video decoder object. Output: The Video features output data as `torchcodec.decoders.VideoDecoder` objects. Args: mode (`str`, *optional*): The mode to convert the video to. If `None`, the native mode of the video is used. decode (`bool`, defaults to `True`): Whether to decode the video data. If `False`, returns the underlying dictionary in the format `{"path": video_path, "bytes": video_bytes}`. stream_index (`int`, *optional*): The streaming index to use from the file. If `None` defaults to the "best" index. dimension_order (`str`, defaults to `NCHW`): The dimension order of the decoded frames. where N is the batch size, C is the number of channels, H is the height, and W is the width of the frames. num_ffmpeg_threads (`int`, defaults to `1`): The number of threads to use for decoding the video. (Recommended to keep this at 1) device (`str` or `torch.device`, defaults to `cpu`): The device to use for decoding the video. seek_mode (`str`, defaults to `exact`): Determines if frame access will be “exact” or “approximate”. Exact guarantees that requesting frame i will always return frame i, but doing so requires an initial scan of the file. Approximate is faster as it avoids scanning the file, but less accurate as it uses the file's metadata to calculate where i probably is. read more [here](https://docs.pytorch.org/torchcodec/stable/generated_examples/approximate_mode.html#sphx-glr-generated-examples-approximate-mode-py) Examples: ```py >>> from datasets import Dataset, Video >>> ds = Dataset.from_dict({"video":["path/to/Screen Recording.mov"]}).cast_column("video", Video()) >>> ds.features["video"] Video(decode=True, id=None) >>> ds[0]["video"] >>> video = ds[0]["video"] >>> video.get_frames_in_range(0, 10) FrameBatch: data (shape): torch.Size([10, 3, 50, 66]) pts_seconds: tensor([0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333], dtype=torch.float64) duration_seconds: tensor([0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167], dtype=torch.float64) >>> ds.cast_column('video', Video(decode=False))[0]["video] {'bytes': None, 'path': 'path/to/Screen Recording.mov'} ``` TdecodeN stream_indexNCHWr(NHWCdimension_orderrnum_ffmpeg_threadscpu torch.devicedeviceexactr0 approximate seek_modeF)defaultrepridz torchcodec.decoders.VideoDecoderdtyperrpa_type)r4initr5_typec|jSN)r9)selfs r#__call__zVideo.__call__hs ||r"valuerreturnc| tdtjrddlm}nd}t |t rtj|}t |tr|ddSt |trt|jddSt |ttfrd|dSt |tjr t|S|t ||r t!|St |t"r`|j%d|j%d}}|$t&j(j+|rd|dS||||dStd |d t-d t/|) aEncode example into a format for Arrow. Args: value (`str`, `np.ndarray`, `bytes`, `bytearray`, `VideoDecoder` or `dict`): Data passed as input to Video feature. Returns: `dict` with "path" and "bytes" fields Nzvalue must be providedrrrrrrr8zTA video sample should have one of 'path' or 'bytes' but they are missing or None in .z!Unsupported encode_example type: ) ValueErrorrTORCHCODEC_AVAILABLEtorchcodec.decodersr isinstancelistnparrayrrabsoluter bytearrayndarrayencode_np_arrayencode_torchcodec_videodictgetosrisfile TypeErrortype)r>r@rrbytes_s r#encode_examplezVideo.encode_exampleksP =56 6  & & 8L eT "HHUOE eS !!D1 1 t $ 01DA A y1 2 51 1 rzz *"5) )  %*UL*I*51 1 t $ 99V,eii.@&DBGGNN4$8!%t44#t'7!'66 jkpjqqrs?U }MN Nr"token_per_repo_idc|js tdtjrddlm}n t d|i}t|tr|d}}n |d|d}}||td|d t|rA|||j|j|j|j|j }nzt!|||j|j|j|j }n@|||j|j|j|j|j }||d |_||j$_|S) aDecode example video file into video data. Args: value (`str` or `dict`): A string with the absolute video file path, a dictionary with keys: - `path`: String with absolute or relative video file path. - `bytes`: The bytes of the video file. token_per_repo_id (`dict`, *optional*): To access and decode video files from private repositories on the Hub, you can pass a dictionary repo_id (`str`) -> token (`bool` or `str`). Returns: `torchcodec.decoders.VideoDecoder` zMDecoding is disabled for this feature. Please use Video(decode=True) instead.rrz8To support decoding videos, please install 'torchcodec'.NrrzBA video should have one of 'path' or 'bytes' but both are None in rDr'r+r,r/r3)rYr+r,r/r3rC)r& RuntimeErrorrrFrGr ImportErrorrHrrErr'r+r,r/r3hf_video_reader _hf_encodedmetadatar)r>r@rYrrrWvideos r#decode_examplezVideo.decode_examplesK,{{no o  & & 8XY Y  $ "  eS ! $&D =%.&D >| #efkellm!noot$$!%!2!2$($8$8'+'>'>;;"nn (&7$($8$8'+'>'>;;"nn !!.. $ 4 4#'#:#:{{.. E&*F;" r"rcLddlm}|jr|S|d|ddS)zfIf in the decodable state, return the feature itself, otherwise flatten the feature into a dictionary.r)Valuebinarystringr8)featuresrdr&)r>rds r#flattenz Video.flattens2#{{  xh r"storagec tjj|jrltjdgt |ztj }tjj||gddg|j}ntjj|jrltjdgt |ztj}tjj||gddg|j}n&tjj|jr|jjddk\r|jd}n6tjdgt |ztj }|jjddk\r|jd}n6tjdgt |ztj}tjj||gddg|j}ntjj|jrtj|j!Dcgc]'}|!t#t%j|dnd)c}tj }tjdgt |ztj}tjj||gddg|j}t'||j(Scc}w)a'Cast an Arrow array to the Video arrow storage type. The Arrow types that can be converted to the Video pyarrow storage type are: - `pa.string()` - it must contain the "path" data - `pa.binary()` - it must contain the video bytes - `pa.struct({"bytes": pa.binary()})` - `pa.struct({"path": pa.string()})` - `pa.struct({"bytes": pa.binary(), "path": pa.string()})` - order doesn't matter - `pa.list(*)` - it must contain the video array data Args: storage (`Union[pa.StringArray, pa.StructArray, pa.ListArray]`): PyArrow array to cast. Returns: `pa.StructArray`: Array in the Video arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. N)rVrr)maskr)patypes is_stringrVrKlenre StructArray from_arraysis_null is_binaryrf is_structget_field_indexris_list to_pylistrOrJrr9)r>ri bytes_array path_arrayarrs r# cast_storagezVideo.cast_storagest& 88  gll +((D6CL#8ryy{KKnn00+w1G'SYIZahapapar0sG XX   -4&3w<"7biikJJnn00':1FRXHY`g`o`o`q0rG XX   -||++G49%mmG4  hhvG '<299;O ||++F3q8$]]62 XXtfs7|&;"))+N nn00+z1JWV\L]dkdsdsdu0vG XX  gll +((ahararatuZ]CO#/8QUUuYY[K4&3w<"7biikJJnn00j)GV+<;CVCVCX1G'4<<00vs ,M'r=)*rrr__doc__r&boolr r'r intr+r r,r/r rr3rr6r7rrlstructrerfr9rr;r?rrMrrJrNrXrQrbrh StringArrayrp ListArrayr{r!r"r#r%r%s<|FD"&L(3-&/5OW^,538FHU3./ 0818Iw-.8d7B 7=E8C==&RYYibiik'RSGXc]SwU?E3?.OE#ui"**Vd*d$e.Ojq.OfDHGS'\"G$DeD#I.>)>$?@G  GR  }d3 3E.FFG  ,1E".."..",,*V$W,1\^\j\j,1r"r%rarrAct)zOConvert a torchcodec Video object to bytes using native compression if possibleNotImplementedErrorras r#video_to_bytesr s  r"cHt|dr |jStd)Nr_zYEncoding a VideoDecoder that doesn't come from datasets.Video.decode() is not implemented)hasattrr_rrs r#rPrP%s(um$   ! g  r"rKctr=r)rKs r#rOrO.s  r"rrYstreamr+r)r,r/r.r3r1cddlm}|i}|jdd}|jtj rtj ntj} t|| } | |j| dnd} t| } t|d| } t|jd d k(rdnt|jd d }|| ||||| }|S) Nrrz::repo_id)tokenrb)download_config:rr[)rGrsplit startswithr HF_ENDPOINTHUB_DATASETS_URLHUB_DATASETS_HFFS_URLrrRrrror~)rrYrr+r,r/r3r source_urlpatternsource_url_fieldsrrf stream_idvds r#r^r^7s1 D!"%J)3)>)>v?Q?Q)Rf%%X^XtXtG&z7;CTC`  ! !"3I"> ?fjE$51O dD/:Ac*+q0c&,,s:KA:N6OI  '-  B Ir")Nrar(rr-r0).rS dataclassesrrpathlibrtypingrrrr r r r numpyrJpyarrowrlrdownload.download_configrtablerutils.file_utilsrrutils.py_utilsrtorchrGrrgrrr%rrrPrNrOrrQr}r~r^r!r"r#rs9 (TTT53+0%i  @1@1 @1F . U  > g  2:: ' @D/53818 S%c *:%: ;< ^,    U3./ 0 -.r"