Xj0lUddlZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl Z ddl mZdd l mZmZmZejd Zd Zd ZiZeed fed<ejZiZeeejfed<dedefdZGddee ZedGddZ edGdd Z!d3de j"dedzde dzfdZ#deeefde!dzfdZ$ede deeefde!fd Z%ed!edeeefde!fd"Z&d!edeeefdefd#Z'd$edejfd%Z(d&e!defd'Z)eddd(d)ed*ed+ed,edzdedzdef d-Z*Gd.d/Z+e+Z,d0Z-deeefdeeeffd1Z.d2Z/dS)4N)Mapping) dataclass)Enum)Any) constants)hf_raise_for_status http_backoffvalidate_hf_hub_argsz^[0-9a-fA-F]{64}$<iXetConnectionInfoXET_CONNECTION_INFO_CACHE_XET_CONNECTION_INFO_KEY_LOCKSxet_hashreturncPtt|S)zLReturn whether `xet_hash` looks like a real Xet content hash (64 hex chars).)bool_REGEX_XET_HASH fullmatch)rs KC:\Projects\Historical\venv\Lib\site-packages\huggingface_hub/utils/_xet.pyis_valid_xet_hashrs ))(33 4 44ceZdZdZdZdS) XetTokenTypereadwriteN)__name__ __module__ __qualname__READWRITErrrrs D EEErrT)frozenc$eZdZUeed<eed<dS) XetFileData file_hash refresh_routeN)rrr str__annotations__r#rrr&r&#s'NNNrr&c.eZdZUeed<eed<eed<dS)r access_tokenexpiration_unix_epochendpointN)rrr r)r*intr#rrrr)s1MMMMMrresponser.c|dS |jtj}tj|jvr|jtjd}n|jtj}n#t $rYdSwxYw||n tj}|tj rF| tj d| d}t||S)a_ Parse XET file metadata from an HTTP response. This function extracts XET file metadata from the HTTP headers or HTTP links of a given response object. If the required metadata is not found, it returns `None`. Args: response (`httpx2.Response`): The HTTP response object containing headers dict and links dict to extract the XET metadata from. Returns: `Optional[XetFileData]`: An instance of `XetFileData` containing the file hash and refresh route if the metadata is found. Returns `None` if the required metadata is missing. Nurl/)r'r() headersrHUGGINGFACE_HEADER_X_XET_HASH$HUGGINGFACE_HEADER_LINK_XET_AUTH_KEYlinks&HUGGINGFACE_HEADER_X_XET_REFRESH_ROUTEKeyErrorENDPOINT startswithHUGGINGFACE_CO_URL_HOMEreplacerstripr&)r0r.r'r(s r!parse_xet_file_data_from_responser?0st$Y%LM  9X^ K K$N9+YZ[`aMM$,Y-]^M tt#/xxY5GH ABBs%--i.O.V.VWZ.[.[]e]l]lmp]q]qrr #   sAA&& A43A4r4c |tj}|tj}t|tj}n#t t tf$rYdSwxYwt|||S)a Parse XET connection info from the HTTP headers or return None if not found. Args: headers (`dict`): HTTP headers to extract the XET metadata from. Returns: `XetConnectionInfo` or `None`: The information needed to connect to the XET storage service. Returns `None` if the headers do not contain the XET connection info. N)r.r,r-) r!HUGGINGFACE_HEADER_X_XET_ENDPOINT%HUGGINGFACE_HEADER_X_XET_ACCESS_TOKENr/#HUGGINGFACE_HEADER_X_XET_EXPIRATIONr9 ValueError TypeErrorr)r4r.r,r-s r&parse_xet_connection_info_from_headersrFSs9FGyNO #GI,Y$Z [ [ j) ,tt !3   sAAA! A! file_datacX|jtdt|j|S)a Utilizes the information in the parsed metadata to request the Hub xet connection information. This includes the access token, expiration, and XET service URL. Args: file_data: (`XetFileData`): The file data needed to refresh the xet connection information. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. Nz>The provided xet metadata does not contain a refresh endpoint.)r(rD#_fetch_xet_connection_info_with_url)rGr4s rrefresh_xet_connection_inforJls/.&YZZZ .y/F P PPrr2c zt||}t|}|t|s|St |5t|}|t|s|cdddSt d||}t |t|j}|tdt5tt D]/\}}t|rt |d0tttkr9t t!t#t|t|<dddn #1swxYwY|cdddS#1swxYwYdS)a Requests the xet connection info from the supplied URL. This includes the access token, expiration time, and endpoint to use for the xet storage service. Result is cached to avoid redundant requests. Args: url: (`str`): The access token endpoint URL. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. NGETr4z6Xet headers have not been correctly set by the server.) _cache_keyrget _is_expired _key_lockr r rFr4rD_XET_CONNECTION_INFO_LOCKlistitemspoplenXET_CONNECTION_INFO_CACHE_SIZEnextiter)r2r4 cache_key cached_inforespmetadatakvs rrIrIsE43((I+// ::K;''   9  /33I>>  ";{+C+C " E3888D!!!9$,GG  UVV V & < <6<<>>?? ; ;1q>>;-11!T:::,--1OOO)--d48Q3R3R.S.STTT4< %i 0 < < < < < < < < < < < < < < <5s> -F0A F0B7F F0F F0F F00F47F4cxd|D}|dd}|d|S)z;Return a unique cache key for the given request parameters.c>i|]\}}||Sr#lower).0r^r_s r z_cache_key..s&>>>daQWWYY>>>r authorization|)rTrO)r2r4 lower_headers auth_headers rrNrNsF>>gmmoo>>>M##OR88K ! !K ! !!rrZct5t|tjcdddS#1swxYwYdS)zNReturn the lock guarding token fetches for `cache_key`, creating it if needed.N)rRr setdefault threadingLock)rZs rrQrQs "VV-88INDTDTUUVVVVVVVVVVVVVVVVVVs,AAAconnection_infocd|jttjtzkS)z2Check if the given XET connection info is expired.)r-r/time!XET_CONNECTION_INFO_SAFETY_PERIOD)ros rrPrPs$  0C 4D4DGh4h hhr)revisionr. token_typerepo_id repo_typerscl||n tj}|d|d|d|jd}|dks||d|z }|S)a Build the URL used to fetch or refresh a Xet access token for a given repo. Args: token_type (`XetTokenType`): Type of the token to request: `"read"` or `"write"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. repo_type (`str`): Type of the repo (e.g. `"model"`, `"dataset"`, `"space"`, `"bucket"`). revision (`str`, `optional`): The revision of the repo to get the token for. endpoint (`str`, `optional`): The endpoint to use for the request. Defaults to the Hub endpoint. Returns: `str`: The fully-qualified URL of the token refresh endpoint. Nz/api/zs/z/xet-z-tokenbucketr3)rr:value)rtrurvrsr.r2s rxet_connection_info_refresh_urlrzse4$/xxY5GH  O OI O O O Oz7G O O OCH 4 ~8~~ Jrc&eZdZdZddZdZdZdS)XetSessionHoldera7Holds an optional XetSession; supports safe re-creation after sigint_abort or fork. Thread-safe: a ``threading.Lock`` guards all state mutations, which matters for free-threaded Python (3.14t) where multiple threads can race on ``get()`` or ``sigint_abort()`` without the GIL serialising them. rNcRtj|_d|_d|_dSN)rmrn_lock_session _session_pidselfs r__init__zXetSessionHolder.__init__s&^%% ! (,rc|j5tj}|j|j|krd|_|jddlm}||_||_|jcdddS#1swxYwYdS)aReturn the current session, creating one if needed. Fork-safe: if the current process PID differs from the PID that created the session (i.e. we are in a forked child), the old session is discarded and a fresh session is created for this process. Nr) XetSession)rosgetpidrrhf_xetr)r current_pidrs rrOzXetSessionHolder.get sZ ! !)++K}(T->+-M-M!% }$------ *  $/!= ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !sAA++A/2A/c|j5|j9 |jn#t$rYnwxYwd|_d|_ddddS#1swxYwYdS)zMAbort the current session and clear it so the next get() creates a fresh one.N)rr sigint_abort Exceptionrrs rrzXetSessionHolder.sigint_abort#s Z ) )}(M..0000 D $ $(! ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) )s,A+A 8A8AAA)rN)rrr __doc__rrOrr#rrr|r|sP---- !!!0 ) ) ) ) )rr|c4tS)a*Return the global :class:`hf_xet.XetSession`, creating it on first call. The session is shared across all calls within a process, just as the HTTP client returned by :func:`~huggingface_hub.utils._http.get_session` is shared. It is created lazily and is fork-safe and thread-safe. )_GLOBAL_XET_HOLDERrOr#rrget_xet_sessionr2s  ! ! # ##rc>d|DS)zReturn a copy of headers with the authorization header removed. Xet storage requests use a short-lived xet access token for auth, so the Hub authorization header must not be forwarded to xet storage endpoints. cJi|] \}}|dk||!S)rfrb)rdkeyrys rrez,xet_headers_without_auth..Bs0 [ [ [:3CIIKK?rs}  ######!!!!!! EEEEEEEEEE"*122$&!!&<>4%8 89>>>*IN,,<>S).%8 9>>>555555 3  $  $   3QU: alosas    FGCH4EJ[^bJb2QQ#s(^Q QQQQ6; ; #s(^;;;;;|"C"$sCx."S""""VVVVVV i!2itiiii    !!!!! ! Dj ! Dj ! !!!!H.).).).).).).).)b&%''$$$\d38n\c3h\\\\&&&&&r