XjVddlZddlZddlmZddlmZmZddlmZe Z e Z edZ eGddZ eGdd ZeGd d ZdS) N) defaultdict) dataclassfield)Literal) F64F32F16BF16I64I32I16I8U8U3BOOLcxeZdZUdZeed<eeed<eeefed<e dZ eed<d d Z d S) TensorInfoaBInformation about a tensor. For more details regarding the safetensors format, check out https://huggingface.co/docs/safetensors/index#format. Attributes: dtype (`str`): The data type of the tensor ("F64", "F32", "F16", "BF16", "I64", "I32", "I16", "I8", "U8", "U3", "BOOL"). shape (`list[int]`): The shape of the tensor. data_offsets (`tuple[int, int]`): The offsets of the data in the file as a tuple `[BEGIN, END]`. parameter_count (`int`): The number of parameters in the tensor. dtypeshape data_offsetsFinitparameter_countreturnNc tjtj|j|_dS#t $r d|_YdSwxYw)N) functoolsreduceoperatormulrr TypeError)selfs SC:\Projects\Historical\venv\Lib\site-packages\huggingface_hub/utils/_safetensors.py __post_init__zTensorInfo.__post_init__#sR %#,#3HL$*#M#MD  % % %#$D  %s)-AArN) __name__ __module__ __qualname____doc__DTYPE_T__annotations__listinttuplerrr$r#rr s   NNN 9S/!!! 5e,,,OS,,,%%%%%%r0rceZdZUdZeeefed<eeefed<e dZ ee e fed<d d Z dS) SafetensorsFileMetadataaMetadata for a Safetensors file hosted on the Hub. This class is returned by [`parse_safetensors_file_metadata`]. For more details regarding the safetensors format, check out https://huggingface.co/docs/safetensors/index#format. Attributes: metadata (`dict`): The metadata contained in the file. tensors (`dict[str, TensorInfo]`): A map of all tensors. Keys are tensor names and values are information about the corresponding tensor, as a [`TensorInfo`] object. parameter_count (`dict[str, int]`): A map of the number of parameters per data type. Keys are data types and values are the number of parameters of that data type. metadatatensorsFrrrNctt}|jD]}||jxx|jz cc<t ||_dSN)rr-r4valuesrrdict)r"rtensors r#r$z%SafetensorsFileMetadata.__post_init__Bsh.9#.>.>l))++ D DF FL ) ) )V-C C ) ) ) )#O44r0r%)r&r'r(r)r8strr+ TENSOR_NAME_Trrrr*r-r$r/r0r#r2r2+s"38n -+ ,,,,*/%U*;*;*;OT'3,';;;555555r0r2ceZdZUdZedzed<eed<eeefed<eee fed<e dZ ee e fed <d d ZdS) SafetensorsRepoMetadataa Metadata for a Safetensors repo. A repo is considered to be a Safetensors repo if it contains either a 'model.safetensors' weight file (non-shared model) or a 'model.safetensors.index.json' index file (sharded model) at its root. This class is returned by [`get_safetensors_metadata`]. For more details regarding the safetensors format, check out https://huggingface.co/docs/safetensors/index#format. Attributes: metadata (`dict`, *optional*): The metadata contained in the 'model.safetensors.index.json' file, if it exists. Only populated for sharded models. sharded (`bool`): Whether the repo contains a sharded model or not. weight_map (`dict[str, str]`): A map of all weights. Keys are tensor names and values are filenames of the files containing the tensors. files_metadata (`dict[str, SafetensorsFileMetadata]`): A map of all files metadata. Keys are filenames and values are the metadata of the corresponding file, as a [`SafetensorsFileMetadata`] object. parameter_count (`dict[str, int]`): A map of the number of parameters per data type. Keys are data types and values are the number of parameters of that data type. Nr3sharded weight_mapfiles_metadataFrrrctt}|jD]1}|jD]\}}||xx|z cc<2t ||_dSr6)rr-r@r7ritemsr8)r"r file_metadatarnb_parameters_s r#r$z%SafetensorsRepoMetadata.__post_init__js.9#.>.>!07799 9 9M)6)F)L)L)N)N 9 9%~&&&.8&&&& 9#O44r0r%)r&r'r(r)r8r+boolr; FILENAME_Tr2rrr*r-r$r/r0r#r=r=Is2Tk MMM]J.////%<<====*/%U*;*;*;OT'3,';;;555555r0r=)rr collectionsr dataclassesrrtypingrr:rFr;r*rr2r=r/r0r#rJs######((((((((  \ ] %%%%%%% %: 5555555 5: %5%5%5%5%5%5%5 %5%5%5r0