!xjz$dZddlZdejcxkrdksnedejdZddlmcmZddl Z ddlm Z m Z m Z m Z mZmZddlmZmZmZgeejd zd ejd zRZ ed kr ed ejZ Gd d ZdZdZdZddZddZGdde jZ Gdde jZ!Gdde jZ"ej#e e!dZ$dS)zGPython bindings to the Zstandard (zstd) compression library (RFC-8878).N) )rzUnsupported Python version: )COMPRESSION_LEVEL_DEFAULTcompressCompressionParameter decompressDecompressionParameter finalize_dictget_frame_infoStrategy train_dictregister_shutilopenZstdFileget_frame_size zstd_versionzstd_version_infoZstdCompressorZstdDecompressorZstdDict ZstdError)rrrrrr)rr_nbytesd)zzstd version is too oldc2eZdZdZdZfdZdZdZxZS) FrameInfoz$Information about a Zstandard frame.decompressed_size dictionary_idctd|td|dS)Nr!r")super __setattr__)selfr!r" __class__s HC:\Projects\Historical\venv\Lib\site-packages\backports/zstd/__init__.py__init__zFrameInfo.__init__;s? /1BCCC O];;;;;c(d|jd|jdS)NzFrameInfo(decompressed_size=z, dictionary_id=)r r&s r(__repr__zFrameInfo.__repr__?s07t/E77!%!3777 8r*c&td|)Nzcan't set attribute )AttributeError)r&name_s r(r%zFrameInfo.__setattr__Cs>>>>>>r*rc8ttj|S)aGet Zstandard frame information from a frame header. *frame_buffer* is a bytes-like object. It should start from the beginning of a frame, and needs to include at least the frame header (6 to 18 bytes). The returned FrameInfo object has two attributes. 'decompressed_size' is the size in bytes of the data in the frame when decompressed, or None when the decompressed size is unknown. 'dictionary_id' is an int in the range (0, 2**32). The special value 0 means that the dictionary ID was not recorded in the frame header, the frame may or may not need a dictionary to be decoded, and the ID of such a dictionary is not specified. )r_zstdr ) frame_buffers r(r r Gs e*<88 99r*c`t|ts't|j}t d|dt |}d|}t d|D}|stdtj |||}t|S)zReturn a ZstdDict representing a trained Zstandard dictionary. *samples* is an iterable of samples, where a sample is a bytes-like object representing a file. *dict_size* is the dictionary's maximum size, in bytes. z%dict_size must be an int object, not .r*c34K|]}t|VdSNr.0samples r( ztrain_dict..g(>>F>>>>>>r*z2samples contained no data; can't train dictionary.) isinstanceinttyper5 TypeErrortuplejoin ValueErrorr:rr)samples dict_sizeds_clschunks chunk_sizes dict_contents r(rrYs i % %Mi-KKKKLLLGnnG XXg  F>>g>>>>>K OMNNN#FKCCL L ! !!r*ct|tstdt|tstdt|tstdt |}d|}t d|D}|st dtj|j ||||}t|S)aHReturn a ZstdDict representing a finalized Zstandard dictionary. Given a custom content as a basis for dictionary, and a set of samples, finalize *zstd_dict* by adding headers and statistics according to the Zstandard dictionary format. You may compose an effective dictionary content by hand, which is used as basis dictionary, and use some samples to finalize a dictionary. The basis dictionary may be a "raw content" dictionary. See *is_raw* in ZstdDict. *samples* is an iterable of samples, where a sample is a bytes-like object representing a file. *dict_size* is the dictionary's maximum size, in bytes. *level* is the expected compression level. The statistics for each compression level differ, so tuning the dictionary to the compression level can provide improvements. z/zstd_dict argument should be a ZstdDict object.z+dict_size argument should be an int object.z'level argument should be an int object.r*c34K|]}t|VdSr?r@rAs r(rDz finalize_dict..rEr*z=The samples are empty content, can't finalize the dictionary.) rFrrIrGrJrKrLr:r rR) zstd_dictrMrNlevelrPrQrRs r(r r ns( i * *KIJJJ i % %GEFFF eS ! !CABBBGnnG XXg  F>>g>>>>>K ('(( (&y'=v'2IuFFL L ! !!r*cht|||}||tjS)aReturn Zstandard compressed *data* as bytes. *level* is an int specifying the compression level to use, defaulting to COMPRESSION_LEVEL_DEFAULT ('3'). *options* is a dict object that contains advanced compression parameters. See CompressionParameter for more on options. *zstd_dict* is a ZstdDict object, a pre-trained Zstandard dictionary. See the function train_dict for how to train a ZstdDict on sample data. For incremental compression, use a ZstdCompressor instead. )rVoptionsrU)mode)rr FLUSH_FRAME)datarVrXrUcomps r(rrs1 w) L L LD ==N$>= ? ??r*cg} t||}||||jst d|j}|snZd|S)aDecompress one or more frames of Zstandard compressed *data*. *zstd_dict* is a ZstdDict object, a pre-trained Zstandard dictionary. See the function train_dict for how to train a ZstdDict on sample data. *options* is a dict object that contains advanced compression parameters. See DecompressionParameter for more on options. For incremental decompression, use a ZstdDecompressor instead. T)rXrUzACompressed data ended before the end-of-stream marker was reachedr*)rappendr eofr unused_datarK)r[rUrXresultsdecomps r(r r sG!'YGGGv((..///z @?@@ @!   88G  r*c"eZdZdZejZejZej Z ej Z ej ZejZejZejZejZejZejZejZejZejZ ej!Z"ej#Z$ej%Z&ej'Z(ej)Z*dZ+dS)rzCompression parameters.c8tj|jdS)zReturn the (lower, upper) int bounds of a compression parameter. Both the lower and upper bounds are inclusive. T is_compressr:get_param_boundsvaluer-s r(boundszCompressionParameter.boundss %djdCCCCr*N),r3r4r5r6r:ZSTD_c_compressionLevelcompression_levelZSTD_c_windowLog window_logZSTD_c_hashLoghash_logZSTD_c_chainLog chain_logZSTD_c_searchLog search_logZSTD_c_minMatch min_matchZSTD_c_targetLength target_lengthZSTD_c_strategystrategy!ZSTD_c_enableLongDistanceMatchingenable_long_distance_matchingZSTD_c_ldmHashLog ldm_hash_logZSTD_c_ldmMinMatch ldm_min_matchZSTD_c_ldmBucketSizeLogldm_bucket_size_logZSTD_c_ldmHashRateLogldm_hash_rate_logZSTD_c_contentSizeFlagcontent_size_flagZSTD_c_checksumFlag checksum_flagZSTD_c_dictIDFlag dict_id_flagZSTD_c_nbWorkers nb_workersZSTD_c_jobSizejob_sizeZSTD_c_overlapLog overlap_logrjr*r(rrs!!5'J#H%I'J%I-M$H$)$K!*L,M734-M*L'J#H)KDDDDDr*rc&eZdZdZejZdZdS)r zDecompression parameters.c8tj|jdS)zReturn the (lower, upper) int bounds of a decompression parameter. Both the lower and upper bounds are inclusive. Frergr-s r(rjzDecompressionParameter.boundss %djeDDDDr*N)r3r4r5r6r:ZSTD_d_windowLogMaxwindow_log_maxrjrr*r(r r s6##.NEEEEEr*r ceZdZdZejZejZej Z ej Z ej ZejZejZejZejZdS)r zCompression strategies, listed from fastest to strongest. Note that new strategies might be added in the future. Only the order (from fast to strong) is guaranteed, the numeric value might change. N)r3r4r5r6r: ZSTD_fastfast ZSTD_dfastdfast ZSTD_greedygreedy ZSTD_lazylazy ZSTD_lazy2lazy2 ZSTD_btlazy2btlazy2 ZSTD_btoptbtopt ZSTD_btultrabtultra ZSTD_btultra2btultra2rr*r(r r s` ?D  E  F ?D  E G  E G"HHHr*r cR|dkrddlm}|Stdtd|)Nrr)rzmodule z has no attribute )backports.zstd._shutilrr0r3)r1rs r( __getattr__rsE    :::::: I8IIII J JJr*)NNN)NN)%r6sys version_info RuntimeErrorversion__all__backports.zstd._zstdzstdr:enumrrrrrrbackports.zstd._zstdfilerrrdivmodzstd_version_numberrZSTD_CLEVEL_DEFAULTrrr rr rr IntEnumrr r set_parameter_typesrrr*r(rsMM 3#----g---- ,CckCC D DD :%$$$$$$$$ @@@@@@@@@@@@@@@@<<<<<<<<<<6ffU6#=sCC6.466Hy  ,0 1 11!5A>>>>>>>>":::$"""*#"#"#"L @ @ @ @ .DDDDD4<DDDD E E E E ET\ E E E#####t|###(.0FGGGKKKKKr*