=xjRYddlZddlZddlmZddlmZddlmZddlm Z m Z m Z m Z ddl mZmZmZmZGdde ZGd d e ZGd d e ZGd de ZdS)N) parse_qsl) ClientError)S3CopyFailedError)CompleteMultipartUploadTaskCreateMultipartUploadTaskSubmissionTaskTask)ChunksizeAdjustercalculate_range_parameter get_callbacksget_filtered_dictc eZdZdZdddddddd d d Zgd Zgd ZgdZgdZd d gZ gdZ d d gZ d d gZ gdZ dZdZ ddZdZdZdZdZdZdZdS)CopySubmissionTaskz+Task for submitting tasks to execute a copyIfMatchIfModifiedSince IfNoneMatchIfUnmodifiedSinceSSECustomerKeySSECustomerAlgorithmSSECustomerKeyMD5 RequestPayerExpectedBucketOwner) CopySourceIfMatchCopySourceIfModifiedSinceCopySourceIfNoneMatchCopySourceIfUnmodifiedSinceCopySourceSSECustomerKeyCopySourceSSECustomerAlgorithmCopySourceSSECustomerKeyMD5rr) rrrrrrrrrrrr) rrrrrrrMetadataDirectiveTaggingDirectiveAnnotationDirectiveTagging) CacheControlContentDispositionContentEncodingContentLanguage ContentTypeExpiresMetadata)rrrrr)rrChecksumAlgorithmc i}|jj}d}t|jtr|jd}|jj |jj||j} |j } | D]\} } | |j vr| | |j | <|j j di| } |j| d|j| d|| }|jj|jkr||||||dS||||||||dS)a :param client: The client associated with the transfer manager :type config: s3transfer.manager.TransferConfig :param config: The transfer config associated with the transfer manager :type osutil: s3transfer.utils.OSUtil :param osutil: The os utility associated to the transfer manager :type request_executor: s3transfer.futures.BoundedExecutor :param request_executor: The request executor associated with the transfer manager :type transfer_future: s3transfer.futures.TransferFuture :param transfer_future: The transfer future associated with the transfer request that tasks are being submitted for N VersionId ContentLengthETag)source_version_id)meta call_args isinstance copy_sourcedictgetsizeetag)_get_head_object_request_from_copy_source extra_argsitemsEXTRA_ARGS_TO_HEAD_ARGS_MAPPING source_client head_objectprovide_transfer_sizeprovide_object_etag_extract_preserved_metadatamultipart_threshold_submit_copy_request_submit_multipart_request)selfclientconfigosutilrequest_executortransfer_futurepreserved_metadatar3r0head_object_requestr;paramvalueresponses BC:\Projects\Historical\venv\Lib\site-packages\s3transfer/copies.py_submitzCopySubmissionTask._submitos* #(2   i+T 2 2 G ) 5 9 9+ F F   % -#(0>>) #-J!+ 0 0 2 2   uD@@@( % rSc|ddkr|Sfd|D}|||S)Nr REPLACEc.i|]\}}|jv||Sr1r).0kvrFs rQ z@CopySubmissionTask._apply_preserved_metadata..as7   1666 q666rS)r7r<update)rFr;rLresults` rQrhz,CopySubmissionTask._apply_preserved_metadata[sq >>- . .) ; ;     "((**     ())) rSct|trtj|Std|dt |d)NzLExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got z or type .)r4r6copy TypeErrortype)rFr5s rQr:zz?CopyCompleteMultipartUploadTask._apply_tags..s4AqA&&rSr#T)keep_blank_values)rrr#r1) r;r7r5r rrr>get_object_taggingrrVrWrput_object_tagging) rFrGr3r0rr; directive src_kwargstag_set put_kwargss rQrz+CopyCompleteMultipartUploadTask._apply_tagss) NN#566 / / / F   #/9 ,U3$ 2 JJ! <*; ;'@i-@c(B G%NN9b11&*G  F&= '*   .F    6&5J{ #!!//J/////rSc V|j}|ddkrdS|jd|jdd}|r||d<i|t|tj}i|t|tj} t|tj} |jj di|} g} i} | dgD]}|d}|jj di| d|i}|j |j ||d  d | }|r||d<|r||d < |jdi|| |}#t $r}|| |<Yd}~d}~wwxYw| rGt#d |j d |j d| dt%| d| dS)Nr"rrrrr- AnnotationsAnnotationNameAnnotationPayload)rrrr ObjectIfMatchz#Failed to copy annotations to s3:///z . Succeeded: z . Failed: z . Errors: r1)r;r7r5r rrrrr>list_object_annotationsget_object_annotationrVrWreadput_object_annotationrs Exceptionrlistkeys)rFrGr3r0rrr;src_base list_kwargsget_kwargs_baseput_passthrough list_response succeededfailed annotationnamepayload_responseres rQrz2CopyCompleteMultipartUploadTask._apply_annotationss) >>/ 0 0F : : F+H5(/    6$5H[ !  .K   .I  , *E  H /G     '++M2>> ! !J./DLy6L  !  #     $* }"&%5'&$&& "J :*9 ;' 8.7 ?+ !,,::z:::  &&&& ! ! ! t  !  #$!($$+4=$$'$$  ..$$" $$   s!"E EEEN)rrrrrrrr1rSrQrvrvsQ    2(0(0(0TEEEEErSrvceZdZdZdZdS)r^zTask to do a nonmultipart copycJ|jd|||d||D]}||dS)a :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to copy to :param key: The name of the key to copy to :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy :param size: The size of the transfer. This value is passed into the callbacks ) CopySourcerrbytes_transferredNr1) copy_object) rFrGr5rVrWr;rXr8callbacks rQrzCopyObjectTask._mainse  "6s  >H   " - -H Ht , , , , , - -rSNrrrrrr1rSrQr^r^s)((-----rSr^ceZdZdZ ddZdS)rtz)Task to upload a part in a multipart copyNc  |jd|||||d|} nm#t$r`} | jdid} |d}|d}| dkrt d|d|d d } ~ wwxYw|D]}|| | d d }||d}| r2d| }|| d vr| d |||<|S)a< :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to upload to :param key: The name of the key to upload to :param upload_id: The id of the upload :param part_number: The number representing the part of the multipart upload :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy part :param size: The size of the transfer. This value is passed into the callbacks :param checksum_algorithm: The algorithm that was used to create the multipart upload :rtype: dict :returns: A dictionary representing a part:: {'Etag': etag_value, 'PartNumber': part_number} This value can be appended to a list to be used to complete the multipart upload. If a checksum is in the response, it will also be included. )rrrr PartNumberErrorCoderrPreconditionFailedzContents of stored object "z " in bucket "z" did not match expected ETag.NrCopyPartResultr/)r/rChecksumr1)upload_part_copyrrPr7rupper)rFrGr5rVrWrercr;rXr8rdrPr error_codesrc_key src_bucketrr9 part_metadatachecksum_members rQrzCopyPartTask._main3svL .v.&"&   HH   4488@@J!%(G$X.J111'%'%%",%%%  " - -H Ht , , , , ,()&1!%[AA  E);)A)A)C)CEEO(+;"<<<19:J1K#2 o.s BAA;;Brrr1rSrQrtrt0s933 EEEEEErSrt)rrm urllib.parserbotocore.exceptionsrs3transfer.exceptionsrs3transfer.tasksrrrr s3transfer.utilsr r r r rrvr^rtr1rSrQrs """"""++++++333333 ````````F OOOOO&AOOOd-----T---2HHHHH4HHHHHrS