/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__
NameSizeModeActions
bandwidth.cpython-313.pyc179660644editdlrm
compat.cpython-313.pyc27020644editdlrm
constants.cpython-313.pyc6880644editdlrm
copies.cpython-313.pyc111430644editdlrm
crt.cpython-313.pyc428680644editdlrm
delete.cpython-313.pyc25350644editdlrm
download.cpython-313.pyc314410644editdlrm
exceptions.cpython-313.pyc19370644editdlrm
futures.cpython-313.pyc287040644editdlrm
manager.cpython-313.pyc262910644editdlrm
processpool.cpython-313.pyc414160644editdlrm
subscribers.cpython-313.pyc36730644editdlrm
tasks.cpython-313.pyc137110644editdlrm
upload.cpython-313.pyc314740644editdlrm
utils.cpython-313.pyc369150644editdlrm
__init__.cpython-313.pyc343430644editdlrm
Edit: /usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__/manager.cpython-313.pyc (26291B)
jp4SSKrSSKrSSKrSSKrSSKJrJr SSKJrJ r J r J r SSK J r SSKJr SSKJr SSKJrJr SSKJrJrJrJrJrJr SS KJr SS KJrJ r J!r!J"r"J#r#J$r$J%r%J&r& \RN"\(5r)"S S 5r*"S S5r+"SS5r,g)N)BandwidthLimiter LeakyBucket)ALLOWED_DOWNLOAD_ARGSFULL_OBJECT_CHECKSUM_ARGSKBMB)CopySubmissionTask)DeleteSubmissionTask)DownloadSubmissionTask)CancelledError FatalError)IN_MEMORY_DOWNLOAD_TAGIN_MEMORY_UPLOAD_TAGBoundedExecutorTransferCoordinatorTransferFuture TransferMeta)UploadSubmissionTask)CallArgsOSUtilsSlidingWindowSemaphore TaskSemaphore get_callbacksset_default_checksum_algorithmsignal_not_transferringsignal_transferringc N\rSrSrS\-S\-SSSSSS\-SSSS4 SjrS rS rg) TransferConfig4 iNc XlX lX0lX@lXPlX`lXplXlXlXl Xl Xl UR5 g)a Configurations for the transfer manager :param multipart_threshold: The threshold for which multipart transfers occur. :param max_request_concurrency: The maximum number of S3 API transfer-related requests that can happen at a time. :param max_submission_concurrency: The maximum number of threads processing a call to a TransferManager method. Processing a call usually entails determining which S3 API requests that need to be enqueued, but does **not** entail making any of the S3 API data transferring requests needed to perform the transfer. The threads controlled by ``max_request_concurrency`` is responsible for that. :param multipart_chunksize: The size of each transfer if a request becomes a multipart transfer. :param max_request_queue_size: The maximum amount of S3 API requests that can be queued at a time. :param max_submission_queue_size: The maximum amount of TransferManager method calls that can be queued at a time. :param max_io_queue_size: The maximum amount of read parts that can be queued to be written to disk per download. The default size for each elementin this queue is 8 KB. :param io_chunksize: The max size of each chunk in the io queue. Currently, this is size used when reading from the downloaded stream as well. :param num_download_attempts: The number of download attempts that will be tried upon errors with downloading an object in S3. Note that these retries account for errors that occur when streaming down the data from s3 (i.e. socket errors and read timeouts that occur after receiving an OK response from s3). Other retryable exceptions such as throttling errors and 5xx errors are already retried by botocore (this default is 5). The ``num_download_attempts`` does not take into account the number of exceptions retried by botocore. :param max_in_memory_upload_chunks: The number of chunks that can be stored in memory at a time for all ongoing upload requests. This pertains to chunks of data that need to be stored in memory during an upload if the data is sourced from a file-like object. The total maximum memory footprint due to a in-memory upload chunks is roughly equal to: max_in_memory_upload_chunks * multipart_chunksize + max_submission_concurrency * multipart_chunksize ``max_submission_concurrency`` has an affect on this value because for each thread pulling data off of a file-like object, they may be waiting with a single read chunk to be submitted for upload because the ``max_in_memory_upload_chunks`` value has been reached by the threads making the upload request. :param max_in_memory_download_chunks: The number of chunks that can be buffered in memory and **not** in the io queue at a time for all ongoing download requests. This pertains specifically to file-like objects that cannot be seeked. The total maximum memory footprint due to a in-memory download chunks is roughly equal to: max_in_memory_download_chunks * multipart_chunksize :param max_bandwidth: The maximum bandwidth that will be consumed in uploading and downloading file content. The value is in terms of bytes per second. N) multipart_thresholdmultipart_chunksizemax_request_concurrencymax_submission_concurrencymax_request_queue_sizemax_submission_queue_sizemax_io_queue_size io_chunksizenum_download_attemptsmax_in_memory_upload_chunksmax_in_memory_download_chunks max_bandwidth_validate_attrs_are_nonzero) selfr%r&r'r(r)r*r+r,r-r.r/r0s E/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/manager.py__init__TransferConfig.__init__5sYl$7 #6 '>$*D'&<#)B&!2(%:"+F(-J** ((*cURR5H"upUcM US::dM[SUSUS35e g)NrzProvided parameter z of value z must be greater than 0.)__dict__items ValueError)r2attrattr_vals r3r1*TransferConfig._validate_attrs_are_nonzerosL"mm113ND#A  )$z(D))4r6) r,r0r/r.r+r'r)r(r*r&r%r-) __name__ __module__ __qualname____firstlineno__rrr4r1__static_attributes__r6r3rr4s@FF "#$#"&2X$&&(b+Hr6rc"\rSrSr\r/SQr\SS/-\-r\/SQ-r/SQr Sr S\ R"S 50r SS jr\S 5r\S 5rSSjrSSjrSSjrSSjrSrSrSrS SjrSrSrSrSrSrS!Sjr\ 4Sjr!Sr"g )"TransferManager)ACL CacheControlChecksumAlgorithmContentDispositionContentEncodingContentLanguage ContentTypeExpectedBucketOwnerExpiresGrantFullControl GrantRead GrantReadACP GrantWriteACPMetadataObjectLockLegalHoldStatusObjectLockModeObjectLockRetainUntilDate RequestPayerServerSideEncryption StorageClassSSECustomerAlgorithmSSECustomerKeySSECustomerKeyMD5 SSEKMSKeyIdSSEKMSEncryptionContextTaggingWebsiteRedirectLocation ChecksumType MpuObjectSize) CopySourceIfMatchCopySourceIfModifiedSinceCopySourceIfNoneMatchCopySourceIfUnmodifiedSinceCopySourceSSECustomerAlgorithmCopySourceSSECustomerKeyCopySourceSSECustomerKeyMD5MetadataDirectiveTaggingDirective)MFA VersionIdrXrNTzS3 Object LambdazV^arn:(aws).*:s3-object-lambda:[a-z\-0-9]+:[0-9]{12}:accesspoint[/:][a-zA-Z0-9\-]{1,63}Nc `XlX lUc[5UlX0lUc[ 5Ul[ 5UlSUl[URRURR[[URR5[[URR 50US9Ul[URR$URR&US9Ul[URR*SUS9UlSUlURR0bY[2R5SURR05 [7URR05n[9U5UlUR;5 g)aA transfer manager interface for Amazon S3 :param client: Client to be used by the manager :param config: TransferConfig to associate specific configurations :param osutil: OSUtils object to use for os-related behavior when using with transfer manager. :type executor_cls: s3transfer.futures.BaseExecutor :param executor_cls: The class of executor to use with the transfer manager. By default, concurrent.futures.ThreadPoolExecutor is used. Nr)max_sizemax_num_threadstag_semaphores executor_cls)rprqrszSetting max_bandwidth to %s)_client_configr_osutilrTransferCoordinatorController_coordinator_controller _id_counterrr)r'rrr.rrr/_request_executorr*r(_submission_executorr+ _io_executor_bandwidth_limiterr0loggerdebugrr_register_handlers)r2clientconfigosutilrs leaky_buckets r3r4TransferManager.__init__sY  >)+DL >"9DL'D'F$"1\\88 LL@@$mLL<<''(>LL>>) & "  %4\\;; LLCC%% !,\\33% #' << % % 1 LL-t||/I/I 't||'A'ABL&6|&DD # !r6cUR$N)rur2s r3rTransferManager.client* ||r6cUR$r)rvrs r3rTransferManager.config.rr6cDU(aUR5O0nUc/nURX@R5 URU5 UR U5 [ UUUUUS9n0nUR (aUR US'URU[U5$)a,Uploads a file to S3 :type fileobj: str or seekable file-like object :param fileobj: The name of a file to upload or a seekable file-like object to upload. It is recommended to use a filename because file-like objects may result in higher memory usage. :type bucket: str :param bucket: The name of the bucket to upload to :type key: str :param key: The name of the key to upload to :type extra_args: dict :param extra_args: Extra arguments that may be passed to the client operation :type subscribers: list(s3transfer.subscribers.BaseSubscriber) :param subscribers: The list of subscribers to be invoked in the order provided based on the event emit during the process of the transfer request. :rtype: s3transfer.futures.TransferFuture :returns: Transfer future representing the upload )fileobjbucketkey extra_args subscribersbandwidth_limiter) copy_validate_all_known_argsALLOWED_UPLOAD_ARGS_validate_if_bucket_supported_add_operation_defaultsrr~_submit_transferr)r2rrrrr call_argsextra_main_kwargss r3uploadTransferManager.upload2s6+5Z__&"  K %%j2J2JK **62 $$Z0!#    " "595L5L 1 2$$ +->  r6cUc0nUc/nURX@R5 URU5 [UUUUUS9nSUR0nUR (aUR US'UR U[U5$)a>Downloads a file from S3 :type bucket: str :param bucket: The name of the bucket to download from :type key: str :param key: The name of the key to download from :type fileobj: str or seekable file-like object :param fileobj: The name of a file to download or a seekable file-like object to download. It is recommended to use a filename because file-like objects may result in higher memory usage. :type extra_args: dict :param extra_args: Extra arguments that may be passed to the client operation :type subscribers: list(s3transfer.subscribers.BaseSubscriber) :param subscribers: The list of subscribers to be invoked in the order provided based on the event emit during the process of the transfer request. :rtype: s3transfer.futures.TransferFuture :returns: Transfer future representing the download )rrrrr io_executorr)rrrrr}r~rr )r2rrrrrrrs r3downloadTransferManager.downloadas8  J  K %%j2L2LM **62!#  +D,=,=>  " "595L5L 1 2$$ -/@  r6c >Uc0nUc/nUc URnURX@R5 [U[5(a UR UR S55 UR U5 [UUUUUUS9nURU[5$)aCopies a file in S3 :type copy_source: dict :param copy_source: The name of the source bucket, key name of the source object, and optional version ID of the source object. The dictionary format is: ``{'Bucket': 'bucket', 'Key': 'key', 'VersionId': 'id'}``. Note that the ``VersionId`` key is optional and may be omitted. :type bucket: str :param bucket: The name of the bucket to copy to :type key: str :param key: The name of the key to copy to :type extra_args: dict :param extra_args: Extra arguments that may be passed to the client operation :type subscribers: a list of subscribers :param subscribers: The list of subscribers to be invoked in the order provided based on the event emit during the process of the transfer request. :type source_client: botocore or boto3 Client :param source_client: The client to be used for operation that may happen at the source object. For example, this client is used for the head_object that determines the size of the copy. If no client is provided, the transfer manager's client is used as the client for the source object. :rtype: s3transfer.futures.TransferFuture :returns: Transfer future representing the copy Bucket) copy_sourcerrrr source_client) rurALLOWED_COPY_ARGS isinstancedictrgetrrr )r2rrrrrrrs r3rTransferManager.copysV  J  K   LLM %%j2H2HI k4 ( (  . .{x/H I **62#!#'  $$Y0BCCr6cUc0nUc/nURX0R5 URU5 [UUUUS9nUR U[ 5$)a0Delete an S3 object. :type bucket: str :param bucket: The name of the bucket. :type key: str :param key: The name of the S3 object to delete. :type extra_args: dict :param extra_args: Extra arguments that may be passed to the DeleteObject call. :type subscribers: list :param subscribers: A list of subscribers to be invoked during the process of the transfer request. Note that the ``on_progress`` callback is not invoked during object deletion. :rtype: s3transfer.futures.TransferFuture :return: Transfer future representing the deletion. )rrrr)rALLOWED_DELETE_ARGSrrrr )r2rrrrrs r3deleteTransferManager.deletesh,  J  K %%j2J2JK **62!#  $$Y0DEEr6cUR(aKURR5H,up#URU5nU(dM[ SUS35e gg)Nz'TransferManager methods do not support z+ resource. Use direct client calls instead.) VALIDATE_SUPPORTED_BUCKET_VALUES_UNSUPPORTED_BUCKET_PATTERNSr9matchr:)r2rresourcepatternrs r3r-TransferManager._validate_if_bucket_supportedsc  0 0%)%F%F%L%L%N! f-5$A(LEE&O 1r6c tUH2nX2;dM [SRUSRU555e g)Nz/Invalid extra_args key '{}', must be one of: {}z, )r:formatjoin)r2actualallowedkwargs r3r(TransferManager._validate_all_known_argss;E# ELLtyy1r6cxURRRRS:Xa [ U5 gg)Nwhen_supported)rmetarrequest_checksum_calculationr)r2rs r3r'TransferManager._add_operation_defaults s2 KK   # # @ @  +: 6 r6cU(d0nURU5upE[US5HnUSRU5 M URXC5nURR U"USUS95 U=R S- slU$)Ndone coordinator)transfer_coordinator main_kwargsrt)_get_future_with_componentsradd_done_callback _get_submission_task_main_kwargsr|submitrz)r2rsubmission_task_clsrtransfer_future componentscallbackrs r3r TransferManager._submit_transfers! " '+&F&F ' # &ov>H } % 7 7 A?;;  !!(( %/ %>'   Ar6cURn[US9nURRU5 UR URR U5 [ XS9US.n[S0UD6nXT4$)N) transfer_id)rrrC)rzrryadd_transfer_coordinatorrremove_transfer_coordinatorrr)r2rrrrrs r3r+TransferManager._get_future_with_components4s}&& 2{K $$==  ..  ( ( D D  !D/ )6:6**r6cURURURURUS.nUR U5 U$)N)rrrrequest_executorr)rurvrwr{update)r2rrrs r3r0TransferManager._get_submission_task_main_kwargsIsCllllll $ 6 6.   ,-r6cSnURRRRU[SS9 URRRR U[ SS9 g)Nzrequest-created.s3zs3upload-not-transferring) unique_idzs3upload-transferring)rureventsregister_firstr register_lastr)r2 event_names r3r"TransferManager._register_handlersVsa)    //  #1 0   .. +7N / r6cU$rrCrs r3 __enter__TransferManager.__enter__bs r6cSnSn[nU(a:Sn[U5nU(d [U5n[U[5(a[ nUR XEU5 g)NFT)r strreprrKeyboardInterruptr _shutdown)r2exc_type exc_valueargscancel cancel_msgcancel_exc_types r3__exit__TransferManager.__exit__esS $ FYJ!)_ )%677"0 v?;r6c(URXU5 g)aShutdown the TransferManager It will wait till all transfers complete before it completely shuts down. :type cancel: boolean :param cancel: If True, calls TransferFuture.cancel() for all in-progress in transfers. This is useful if you want the shutdown to happen quicker. :type cancel_msg: str :param cancel_msg: The message to specify if canceling all in-progress transfers. N)r)r2rrs r3shutdownTransferManager.shutdownvs vz2r6cU(aURRX#5 URR5 URR 5 UR R 5 URR 5 g![a URRS5 ef=f!URR 5 UR R 5 URR 5 f=f)NzKeyboardInterrupt())ryrwaitrr|rr{r})r2rrrs r3rTransferManager._shutdowns   ( ( / / E )  ( ( - - /  % % . . 0  " " + + -    & & (!   ( ( / /0E F    % % . . 0  " " + + -    & & (sB'B55B88AD) r~rurvryrzr}rwr{r|)NNN)NNr)Fr)#r>r?r@rAr_ALLOWED_SHARED_ARGSrrrrrrecompilerr4propertyrrrrrrrrrrrrrrrrr rrBrCr6r3rErEs1>     $  $- 0 (,$ BJJ 2 $ @"D- `BF. j=D~"FH 7AE!F+*   <"3"6D)r6rEcJ\rSrSrSr\S5rSrSrS\ 4Sjr Sr S r g ) rxicV[R"5Ul[5Ulg)zAbstraction to control all transfer coordinators This abstraction allows the manager to wait for inprogress transfers to complete and cancel all inprogress transfers. N) threadingLock_lockset_tracked_transfer_coordinatorsrs r3r4&TransferCoordinatorController.__init__s ^^% .1e+r6cUR [R"UR5sSSS5 $!,(df  g=f)z.The set of transfer coordinators being trackedN)rrrrs r3tracked_transfer_coordinators;TransferCoordinatorController.tracked_transfer_coordinatorss)ZZ99T@@A ZZs 7 AcUR URRU5 SSS5 g!,(df  g=f)zAdds a transfer coordinator of a transfer to be canceled if needed :type transfer_coordinator: s3transfer.futures.TransferCoordinator :param transfer_coordinator: The transfer coordinator for the particular transfer N)rraddr2rs r3r6TransferCoordinatorController.add_transfer_coordinators*ZZ  / / 3 34H IZZ 2 AcUR URRU5 SSS5 g!,(df  g=f)aQRemove a transfer coordinator from cancellation consideration Typically, this method is invoked by the transfer coordinator itself to remove its self when it completes its transfer. :type transfer_coordinator: s3transfer.futures.TransferCoordinator :param transfer_coordinator: The transfer coordinator for the particular transfer N)rrremover s r3r9TransferCoordinatorController.remove_transfer_coordinators*ZZ  / / 6 67K LZZr rcLURHnURX5 M g)a Cancels all inprogress transfers This cancels the inprogress transfers by calling cancel() on all tracked transfer coordinators. :param msg: The message to pass on to each transfer coordinator that gets cancelled. :param exc_type: The type of exception to set for the cancellation N)rr)r2msgrrs r3r$TransferCoordinatorController.cancels$%)$F$F ' ' 6%Gr6cSnURHnUR5 M g![a4 [R S5 W(a[R SU5 e[ a gf=f)zWait until there are no more inprogress transfers This will not stop when failures are encountered and not propagate any of these errors from failed transfers, but it can be interrupted with a KeyboardInterrupt. Nz$Received KeyboardInterrupt in wait()z'On KeyboardInterrupt was waiting for %s)rresultrrr Exceptionr s r3r"TransferCoordinatorController.waitsp #' (,(J(J$$++-)K  LL? @$ =(     s%(AA10A1)rrN) r>r?r@rAr4rrrrr rrrBrCr6r3rxrxs:4BBJ Mn 7r6rx)-rloggingrrs3transfer.bandwidthrrs3transfer.constantsrrrrs3transfer.copiesr s3transfer.deleter s3transfer.downloadr s3transfer.exceptionsr r s3transfer.futuresrrrrrrs3transfer.uploadrs3transfer.utilsrrrrrrrr getLoggerr>rrrErxrCr6r3r!s  > 126<3      8 $kk\{){)|SSr6