/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__
Edit: /usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__/bandwidth.cpython-313.pyc (17966B)
j< S SK r S SKr " S S\5 r " S S5 r " S S5 r " S S 5 r " S
S 5 r " S S
5 r " S S5 r " S S5 r
g) Nc ( ^ \ rS rSrU 4S jrSrU =r$ )RequestExceededException c L > Xl X l SU SU 3n[ TU ]
U5 g)a` Error when requested amount exceeds what is allowed
The request that raised this error should be retried after waiting
the time specified by ``retry_time``.
:type requested_amt: int
:param requested_amt: The originally requested byte amount
:type retry_time: float
:param retry_time: The length in time to wait to retry for the
requested amount
zRequest amount z) exceeded the amount available. Retry in N)
requested_amt
retry_timesuper__init__)selfr r msg __class__s G/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/bandwidth.pyr
!RequestExceededException.__init__ s2 +$
.WXbWcd
r r )__name__
__module__ __qualname____firstlineno__r
__static_attributes__
__classcell__)r
s @r r r s
r r c \ rS rSrSrSrg) RequestToken% zDA token to pass as an identifier when consuming from the LeakyBucket N)r r r r __doc__r r r r r r % s Nr r c \ rS rSrS rS rSrg) TimeUtils+ c , [ R " 5 $ )zOGet the current time back
:rtype: float
:returns: The current time in seconds
)timer s r r! TimeUtils.time, s yy{r c . [ R " U5 $ )z_Sleep for a designated time
:type value: float
:param value: The time to sleep for in seconds
)r! sleep)r values r r% TimeUtils.sleep4 s zz% r r N)r r r r r! r% r r r r r r + s !r r c * \ rS rSrSS jr SS jrSrg)BandwidthLimiter= Nc B Xl X l Uc [ 5 U l gg)zLimits bandwidth for shared S3 transfers
:type leaky_bucket: LeakyBucket
:param leaky_bucket: The leaky bucket to use limit bandwidth
:type time_utils: TimeUtils
:param time_utils: Time utility to use for interacting with time.
N)
_leaky_bucket _time_utilsr )r leaky_bucket
time_utilss r r
BandwidthLimiter.__init__> s% *% ({D r c t [ XR X R 5 nU( d UR 5 U$ )a Wraps a fileobj in a bandwidth limited stream wrapper
:type fileobj: file-like obj
:param fileobj: The file-like obj to wrap
:type transfer_coordinator: s3transfer.futures.TransferCoordinator
param transfer_coordinator: The coordinator for the general transfer
that the wrapped stream is a part of
:type enabled: boolean
:param enabled: Whether bandwidth limiting should be enabled to start
)BandwidthLimitedStreamr, r- disable_bandwidth_limiting)r fileobjtransfer_coordinatorenabledstreams r get_bandwith_limited_stream,BandwidthLimiter.get_bandwith_limited_streamL s6 ( '')=?O?O
- - /
r )r, r- N)T)r r r r r
r8 r r r r r) r) = s + 6:r r) c h \ rS rSr SS jrS rS rS rS rS r S r
SS
jr S r S r
S
rS rSrg)r2 c Nc Xl X l X0l X@l Uc [ 5 U l SU l [
5 U l SU l XPl g)a Limits bandwidth for reads on a wrapped stream
:type fileobj: file-like object
:param fileobj: The file like object to wrap
:type leaky_bucket: LeakyBucket
:param leaky_bucket: The leaky bucket to use to throttle reads on
the stream
:type transfer_coordinator: s3transfer.futures.TransferCoordinator
param transfer_coordinator: The coordinator for the general transfer
that the wrapped stream is a part of
:type time_utils: TimeUtils
:param time_utils: The time utility to use for interacting with time
NTr )
_fileobjr, _transfer_coordinatorr- r _bandwidth_limiting_enabledr _request_token _bytes_seen_bytes_threshold)r r4 r. r5 r/ bytes_thresholds r r
BandwidthLimitedStream.__init__d sK 0
)%9"% ({D +/( *n / r c SU l g)z0Enable bandwidth limiting on reads to the streamTNr@ r" s r enable_bandwidth_limiting0BandwidthLimitedStream.enable_bandwidth_limiting s
+/(r c SU l g)z1Disable bandwidth limiting on reads to the streamFNrG r" s r r3 1BandwidthLimitedStream.disable_bandwidth_limiting s
+0(r c D U R ( d U R R U5 $ U =R U-
sl U R U R : a U R R U5 $ U R 5 U R R U5 $ )zXRead a specified amount
Reads will only be throttled if bandwidth limiting is enabled.
)r@ r> readrB rC _consume_through_leaky_bucket)r amounts r rM BandwidthLimitedStream.read s
//==%%f- -
F" d 3 3 3==%%f- - **,}}!!&))r c U R R ( d9 U R R U R U R
5 SU l g U R R e! [ a/ nU R R UR 5 S nAOS nAff = fU R R ( d M Np)Nr )
r? exceptionr, consumerB rA r r- r% r )r es r rN 4BandwidthLimitedStream._consume_through_leaky_bucket s ,,66
5""**$$d&9&9 $% ,,66 6 ,
5 &&q||44
5 ,,666s 7A+ +
B$5%B B$c $ U R 5 g)z6Signal that data being read is being transferred to S3N)rH r" s r signal_transferring*BandwidthLimitedStream.signal_transferring s &&(r c $ U R 5 g)z:Signal that data being read is not being transferred to S3N)r3 r" s r signal_not_transferring.BandwidthLimitedStream.signal_not_transferring s '')r c : U R R X5 g r: )r> seek)r wherewhences r r] BandwidthLimitedStream.seek s
5)r c 6 U R R 5 $ r: )r> tellr" s r rb BandwidthLimitedStream.tell s }}!!##r c U R ( a! U R ( a U R 5 U R R 5 g r: )r@ rB rN r> closer" s r re BandwidthLimitedStream.close s1 + +0@0@
. . 0
r c U $ r: r r" s r __enter__ BandwidthLimitedStream.__enter__ s r c $ U R 5 g r: )re )r argskwargss r __exit__ BandwidthLimitedStream.__exit__ s
r )r@ rB rC r> r, rA r- r? )Ni )r )r r r r r
rH r3 rM rN rW rZ r] rb re rh rm r r r r r2 r2 c sG "
!0F01*(7$)**$ r r2 c B \ rS rSr S
S jrS rS rS rS rS r S r
g) LeakyBucket Nc [ U5 U l X l Uc [ 5 U l [ R
" 5 U l X0l Uc [ 5 U l X@l Uc [ 5 U l gg)a A leaky bucket abstraction to limit bandwidth consumption
:type rate: int
:type rate: The maximum rate to allow. This rate is in terms of
bytes per second.
:type time_utils: TimeUtils
:param time_utils: The time utility to use for interacting with time
:type rate_tracker: BandwidthRateTracker
:param rate_tracker: Tracks bandwidth consumption
:type consumption_scheduler: ConsumptionScheduler
:param consumption_scheduler: Schedules consumption retries when
necessary
N) float _max_rater- r threadingLock_lock
_rate_trackerBandwidthRateTracker_consumption_schedulerConsumptionScheduler)r max_rater/ rate_trackerconsumption_schedulers r r
LeakyBucket.__init__ sf . x % ({D ^^%
) !5!7D &;# (*>*@D ' )r c U R U R R 5 nU R R U5 ( a U R XU5 sSSS5 $ U R
X5 ( a U R XU5 OU R X5 sSSS5 $ SSS5 g! , ( d f g= f)a Consume an a requested amount
:type amt: int
:param amt: The amount of bytes to request to consume
:type request_token: RequestToken
:param request_token: The token associated to the consumption
request that is used to identify the request. So if a
RequestExceededException is raised the token should be used
in subsequent retry consume() request.
:raises RequestExceededException: If the consumption amount would
exceed the maximum allocated bandwidth
:rtype: int
:returns: The amount consumed
N) rw r- r! rz is_scheduled,_release_requested_amt_for_scheduled_request _projected_to_exceed_max_rate!_raise_request_exceeded_exception_release_requested_amtr amt
request_tokentime_nows r rS LeakyBucket.consume s $ ZZ'',,.H**77
FFHH Z 33CBB66 223A Z ZZs A B0#9B00
B>c T U R R X5 nX0R : $ r: )rx get_projected_ratert )r r r projected_rates r r )LeakyBucket._projected_to_exceed_max_rate s% ++>>sM ..r c Z U R R U5 U R X5 $ r: )rz process_scheduled_consumptionr r s r r 8LeakyBucket._release_requested_amt_for_scheduled_request s.
##AA
**399r c | U[ U R 5 - nU R R XU5 n[ XS9e)Nr )rs rt rz schedule_consumptionr )r r r r allocated_timer s r r -LeakyBucket._raise_request_exceeded_exception# sB uT^^ 4400EE
'
r c < U R R X5 U$ r: )rx record_consumption_rate)r r r s r r "LeakyBucket._release_requested_amt, s 223A
r )rz rw rt rx r- )NNN) r r r r r
rS r r r r r r r r rp rp s. " !AF B>/:
r rp c , \ rS rSrS rS rS rS rSrg)r{ i1 c 0 U l SU l g)z*Schedules when to consume a desired amountr N _tokens_to_scheduled_consumption _total_waitr" s r r
ConsumptionScheduler.__init__2 s 02- r c XR ; $ )zIndicates if a consumption request has been scheduled
:type token: RequestToken
:param token: The token associated to the consumption
request that is used to identify the request.
)r )r tokens r r !ConsumptionScheduler.is_scheduled7 s ====r c | U =R U-
sl U R US.U R U' U R $ )aL Schedules a wait time to be able to consume an amount
:type amt: int
:param amt: The amount of bytes scheduled to be consumed
:type token: RequestToken
:param token: The token associated to the consumption
request that is used to identify the request.
:type time_to_consume: float
:param time_to_consume: The desired time it should take for that
specific request amount to be consumed in regardless of previously
scheduled consumption requests
:rtype: float
:returns: The amount of time to wait for the specific request before
actually consuming the specified amount.
)
wait_durationtime_to_consume)r r )r r r r s r r )ConsumptionScheduler.schedule_consumption@ sA &
O+ ! - - .8
--e4 r c | U R R U5 n[ U R US -
S5 U l g)zProcesses a scheduled consumption request that has completed
:type token: RequestToken
:param token: The token associated to the consumption
request that is used to identify the request.
r r N)r popmaxr )r r scheduled_retrys r r 2ConsumptionScheduler.process_scheduled_consumptionZ s= ??CCEJ /@ A A1
r r N) r r r r r
r r r r r r r r{ r{ 1 s
> 4
r r{ c F \ rS rSrS
S jr\S 5 rS rS rS r S r
Sr g ) ry ig c , Xl SU l SU l g)aZ Tracks the rate of bandwidth consumption
:type a: float
:param a: The constant to use in calculating the exponentional moving
average of the bandwidth rate. Specifically it is used in the
following calculation:
current_rate = alpha * new_rate + (1 - alpha) * current_rate
This value of this constant should be between 0 and 1.
N)_alpha
_last_time
_current_rate)r alphas r r
BandwidthRateTracker.__init__h s !r c 6 U R c gU R $ )zUThe current transfer rate
:rtype: float
:returns: The current tracked transfer rate
)r r r" s r current_rate!BandwidthRateTracker.current_ratex s ?? "!!!r c @ U R c gU R X5 $ )a" Get the projected rate using a provided amount and time
:type amt: int
:param amt: The proposed amount to consume
:type time_at_consumption: float
:param time_at_consumption: The proposed time to consume at
:rtype: float
:returns: The consumption rate if that amt and time were consumed
r )r *_calculate_exponential_moving_average_rater r time_at_consumptions r r 'BandwidthRateTracker.get_projected_rate s' ?? ">>
r c r U R c X l SU l gU R X5 U l X l g)zRecord the consumption rate based off amount and time point
:type amt: int
:param amt: The amount that got consumed
:type time_at_consumption: float
:param time_at_consumption: The time at which the amount was consumed
Nr )r r r r s r r ,BandwidthRateTracker.record_consumption_rate s; ?? " 1O!$D ! L L
.r c H X R -
nUS:: a [ S5 $ X- $ )Nr inf)r rs )r r r
time_deltas r _calculate_rate$BandwidthRateTracker._calculate_rate s* (??:
?
< !!r c | U R X5 nU R U- SU R -
U R - - $ )N )r r r )r r r new_rates r r ?BandwidthRateTracker._calculate_exponential_moving_average_rate s; ''A{{X%T[[ D
r sk y ( ! !$# #Ln nbZ Zz3
3
lNO NOr