/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__
Edit: /usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__/utils.cpython-313.pyc (36915B)
j/q X S SK r S SKrS SKrS SKrS SKrS SKrS SKrS SKrS SKrS SK J
r
S SK J r J
r
Jr S SKJrJr S SKJr S SKJrJrJr S SKJr SrS rS
r \R: " \ 5 r \R@ \\
\ \4r!S.S jr"S r#S
r$S r% S/S jr&S r'S r( S0S jr) " S S5 r* " S S5 r+ " S S5 r, " S S5 r- " S S 5 r. " S S 5 r/ " S S 5 r0 " S! S"\15 r2 " S# S$5 r3 " S% S&\35 r4 " S' S(5 r5S) r6S* r7 S S+KJ8r9 S- r8g! \: a S, r9 Nf = f)1 N) defaultdict)IncompleteReadErrorReadTimeoutErrorResponseStreamingError)DEFAULT_CHECKSUM_ALGORITHMAwsChunkedWrapperis_s3express_bucket) SOCKET_ERROR fallocate rename_file)FULL_OBJECT_CHECKSUM_ARGSi' l i P c D SR S [ U 5 5 5 $ )N c 3 j # U H) n[ R " [ R 5 v M+ g 7fN)randomchoicestring hexdigits).0_s C/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/utils.py
(random_file_extension..6 s$ N
ZZ!!"#
KK1 K
ZZs 2A
Ac U R U R S:X a [ S5 eU =R S- sl U R ( a U R S:X a U R 5 SSS5 g! , ( d f g= f)zDecrement the count by oner z,Counter is at zero. It cannot dip below zeror9 N)r r r r r r{ s r decrement CountCallbackInvoker.decrement s]
ZZ{{a "B
KK1 K!!dkkQ&6 ZZs A"A88
Bc U R SU l U R S:X a U R 5 SSS5 g! , ( d f g= f)zFinalize the counter
Once finalized, the counter never be incremented and the callback
can be invoked once the count reaches zero
Tr N)r r r r r{ s r finalize CountCallbackInvoker.finalize s3 ZZ!%D {{a ZZs (>
A )r r r r N) rj rk rl rm r rh propertyr r r r rn rU r r r r s/
# ! !r r c T \ rS rSrSrS rS r SS jrS rS r S r
S
r S r S r
S
rg)OSUtilsi c @ [ R R U5 $ r )ospathgetsizerf filenames r
get_file_sizeOSUtils.get_file_size s wwx((r c , [ R XX4SS9$ )NF)enable_callbacks)
ReadFileChunk
from_filename)rf r
start_byter5 rN s r open_file_chunk_reader OSUtils.open_file_chunk_reader s! ** $E +
r Nc [ UUUUSUS9$ )NF)rN r close_callbacks)r )rf fileobj
chunk_sizefull_file_sizerN r s r #open_file_chunk_reader_from_fileobj+OSUtils.open_file_chunk_reader_from_fileobj
s# " +
r c [ X5 $ r )open)rf r modes r r OSUtils.open s
H##r c R [ R " U5 g! [ a gf = f)z+Remove a file, noop if file does not exist.N)r removeOSErrorr s r remove_fileOSUtils.remove_file! s% IIh s
&&c [ X5 g r )r
)rf current_filename new_filenames r r
OSUtils.rename_file* s $3r c n [ R R U5 ( d g[ R " U5 R n[ R
" U5 ( a g[ R " U5 ( a g[ R " U5 ( a g[ R " U5 ( a gg)zChecks to see if a file is a special UNIX file.
It checks if the file is a character special device, block special
device, FIFO, or socket.
:param filename: Name of the file
:returns: True if the file is a special file. False, if is not.
FT) r r existsstatst_modeS_ISCHRS_ISBLKS_ISFIFOS_ISSOCK)clsr r s r is_special_fileOSUtils.is_special_file- sy ww~~h''wwx (( << << == == r c . [ R [ 5 - n[ R R U5 n[ R R U5 nUS U R [ U5 -
U- n[ R R X55 $ r ) r extsepr r dirnamebasename_MAX_FILENAME_LENlenr )rf r suffixr name
temp_filenames r get_temp_filenameOSUtils.get_temp_filenameJ sn 2 44wwx(ww ) Ct 5 5F CDvM
ww||D00r c U R US5 n[ X25 S S S 5 g ! , ( d f g = f! [ a U R U5 e f = f)Nwb)r r r r )rf r r5 fs r allocateOSUtils.allocateQ sJ 8T*a!" +** X & s : ):
7: : ArU r )rj rk rl rm r r r r r r r
r r r rn rU r r r r s: )
"$4:1r r c l \ rS rSrSS\4S jrS r\S 5 rSS jr S r
SS
jr S r S r
S
rS rSrg)DeferredOpenFileiZ r rbc B Xl SU l X l X0l X@l g)a A class that defers the opening of a file till needed
This is useful for deferring opening of a file till it is needed
in a separate thread, as there is a limit of how many open files
there can be in a single thread for most operating systems. The
file gets opened in the following methods: ``read()``, ``seek()``,
and ``__enter__()``
:type filename: str
:param filename: The name of the file to open
:type start_byte: int
:param start_byte: The byte to seek to when the file is opened.
:type mode: str
:param mode: The mode to use to open the file
:type open_function: function
:param open_function: The function to use to open the file
N) _filename_fileobj _start_byte_mode_open_function)rf r r r
open_functions r rh DeferredOpenFile.__init__[ s! * "
%
+r c U R cb U R U R U R 5 U l U R S:w a& U R R U R 5 g g g Nr )r r r r r seekr{ s r _open_if_needed DeferredOpenFile._open_if_neededv sX == / /
KDM 1$
""4#3#34 % !r c U R $ r )r r{ s r r DeferredOpenFile.name| s ~~ r Nc X U R 5 U R R U5 $ r )r r read)rf amounts r r DeferredOpenFile.read s# }}!!&))r c Z U R 5 U R R U5 g r )r r write)rf datas r r DeferredOpenFile.write s
D!r c Z U R 5 U R R X5 g r )r r r )rf wherewhences r r DeferredOpenFile.seek s
5)r c h U R c U R $ U R R 5 $ r )r r tellr{ s r r DeferredOpenFile.tell s+ == ## #}}!!##r c \ U R ( a U R R 5 g g r )r closer{ s r r DeferredOpenFile.close s == MM ! r c & U R 5 U $ r )r r{ s r __enter__DeferredOpenFile.__enter__ s r c $ U R 5 g r r rf rx r* s r __exit__DeferredOpenFile.__exit__
r )r r r r r r r )rj rk rl rm r rh r r r r r r r r r r rn rU r r r r Z sJ ,-D ,65 *"*$
"r r c \ rS rSr SS jr\ SS j5 rS rSS jrS r S r
S r S
r SS jr
S rS
rS rS rS rS rSrg)r i Nc Xl U R R 5 U l U R U R UU R US9U l SU l X@l Uc / U l XPl X`l Uc X`l gg)a
Given a file object shown below::
|___________________________________________________|
0 | | full_file_size
|----chunk_size---|
f.tell()
:type fileobj: file
:param fileobj: File like object
:type chunk_size: int
:param chunk_size: The max chunk size to read. Trying to read
pass the end of the chunk size will behave like you've
reached the end of the file.
:type full_file_size: int
:param full_file_size: The entire content length associated
with ``fileobj``.
:type callbacks: A list of function(amount_read)
:param callbacks: Called whenever data is read from this object in the
order provided.
:type enable_callbacks: boolean
:param enable_callbacks: True if to run callbacks. Otherwise, do not
run callbacks
:type close_callbacks: A list of function()
:param close_callbacks: Called when close is called. The function
should take no arguments.
)requested_sizer actual_file_sizer N) r r r _calculate_file_size_size _amount_read
_callbacks_callbacks_enabled_close_callbacks)rf r r r rN r r s r rh ReadFileChunk.__init__ s T
==--/.. MM%'' + /
# DO"2 / "$3 ! #r c [ US5 nUR U5 [ R " UR 5 5 R
nU " XcXtU5 $ )a Convenience factory function to create from a filename.
:type start_byte: int
:param start_byte: The first byte from which to start reading.
:type chunk_size: int
:param chunk_size: The max chunk size to read. Trying to read
pass the end of the chunk size will behave like you've
reached the end of the file.
:type full_file_size: int
:param full_file_size: The entire content length associated
with ``fileobj``.
:type callbacks: function(amount_read)
:param callbacks: Called whenever data is read from this object.
:type enable_callbacks: bool
:param enable_callbacks: Indicate whether to invoke callback
during read() calls.
:rtype: ``ReadFileChunk``
:return: A new instance of ``ReadFileChunk``
r )r r r fstatfilenost_size)r r r r rN r r file_sizes r r ReadFileChunk.from_filename sG D
4 zHHQXXZ(00 1)8HIIr c XC-
n[ XR5 $ r )min)rf r r r r max_chunk_sizes r r "ReadFileChunk._calculate_file_size s *6>22r c Z [ U R U R -
S5 nUc UnO [ X!5 nU R R U5 nU =R [
U5 -
sl U R b0 U R ( a [ U R [
U5 5 U$ r )
maxr r r r r r r r rW )rf r amount_leftamount_to_readr s r r ReadFileChunk.read s $**t'8'88!< > (N 5N}}!!.1 SY& ?? &4+B+B %doos4y A r c U R 5 [ U R S5 ( a U R R 5 g g )Nr- )enable_callbackr& r r- r{ s r r- !ReadFileChunk.signal_transferring s5 4=="7 8 8 MM - - / 9r c U R 5 [ U R S5 ( a U R R 5 g g )Nr% )disable_callbackr& r r% r{ s r r% %ReadFileChunk.signal_not_transferring s5 4=="; < < MM 1 1 3 =r c SU l g NTr r{ s r r( ReadFileChunk.enable_callback s
"& r c SU l g )NFr/ r{ s r r+ ReadFileChunk.disable_callback! s
"' r c 6 US; a [ SU S35 eXR -
nUS:X a XR -
nOUS:X a XR -
nU R R [
XR 5 5 U R bu U R ( ad [
[ XR -
U R 5 S5 n[ U R U R 5 nX4-
n[ U R US9 [
XR -
S5 U l g )N)r r9 zinvalid whence (z, should be 0, 1 or 2)r9 r4 r rS )
ValueErrorr r r r r r# r r r rW )rf r r
bounded_wherebounded_amount_readr s r r ReadFileChunk.seek$ s " /x7M NO O !!! Q; && &E
q[ ZZ E
3u&6&678 ?? &4+B+B E,<,<$ r r rF rn rU r r r r ss ;4z
$J $JL3
0
4
'(=0 !r r c ( \ rS rSrSrSS jrS rSrg)StreamReaderProgressi\ z r )r rL r )rj rk rl rm r rh r rn rU r r rJ rJ \ s F! r rJ c \ rS rSrSrg)NoResourcesAvailableik rU N)rj rk rl rm rn rU r r rR rR k s r rR c * \ rS rSrS rSS jrS rSrg)
TaskSemaphoreio c : [ R " U5 U l g)zaA semaphore for the purpose of limiting the number of tasks
:param count: The size of semaphore
N)r Semaphore
_semaphorerf counts r rh TaskSemaphore.__init__p s
$--e4r c [ R SU5 U R R U5 ( d [ SU S35 eg)a Acquire the semaphore
:param tag: A tag identifying what is acquiring the semaphore. Note
that this is not really needed to directly use this class but is
needed for API compatibility with the SlidingWindowSemaphore
implementation.
:param block: If True, block until it can be acquired. If False,
do not block and raise an exception if cannot be acquired.
:returns: A token (can be None) to use when releasing the semaphore
Acquiring %sCannot acquire tag ''N)loggerdebugrW acquirerR )rf tagblockings r ra TaskSemaphore.acquirew sA ^S)&&x00&)=cU!'DE E 1r c n [ R SU SU 35 U R R 5 g)aD Release the semaphore
:param tag: A tag identifying what is releasing the semaphore
:param acquire_token: The token returned from when the semaphore was
acquired. Note that this is not really needed to directly use this
class but is needed for API compatibility with the
SlidingWindowSemaphore implementation.
zReleasing acquire /N)r_ r` rW release)rf rb
acquire_tokens r rg TaskSemaphore.release s. )#a
?@ !r )rW NT)rj rk rl rm rh ra rg rn rU r r rT rT o s 5F
"r rT c 4 \ rS rSrSrS rS rS S jrS rSr g)
SlidingWindowSemaphorei a A semaphore used to coordinate sequential resource access.
This class is similar to the stdlib BoundedSemaphore:
* It's initialized with a count.
* Each call to ``acquire()`` decrements the counter.
* If the count is at zero, then ``acquire()`` will either block until the
count increases, or if ``blocking=False``, then it will raise
a NoResourcesAvailable exception indicating that it failed to acquire the
semaphore.
The main difference is that this semaphore is used to limit
access to a resource that requires sequential access. For example,
if I want to access resource R that has 20 subresources R_0 - R_19,
this semaphore can also enforce that you only have a max range of
10 at any given point in time. You must also specify a tag name
when you acquire the semaphore. The sliding window semantics apply
on a per tag basis. The internal count will only be incremented
when the minimum sequence number for a tag is released.
c Xl [ [ 5 U l 0 U l [
R " 5 U l [
R " U R 5 U l 0 U l
g r ) r r r1 _tag_sequences_lowest_sequencer r r Condition
_condition_pending_releaserX s r rh SlidingWindowSemaphore.__init__ sH )# . " ^^%
#--djj9 " r c h U R U R sS S S 5 $ ! , ( d f g = fr r r{ s r r $SlidingWindowSemaphore.current_count s
ZZ;; ZZr c < [ R SU5 U R R 5 U R S:X aR U( d [ SU S35 eU R S:X a, U R R
5 U R S:X a M, U R U nUS:X a X0R U' U R U== S-
ss' U =R S- sl UU R R 5 $ ! U R R 5 f = f)Nr\ r r] r^ r9 )
r_ r` rq ra r rR waitrn ro rg )rf rb rc sequence_numbers r ra SlidingWindowSemaphore.acquire s ^S) ! &{{a .1EcU!/LMM ++* ,,. ++* # 1 1# 6O !#-<%%c* $ ) $ KK1 K" OO # # %DOO # # %s A C? AC? ? Dc Un[ R SX5 U R R 5 XR ; a [ SU 35 eU R U nU R U U:X a U R U== S-
ss' U =R S-
sl U R R 5 U R R U/ 5 nU( a] U R U US :X a= UR 5 U R U== S-
ss' U =R S-
sl OOU( a M] OvU R U Us=: a U: aK O OHU R R U/ 5 R U5 U R U R SS9 O[ SU SU 35 eU R R 5 g ! U R R 5 f = f) NzReleasing acquire %s/%sz"Attempted to release unknown tag: r9 T)reversez-Attempted to release unknown sequence number z
for tag: )r_ r` rq ra rn r5 ro r notifyrr getpop
setdefaultrI sortrg )rf rb rh rx max_sequencequeueds r rg SlidingWindowSemaphore.release s ' .E ! &--- #EcU!KLL ..s3L$$S)_< %%c*a/* q &&( ..223; ,,S1VBZ?
--c2a72 q(
f &&s+oL L %%00b9@@# %%c*///= C&'z#8
OO # # %DOO # # %s DG 9A7G G')rq r r ro rr rn Nrj )
rj rk rl rm r rh r ra rg rn rU r r rl rl s ,# &,$&r rl c : \ rS rSr\\\4S jrSS jrS r S r
Sr g) ChunksizeAdjusteri c ( Xl X l X0l g r )max_sizemin_size max_parts)rf r r r s r rh ChunksizeAdjuster.__init__ s !
"r Nc P UnUb U R X25 nU R U5 $ )az Get a chunksize close to current that fits within all S3 limits.
:type current_chunksize: int
:param current_chunksize: The currently configured chunksize.
:type file_size: int or None
:param file_size: The size of the file to upload. This might be None
if the object being transferred has an unknown size.
:returns: A valid chunksize that fits within configured limits.
)_adjust_for_max_parts _adjust_for_chunksize_limits)rf current_chunksizer chunksizes r adjust_chunksize"ChunksizeAdjuster.adjust_chunksize s0 & 229HI00;;r c
XR : a2 [ R SU R SU S35 U R $ XR : a2 [ R SU R SU S35 U R $ U$ )Nz5Chunksize greater than maximum chunksize. Setting to from .z2Chunksize less than minimum chunksize. Setting to )r r_ r` r )rf r s r r .ChunksizeAdjuster._adjust_for_chunksize_limits s }} , LL "mm_F3D2EQH
==
. LL "mm_F3D2EQH
== $ $r c B Un[ [ R " U[ U5 - 5 5 nX@R : aA US- n[ [ R " U[ U5 - 5 5 nX@R : a MA X1:w a [
R
SU SU S35 U$ )Nr4 zPChunksize would result in the number of parts exceeding the maximum. Setting to r r )r1 r2 r3 r4 r r_ r` )rf r r r r= s r r 'ChunksizeAdjuster._adjust_for_max_parts" s % )eI.>">?@ ..( NIDIIi% 2B&B CDI ..( ) LL''0k8I7J!M
r )r r r r ) rj rk rl rm MAX_SINGLE_UPLOAD_SIZEMIN_UPLOAD_CHUNKSIZE MAX_PARTSrh r r r rn rU r r r r s! (% #<"% r r c > [ U 5 ( a
SU; a SUS' ggg)z
This function has been deprecated, but is kept for backwards compatibility.
This function is subject to removal in a future release.
ChecksumAlgorithmcrc32Nr )bucket
extra_argss r add_s3express_defaultsr 3 s+
6""':*'L*1
&' (M"r c p ^ [ U 4S j[ 5 5 ( a gT R S[ 5 g)z@Set the default algorithm to CRC32 if not specified by the user.c 3 , ># U H oT; v M g 7fr rU )r checksumr s r r 1set_default_checksum_algorithm..? s
L2Khz !2Ks Nr )anyr r r )r s `r set_default_checksum_algorithmr = s*
L2K
LLL-/IJr )create_nested_clientc & U R " U0 UD6$ r
create_client)sessionrx r* s r r r K s $$d5f55r c [ X40 UD6$ r r )r service_namer* s r r r O s 9& 99r ) r )NN);rJ loggingr2 r r socketr r r collectionsr botocore.exceptionsr r r botocore.httpchecksumr r botocore.utilsr
s3transfer.compatr r r
s3transfer.constantsr r r r getLoggerrj r_ timeout S3_RETRYABLE_DOWNLOAD_ERRORSr r% r- r7 rB rQ rW r` rb rp r r r r rJ ExceptionrR rT rl r r r r r ImportErrorrU r r r sd
#
P . B B : ' $ 8 $ NN O/'3
26<:
:" <@2 & &7 7&/! /!dU Up@ @F| |~ 9 "" ""J_&] _&D: :z2K6D:
666s D D)(D)