֦iH d Z ddgZddlmZ ddlZddlZddlZddlZddlZddl Z ej dk( rddl Z dZ nddl
Z
dZ d d
lmZ ej ej" z Zd Ze rd Znd
Zd Z G d d ZdZ G d d Zy)zProvides shared memory for direct access across processes.
The API of this package is currently provisional. Refer to the
documentation for details.
SharedMemory
ShareableList )partialNntFT )resource_tracker z/psm_wnsm_c t t t z
dz } | dk\ sJ d t t j | z }t | t k sJ |S )z6Create a random filename for the shared memory object. z_SHM_NAME_PREFIX too long)_SHM_SAFE_NAME_LENGTHlen_SHM_NAME_PREFIXsecrets token_hex)nbytesnames 6/usr/lib64/python3.12/multiprocessing/shared_memory.py_make_filenamer ( sX $c*:&;;
AF Q;333; g / / 7 7D t9- -- - K c e Zd ZdZdZdZdZdZej Z
dZ e rdndZ
ddZd Zd Zd
Zed Zed Zed
Zd Zd Zy)r a Creates a new shared memory block or attaches to an existing
shared memory block.
Every shared memory block is assigned a unique name. This enables
one process to create a shared memory block with a particular name
so that a different process can attach to that same shared memory
block using that same name.
As a resource for sharing data across processes, shared memory blocks
may outlive the original process that created them. When one process
no longer needs access to a shared memory block that might still be
needed by other processes, the close() method should be called.
When a shared memory block is no longer needed by any process, the
unlink() method should be called to ensure proper cleanup.Ni TFc |dk\ s t d |r,t t j z | _ |dk( r t d |(| j t j
z s t d t r)|E t } t j || j | j | _ || _
nK| j rd|z n|}t j || j | j | _ || _
|r"|r t j | j | t j | j }|j" }t% j$ | j | | _ t- j. | j d n|r" |
t n|}t1 j2 t0 j4 t0 j6 t0 j8 |dz d z |d z | } t1 j: }|t0 j< k( rd|Kt t> j@ t jB t> j@ |t0 j< t1 jD | t% j$ d
|| | _ t1 jD | || _
n|| _
t1 jF t0 jH d | } t1 jJ |t0 jH ddd }t1 jD | t1 jL | }t1 jN | t% j$ d
|| | _ || _( tS | j& | _* y # t $ r Y +w xY w# t( $ r | j+ w xY w# t1 jD | w xY w# t1 jD | w xY w# t1 jN | w xY w)
Nr z!'size' must be a positive integerz4'size' must be a positive number different from zeroz&'name' can only be None if create=True)mode/
shared_memory l r )tagnameF)+
ValueError_O_CREXosO_RDWR_flagsO_EXCL
_USE_POSIXr _posixshmemshm_open_mode_fdFileExistsError_name_prepend_leading_slash ftruncatefstatst_sizemmap_mmapOSErrorunlinkr register_winapiCreateFileMappingINVALID_HANDLE_VALUENULLPAGE_READWRITE GetLastErrorERROR_ALREADY_EXISTSerrnoEEXISTstrerror CloseHandleOpenFileMapping
FILE_MAP_READ
MapViewOfFileVirtualQuerySizeUnmapViewOfFile_size
memoryview_buf) selfr createsizestats temp_nameh_maplast_error_codep_bufs r __init__zSharedMemory.__init__K sO qy @A A !BII-DKqy !WXX < bii 7 EF F |)+D!#.#7#7 KK!%$ "&DJ%)%@%@sTzd&//KK
"
dLL40* }} !YYtxx 6
% %djj/ B 48L 0dI $ 5 5 44 .. z1 z)!
E3*1*>*>*@*g.J.JJ # /&5$)LL$&KK $=$($+$@$@ '" !" !) ++E2 &*YYr4%K
++E2!*DJ "
//))
/ # 1 1 -- E ''.3"33E:D++E2 !YYr4 >
tzz* k + ! !$
J ++E2, ''. ++E2sJ >1N A4N! 9A4N? N? +'O (O3 N N !N<?OO03P
c D | j y # t $ r Y y w xY wN)closer2 rH s r __del__zSharedMemory.__del__ s" JJL s c L | j | j d| j ffS )NF) __class__r rJ rT s r
__reduce__zSharedMemory.__reduce__ s) NN
r c h | j j d| j d| j dS )N(z, size=))rW __name__r rJ rT s r __repr__zSharedMemory.__repr__ s. ..))*!DII= {!LLr c | j S )z4A memoryview of contents of the shared memory block.)rG rT s r bufzSharedMemory.buf s yyr c | j }t r6| j r*| j j d r| j dd }|S )z4Unique name that identifies the shared memory block.r r N)r+ r% r,
startswith)rH
reported_names r r zSharedMemory.name s?
$55zz$$S) $
12
r c | j S )zSize in bytes.)rE rT s r rJ zSharedMemory.size s zzr c 2 | j !| j j d| _ | j !| j j d| _ t r7| j
dk\ r't
j | j
d| _ yyy)zkCloses access to the shared memory from this instance but does
not destroy the shared memory block.Nr r )rG releaser1 rS r% r) r! rT s r rS zSharedMemory.close sq 99 II DI :: ! JJ DJ $((a- HHTXX DH (:r c t rM| j r@t j | j t j
| j d yyy)zRequests that the underlying shared memory block be destroyed.
In order to ensure proper cleanup of resources, unlink should be
called once (and only once) across all processes which have access
to the shared memory block.r N)r% r+ r&
shm_unlinkr
unregisterrT s r r3 zSharedMemory.unlink s: $** " "4:: . ' '
O D %:r )NFr )r\
__module__ __qualname____doc__r+ r) r1 rG r! r" r# r( r% r, rP rU rX r] propertyr_ r rJ rS r3 r r r r 2 s
B
E
C E D
YYF E%/TUl+\
M Er utf8c H e Zd ZdZedededededdj diZ
dZ d d
d d d
Z e
d Zd"dddZd Zd Zd Zd Zd Zd Zd Zd Zed Zed Zed Zed Z ed Z ed Z ed Z d Z d! Z! e"e#jH Z%y)#r a Pattern for a mutable list-like object shareable via a shared
memory block. It differs from the built-in list type in that these
lists can not change their overall length (i.e. no append, insert,
etc.)
Because values are packed into a memoryview as bytes, the struct
packing format for any storable value must require no more than 8
characters to describe its format.qdzxxxxxxx?z%dsNzxxxxxx?x c | S rR rm values r zShareableList. s r c J | j d j t S N )rstripdecode _encodingrt s r rv zShareableList. s g.55i@r c $ | j d S rx )rz rt s r rv zShareableList. s
g.r c y rR rm )_values r rv zShareableList. s $r )r r r c t | t t dj f syt | t ryt | t ryy)zUsed in concert with _back_transforms_mapping to convert values
into the appropriate Python objects when retrieving them from
the list as well as when storing them.Nr r r r )
isinstancestrbytesrW rt s r _extract_recreation_codez&ShareableList._extract_recreation_code s9
%#udnn!=>
s
#
u
%r r c R |||xs d}|D cg c]r }t |t t f s| j t | nA| j t | | j
t
| | j
z dz z fz t }}t
| | _ t d |D | j k( sJ d}dg| _ |D ]B }||d dk7 r | j
n
t |d d z
}| j j | D |D cg c] }| j | }}t j d| j z dj! | z | j" z | j$ z }t' |d |
| _ nt' | | _ |,t* t j, d| j z | j( j. d| j g| j t j, dj! | j( j. | j0 g fd |D t j, | j" | j( j. | j2 g fd |D t j, | j$ | j( j. | j4 g y t
| | _ t7 t j8 | j | j( j. d
| _ y c c}w c c}w )Nrm r c 3 8 K | ] }t | d k yw)rr N)r ).0fmts r z)ShareableList.__init__..6 s 9s3x1}s r r srp T)rI rJ c 3 d K | ]' }t |t r|j n| ) y wrR )r r encoder v_encs r r z)ShareableList.__init__..Z s( Px!Jq#$6!((4.A=xs -0c 3 @ K | ] }|j y wrR )r r s r r z)ShareableList.__init__..` s 3(Q!((4.( rr ) r r r _types_mappingtype
_alignmentr _list_lensum_allocated_offsetsintappendr structcalcsize_format_size_metainfojoin_format_packing_metainfo _format_back_transform_codesr shmr| pack_intor_ _offset_data_start_offset_packing_formats _offset_back_transform_codeslist unpack_from)
rH sequencer item_formatsoffsetr _recreation_codesrequested_sizer s
@r rP zShareableList.__init__* s <8/ ~2H %
%D &dS%L9 ##DJ/ ,,T$Z8 3t9+G!+KL<
%
!]DN999T^^K KKF ()cD # SW^$//S"X N''..v6 AI!@H--d3
! $__d000!"--. 112 N $DNKDH#D)DH D d000
))
! ''
QxP
-- ,,
4(3
11 11
$
!YDN&*""..HHLL'D #}$!s A7L L$c L |dk\ r|n|| j z }|| j k\ s| j dk r t d t j d| j j
| j |dz z d }|j d }|j t }|S )z>Gets the packing format for a single value stored in the list.r Requested position out of range.8srr ry )
r
IndexErrorr r r r_ r rz r{ r| )rH positionr r
fmt_as_strs r _get_packing_formatz!ShareableList._get_packing_formats s '1}8(T^^2K &DNNQ,> ?@ @ HHLL ( (8a< 7
hhw ZZ *
r c || j k\ s| j dk r t d t j d| j j
| j |z d }| j | }|S )z9Gets the back transformation function for a single value.r r b)r r r r r r_ r _back_transforms_mapping)rH r transform_codetransform_functions r _get_back_transformz!ShareableList._get_back_transform sv
&DNNQ,> ?@ @ ++ HHLL - - 8
" : :> J!!r c || j k\ s| j dk r t d t j d| j j
| j |dz z |j t | j | }t j d| j j
| j |z | y)zvSets the packing format and back transformation code for a
single value in the list at the specified position.r r r rr r N) r r r r r r_ r r r| r r )rH r r ru r s r !_set_packing_format_and_transformz/ShareableList._set_packing_format_and_transform s
&DNNQ,> ?@ @ HHLL ( (8a< 7 i (
66u= HHLL - - 8
r c F |dk\ r|n|| j z } | j | j | z }t j | j | | j j | \ }| j | } || }|S # t $ r t d w xY w)Nr zindex out of range)
r r r r r r r r_ r r )rH r r r back_transforms r __getitem__zShareableList.__getitem__ s '1}8(T^^2K 3,,t/F/Fx/PPF%%((2 DQ 11(; 1
3 12 2 3s AB B c |dk\ r|n|| j z } | j | }| j |z }| j | }t |t t f s| j t | }|}nw| j |dz |z
}t |t r|j t n|}t | |kD r t d |d dk( r|}n| j t |fz }| j ||| t j || j" j$ || y # t $ r t d w xY w)Nr z assignment index out of ranger z(bytes/str item exceeds available storager r )r r r r r r r r r r r r| r r r r r r r_ ) rH r ru item_offsetr current_format
new_format
encoded_valueallocated_lengths r __setitem__zShareableList.__setitem__ sO '1}8(T^^2K > 11(;K,,{:F ! 5 5h ?N %#u . ,,T%[9J !M # 6 6x!| D{ R !+5# 6 #\\) 4 <= = >s /D/ /Ec \ t | j | j j dfS )Nr rm )r rW r r rT s r rX zShareableList.__reduce__ s t~~DHHMM:B>>r c ^ t j d| j j d d S )Nrp r )r r r r_ rT s r __len__zShareableList.__len__ s$ !!#txx||Q7::r c z | j j dt | d| j j dS )NrZ z, name=r[ )rW r\ r r r rT s r r] zShareableList.__repr__ s3 ..))*!DJOqQQr c ^ dj fdt j D S )z=The struct packing format used by all currently stored items.r c 3 @ K | ] }j | y wrR )r )r irH s r r z'ShareableList.format.. s!
1FAD $ $Q '1Fr )r ranger rT s `r formatzShareableList.format s, ww
16t~~1F
r c & d| j dz z S )z>The struct packing format used for the items' storage offsets.rp r r rT s r r z#ShareableList._format_size_metainfo s dnnq())r c d| j z S )z>The struct packing format used for the items' packing formats.r r rT s r r z&ShareableList._format_packing_metainfo s dnn$$r c d| j z S )z>The struct packing format used for the items' back transforms.r r rT s r r z*ShareableList._format_back_transform_codes s T^^##r c & | j dz dz S )Nr rr r rT s r r z ShareableList._offset_data_start s "a''r c : | j | j d z S )Nr )r r rT s r r z%ShareableList._offset_packing_formats s &&)@)@)DDDr c : | j | j dz z S )Nrr )r r rT s r r z*ShareableList._offset_back_transform_codes s ++dnnq.@@@r c , t fd| D S )zCL.count(value) -> integer -- return number of occurrences of value.c 3 ( K | ] }|k( y wrR rm )r entryru s r r z&ShareableList.count..
s 4te5E>ts )r )rH ru s `r countzShareableList.count s 4t444r c V t | D ] \ }}||k( s |c S t |d )zpL.index(value) -> integer -- return first index of value.
Raises ValueError if the value is not present.z not in this container) enumerater )rH ru r r s r indexzShareableList.index s7 )OHe~ / y(> ?@ @r rR )&r\ ri rj rk r floatboolr r rW r r r staticmethodr rP r r r r r rX r r] rl r r r r r r r r r classmethodtypes GenericAlias__class_getitem__rm r r r r sI *& S
s j U
u
N J @ . Gd GR
"
," JB?;R
* * % % $ $ ( (
E E A A5
A $E$6$67r )rk __all__ functoolsr r0 r! r< r r r r r5 r% r& r r O_CREATr$ r r
r r r r| r rm r r r s
O
-
77d?JJ
**ryy
BE BEJ
]8 ]8r